[2025-09-28T00:48:15.571201] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-28T00:48:15.571981] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T00:48:15.572132] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T00:48:15.572192] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T00:48:17.159073] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T00:48:17.159287] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T00:48:17.159503] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T00:48:17.161105] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T00:48:17.161176] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T00:48:17.161213] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T00:48:17.161537] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-28T00:48:17.161601] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-28T00:48:17.161696] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-28T00:48:17.161762] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-28T00:48:17.594352] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T00:48:17.594788] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-28T00:48:17.998150] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-28T00:48:17.999296] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-28T00:48:18.331896] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-28T00:48:18.333876] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-28T00:48:18.671829] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-28T00:48:18.673193] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-28T00:48:19.207932] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-28T00:48:19.209116] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-28T00:48:19.553020] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-28T00:48:19.554283] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-28T00:48:19.794561] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-28T00:48:19.795501] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-28T00:48:20.043322] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-28T00:48:20.044309] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-28T00:48:20.360413] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-28T00:48:20.361720] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-28T00:48:20.788417] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-28T00:48:20.789692] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-28T00:48:21.115849] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-28T00:48:21.116667] [INFO ] [REMOTE ] AAM: Full fetch complete (966 records). [2025-09-28T00:48:21.116785] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-28T00:48:21.117289] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T00:48:21.117367] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T00:48:21.117419] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T00:48:21.117488] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-28T00:48:21.117554] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-28T00:48:21.117682] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-28T00:48:21.117766] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-28T00:49:13.940110] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-28T00:49:13.940335] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T00:49:13.940449] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T00:49:13.940494] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T00:49:15.496902] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T00:49:15.497131] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T00:49:15.497404] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T00:49:15.498134] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T00:49:15.498212] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T00:49:15.498283] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T00:49:15.498624] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-28T00:49:15.498730] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-28T00:49:15.498874] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-28T00:49:15.498992] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-28T00:49:16.034161] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T00:49:16.034522] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-28T00:49:16.247261] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T00:49:16.247601] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-28T00:49:16.248053] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-28T00:49:16.452095] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T00:49:16.452403] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-28T00:49:16.454200] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-28T00:49:16.671821] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T00:49:16.672221] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-28T00:49:16.672778] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-28T00:49:16.874332] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T00:49:16.874723] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-28T00:49:16.875223] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-28T00:49:17.075498] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T00:49:17.075930] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-28T00:49:17.076413] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-28T00:49:18.003600] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-28T00:49:18.009374] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-28T00:49:19.621737] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-28T00:49:19.634348] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-28T00:49:21.291409] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-28T00:49:21.301361] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-28T00:49:22.967859] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-28T00:49:22.977919] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-28T00:49:24.449780] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-28T00:49:24.459295] [INFO ] [REMOTE ] HNGE: Full fetch complete (27204 records). [2025-09-28T00:49:24.459490] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-28T00:49:24.654566] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 88 unique days, need 200 days [2025-09-28T00:49:24.654960] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-28T00:49:24.655020] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-28T00:49:24.655080] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-28T00:49:24.655191] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-28T00:49:24.655257] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-28T00:49:24.655323] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-28T01:18:58.872681] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-28T01:18:58.872900] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T01:18:58.873014] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T01:18:58.873059] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T01:19:00.526269] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T01:19:00.526456] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T01:19:00.526697] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T01:19:00.527545] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T01:19:00.527619] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T01:19:00.527692] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T01:19:00.527951] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-28T01:19:00.528022] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-28T01:19:00.528091] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-28T01:19:00.528153] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-28T01:19:00.900802] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:19:00.901140] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-28T01:19:01.088129] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:19:01.088478] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-28T01:19:01.088958] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-28T01:19:01.228292] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:19:01.228696] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-28T01:19:01.229149] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-28T01:19:01.367746] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:19:01.368159] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-28T01:19:01.368605] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-28T01:19:01.529690] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:19:01.530148] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-28T01:19:01.530786] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-28T01:19:01.664619] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:19:01.664981] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-28T01:19:01.665378] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-28T01:19:02.148815] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-28T01:19:02.152409] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-28T01:19:02.949386] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-28T01:19:02.960455] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-28T01:19:03.556754] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-28T01:19:03.565458] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-28T01:19:04.315562] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-28T01:19:04.324876] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-28T01:19:05.121212] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-28T01:19:05.130322] [INFO ] [REMOTE ] HNGE: Full fetch complete (27204 records). [2025-09-28T01:19:05.130426] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-28T01:19:05.322386] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 88 unique days, need 200 days [2025-09-28T01:19:05.322787] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-28T01:19:05.322861] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-28T01:19:05.322919] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-28T01:19:05.322990] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-28T01:19:05.323039] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-28T01:19:05.323120] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-28T01:34:16.519835] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-28T01:34:16.520079] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T01:34:16.520192] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T01:34:16.520266] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T01:34:18.090108] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T01:34:18.090297] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T01:34:18.090533] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T01:34:18.091453] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T01:34:18.091534] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T01:34:18.091607] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T01:34:18.091759] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T01:34:18.091833] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T01:34:18.092219] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T01:34:18.092292] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T01:34:18.092501] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T01:34:18.092603] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T01:34:18.092709] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T01:34:18.092795] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T01:34:18.122116] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T01:34:18.149229] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T01:34:18.149356] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T01:34:18.149431] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T01:34:18.149507] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T01:34:18.149965] [WARN ] [STATE ] State set to: RUNNING [2025-09-28T01:34:18.150049] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-09-28T01:34:18.150124] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T01:34:18.150290] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T01:34:18.150372] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T01:34:18.730956] [WARN ] [STATE ] Received SIGINT signal. Initiating graceful shutdown... [2025-09-28T01:34:18.731246] [WARN ] [STATE ] Operation was interrupted, setting state to COMPLETED_ERROR [2025-09-28T01:34:18.731483] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-09-28T01:34:18.731783] [INFO ] [STATE ] Last completion updated: 2025-09-28T01:34:18.731565 [2025-09-28T01:34:19.009724] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T01:34:19.009914] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T01:34:19.010150] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T01:34:19.010759] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T01:34:19.010849] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T01:34:19.010920] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T01:34:19.011043] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-28T01:34:19.011115] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T01:34:19.011183] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T01:34:19.011560] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T01:34:19.011630] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T01:34:19.011843] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T01:34:19.011915] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T01:34:19.011993] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T01:34:19.012065] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T01:34:19.038247] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T01:34:19.064678] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T01:34:19.064961] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T01:34:19.065040] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T01:34:19.065112] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T01:34:19.065192] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T01:34:19.065581] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T01:34:19.065676] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T01:34:19.065753] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-28T01:34:19.065823] [INFO ] [MAIN ] Running in parallel mode [2025-09-28T01:34:19.066092] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-28T01:34:19.066236] [WARN ] [MAIN ] Main thread: Shutdown detected, stopping task submission [2025-09-28T01:34:19.066313] [WARN ] [MAIN ] Shutting down thread pool executor... [2025-09-28T01:34:19.066407] [WARN ] [MAIN ] Update INTERRUPTED after 0.0s. Processed 0/2371 symbols before shutdown. [2025-09-28T01:34:19.693315] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_ERROR: TDM All Symbols Update Failed' [2025-09-28T01:34:19.693946] [WARN ] [STATE ] State set to: RUNNING [2025-09-28T01:34:19.694028] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-09-28T01:34:19.694101] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T01:34:19.694257] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T01:34:19.694332] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T01:34:21.114742] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T01:34:21.115025] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T01:34:21.115295] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T01:34:21.115838] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T01:34:21.115918] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T01:34:21.115993] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T01:34:21.116109] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-28T01:34:21.116214] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T01:34:21.116285] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T01:34:21.116754] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T01:34:21.116829] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T01:34:21.117053] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T01:34:21.117130] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T01:34:21.117202] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T01:34:21.117274] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T01:34:21.147995] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T01:34:21.175082] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T01:34:21.175360] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T01:34:21.175438] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T01:34:21.175509] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T01:34:21.175632] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-28T01:34:21.175741] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-28T01:34:21.175881] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-28T01:34:21.177602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-28T01:34:21.178429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-28T01:34:21.178804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-28T01:34:21.179123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-28T01:34:21.179489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-28T01:34:21.179820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-28T01:34:21.180192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-28T01:34:21.180493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-28T01:34:21.180795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-28T01:34:21.181177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-28T01:34:21.181488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-28T01:34:21.181816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-28T01:34:21.182362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-28T01:34:21.182802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-28T01:34:21.183059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-28T01:34:21.183345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-28T01:34:21.183805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-28T01:34:21.184197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-28T01:34:21.184485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-28T01:34:21.184914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-28T01:34:21.185210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-28T01:34:21.185518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-28T01:34:21.185874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-28T01:34:21.186121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-28T01:34:21.186402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-28T01:34:21.186836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-28T01:34:21.187253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-28T01:34:21.187535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-28T01:34:21.187892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-28T01:34:21.188177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-09-28T01:34:21.188471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-28T01:34:21.188802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-28T01:34:21.189083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-28T01:34:21.189455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-28T01:34:21.189840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-28T01:34:21.190132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-28T01:34:21.190476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-28T01:34:21.190797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-28T01:34:21.191067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-28T01:34:21.191324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-28T01:34:21.191584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-28T01:34:21.191842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-28T01:34:21.192073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-28T01:34:21.192311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-28T01:34:21.192537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-28T01:34:21.192997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-28T01:34:21.193280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-28T01:34:21.193994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-28T01:34:21.194279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-28T01:34:21.194487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-28T01:34:21.195148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-28T01:34:21.195394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-28T01:34:21.195728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-28T01:34:21.196178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-28T01:34:21.196464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-28T01:34:21.196867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-28T01:34:21.197183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-28T01:34:21.197602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-28T01:34:21.197893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-28T01:34:21.198277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-28T01:34:21.198676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-28T01:34:21.198924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-28T01:34:21.199146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-28T01:34:21.199397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-28T01:34:21.199695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-28T01:34:21.199934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-28T01:34:21.200187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-28T01:34:21.200449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-28T01:34:21.200792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-28T01:34:21.201080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-28T01:34:21.201526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-28T01:34:21.201801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-28T01:34:21.202091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-28T01:34:21.202322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-28T01:34:21.202538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-28T01:34:21.203040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-28T01:34:21.203316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-28T01:34:21.203553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-28T01:34:21.203861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-28T01:34:21.204096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-28T01:34:21.204487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-28T01:34:21.204808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-28T01:34:21.205145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-28T01:34:21.205695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-28T01:34:21.205925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-28T01:34:21.206479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-28T01:34:21.206808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-28T01:34:21.207046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-28T01:34:21.207305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-28T01:34:21.207541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-28T01:34:21.207877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-28T01:34:21.208189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-28T01:34:21.208472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-28T01:34:21.208848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-28T01:34:21.209222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-28T01:34:21.209477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-28T01:34:21.209832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-28T01:34:21.210162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-28T01:34:21.210393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-28T01:34:21.210907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-28T01:34:21.211241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-28T01:34:21.211513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-28T01:34:21.211750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-28T01:34:21.211994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-28T01:34:21.212246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-28T01:34:21.212461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-28T01:34:21.212737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-28T01:34:21.213024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-28T01:34:21.213251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-28T01:34:21.213556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-28T01:34:21.213842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-28T01:34:21.214123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-28T01:34:21.214488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-28T01:34:21.214873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-28T01:34:21.215131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-28T01:34:21.215373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-28T01:34:21.215681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-28T01:34:21.215951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-28T01:34:21.216520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-28T01:34:21.216859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-28T01:34:21.217094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-28T01:34:21.217307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-28T01:34:21.217506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-28T01:34:21.217829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-28T01:34:21.218130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-09-28T01:34:21.218441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-28T01:34:21.218935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-28T01:34:21.219123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-28T01:34:21.219441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-28T01:34:21.219800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-28T01:34:21.220151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-28T01:34:21.220569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-28T01:34:21.220902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-28T01:34:21.221162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-28T01:34:21.221412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-28T01:34:21.221797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-28T01:34:21.222037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-28T01:34:21.222262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-28T01:34:21.222546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-28T01:34:21.222884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-28T01:34:21.223087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-28T01:34:21.223316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-28T01:34:21.223505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-28T01:34:21.224033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-28T01:34:21.224287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-28T01:34:21.224493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-28T01:34:21.224727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-28T01:34:21.224959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-28T01:34:21.225223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-28T01:34:21.225530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-28T01:34:21.225814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-28T01:34:21.226299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-28T01:34:21.226672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-28T01:34:21.227254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-09-28T01:34:21.227512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-28T01:34:21.227758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-28T01:34:21.228162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-28T01:34:21.228384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-28T01:34:21.228658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-28T01:34:21.228931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-28T01:34:21.229172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-28T01:34:21.229487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-28T01:34:21.229743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-28T01:34:21.230133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-28T01:34:21.230412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-28T01:34:21.230630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-28T01:34:21.230899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-28T01:34:21.231192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-09-28T01:34:21.231583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-28T01:34:21.232041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-28T01:34:21.232316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-28T01:34:21.232623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-28T01:34:21.232899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-28T01:34:21.233101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-28T01:34:21.233360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-28T01:34:21.233677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-28T01:34:21.233919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-28T01:34:21.234308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-28T01:34:21.234590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-28T01:34:21.234806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-28T01:34:21.235063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-28T01:34:21.235312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-28T01:34:21.235545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-28T01:34:21.235806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-28T01:34:21.236019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-28T01:34:21.236229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-28T01:34:21.236426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-28T01:34:21.236686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-28T01:34:21.237051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-28T01:34:21.237279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-28T01:34:21.237485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-28T01:34:21.237764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-28T01:34:21.237987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-28T01:34:21.238270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-28T01:34:21.238562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-28T01:34:21.238821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-28T01:34:21.239112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-28T01:34:21.239334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-28T01:34:21.239570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-28T01:34:21.239976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-09-28T01:34:21.240226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-28T01:34:21.240496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-28T01:34:21.240732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-28T01:34:21.241058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-28T01:34:21.241339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-28T01:34:21.241584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-28T01:34:21.241916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-28T01:34:21.242163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-28T01:34:21.242428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-28T01:34:21.242720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-28T01:34:21.243104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-28T01:34:21.243333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-28T01:34:21.243551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-28T01:34:21.243931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-28T01:34:21.244164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-28T01:34:21.244473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-28T01:34:21.244760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-28T01:34:21.244994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-28T01:34:21.245221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-28T01:34:21.245539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-28T01:34:21.245798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-28T01:34:21.246064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-28T01:34:21.246342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-28T01:34:21.246871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-28T01:34:21.247157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-28T01:34:21.247431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-28T01:34:21.247882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-28T01:34:21.248210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-28T01:34:21.248495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-28T01:34:21.249070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-09-28T01:34:21.249280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-28T01:34:21.249546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-28T01:34:21.249865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-28T01:34:21.250200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-28T01:34:21.250454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-28T01:34:21.250767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-28T01:34:21.251012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-28T01:34:21.251571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-28T01:34:21.251931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-28T01:34:21.252186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-28T01:34:21.252463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-28T01:34:21.252721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-28T01:34:21.252999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-28T01:34:21.253299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-28T01:34:21.253697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-28T01:34:21.253922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-28T01:34:21.254117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-28T01:34:21.254308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-28T01:34:21.254572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-28T01:34:21.254900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-28T01:34:21.255163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-28T01:34:21.255397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-28T01:34:21.255695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-28T01:34:21.255959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-28T01:34:21.256258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-28T01:34:21.256606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-28T01:34:21.257112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-28T01:34:21.257302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-28T01:34:21.257539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-28T01:34:21.257845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-28T01:34:21.258338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-28T01:34:21.258777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-28T01:34:21.259011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-28T01:34:21.259231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-28T01:34:21.259474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-28T01:34:21.259693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-28T01:34:21.259946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-28T01:34:21.260212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-28T01:34:21.260478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-28T01:34:21.260761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-28T01:34:21.261321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-09-28T01:34:21.261578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-28T01:34:21.261924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-28T01:34:21.262201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-28T01:34:21.262477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-28T01:34:21.262729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-28T01:34:21.263000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-28T01:34:21.263253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-28T01:34:21.263472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-28T01:34:21.263827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-28T01:34:21.264094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-28T01:34:21.264284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-28T01:34:21.264568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-28T01:34:21.264871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-28T01:34:21.265087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-28T01:34:21.265316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-28T01:34:21.265507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-28T01:34:21.265755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-28T01:34:21.265995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-28T01:34:21.266233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-28T01:34:21.266469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-28T01:34:21.266684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-28T01:34:21.266858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-28T01:34:21.267129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-28T01:34:21.267447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-28T01:34:21.267719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-28T01:34:21.267966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-28T01:34:21.268231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-28T01:34:21.268429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-28T01:34:21.268703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-28T01:34:21.268938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-28T01:34:21.269168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-28T01:34:21.269471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-28T01:34:21.269719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-28T01:34:21.270014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-28T01:34:21.270217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-28T01:34:21.270457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-28T01:34:21.270914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-28T01:34:21.271120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-28T01:34:21.271398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-28T01:34:21.271662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-28T01:34:21.271891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-28T01:34:21.272084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-28T01:34:21.272427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-28T01:34:21.272710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-28T01:34:21.272976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-28T01:34:21.273252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-28T01:34:21.273464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-28T01:34:21.273750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-28T01:34:21.273980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-28T01:34:21.274341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-09-28T01:34:21.274560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-28T01:34:21.274788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-28T01:34:21.275037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-28T01:34:21.275320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-28T01:34:21.275514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-28T01:34:21.275740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-28T01:34:21.275999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-28T01:34:21.276290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-28T01:34:21.276713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-28T01:34:21.276964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-28T01:34:21.277230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-28T01:34:21.277475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-28T01:34:21.277932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-28T01:34:21.278126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-28T01:34:21.278363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-28T01:34:21.278549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-28T01:34:21.278773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-28T01:34:21.279004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-28T01:34:21.279259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-28T01:34:21.279494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-28T01:34:21.279764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-28T01:34:21.280050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-28T01:34:21.280541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-28T01:34:21.280815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-28T01:34:21.280973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-09-28T01:34:21.281314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-28T01:34:21.281518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-28T01:34:21.281860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-28T01:34:21.282115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-28T01:34:21.282313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-28T01:34:21.282511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-28T01:34:21.282792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-28T01:34:21.283031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-28T01:34:21.283237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-28T01:34:21.283469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-28T01:34:21.283711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-09-28T01:34:21.283956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-28T01:34:21.284173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-28T01:34:21.284372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-28T01:34:21.284549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-28T01:34:21.284765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-28T01:34:21.284996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-28T01:34:21.285244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-28T01:34:21.285473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-28T01:34:21.285771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-28T01:34:21.285961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-28T01:34:21.286177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-28T01:34:21.286362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-28T01:34:21.286611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-28T01:34:21.286950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-28T01:34:21.287166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-09-28T01:34:21.287445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-28T01:34:21.287598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-28T01:34:21.287822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-28T01:34:21.288097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-28T01:34:21.288579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-28T01:34:21.288786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-28T01:34:21.289009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-28T01:34:21.289201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-28T01:34:21.289454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-28T01:34:21.289668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-28T01:34:21.289882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-28T01:34:21.290165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-09-28T01:34:21.290424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-09-28T01:34:21.290624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-28T01:34:21.290966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-28T01:34:21.291299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-28T01:34:21.291533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-28T01:34:21.291746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-28T01:34:21.291946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-28T01:34:21.292159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-09-28T01:34:21.292464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-28T01:34:21.292718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-28T01:34:21.292962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-28T01:34:21.293166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-28T01:34:21.293380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-28T01:34:21.293601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-28T01:34:21.293889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-28T01:34:21.294057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-28T01:34:21.294284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-28T01:34:21.294535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-28T01:34:21.294748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-28T01:34:21.294981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-28T01:34:21.295178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-28T01:34:21.295365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-28T01:34:21.295701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-28T01:34:21.295900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-28T01:34:21.296087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-28T01:34:21.296355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-28T01:34:21.296621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-28T01:34:21.296900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-28T01:34:21.297150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-28T01:34:21.297341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-28T01:34:21.297529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-28T01:34:21.297756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-28T01:34:21.297997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-28T01:34:21.298277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-09-28T01:34:21.298471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-28T01:34:21.298780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-28T01:34:21.299078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-28T01:34:21.299304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-28T01:34:21.299513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-28T01:34:21.299811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-28T01:34:21.300008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-09-28T01:34:21.300203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-28T01:34:21.300408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-28T01:34:21.300678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-28T01:34:21.300867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-28T01:34:21.301060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-28T01:34:21.301334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-28T01:34:21.301621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-28T01:34:21.301871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-28T01:34:21.302073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-28T01:34:21.302286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-28T01:34:21.302492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-28T01:34:21.302933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-28T01:34:21.303170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-28T01:34:21.303352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-28T01:34:21.303555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-28T01:34:21.303751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-28T01:34:21.304129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-28T01:34:21.304319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-28T01:34:21.304495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-28T01:34:21.304718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-28T01:34:21.304897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-28T01:34:21.305092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-28T01:34:21.305299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-28T01:34:21.305490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-28T01:34:21.305693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-28T01:34:21.305931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-28T01:34:21.306135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-28T01:34:21.306330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-28T01:34:21.306513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-28T01:34:21.306755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-28T01:34:21.306970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-28T01:34:21.307220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-28T01:34:21.307435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-28T01:34:21.307709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-28T01:34:21.307883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-28T01:34:21.308095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-28T01:34:21.308272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-28T01:34:21.308499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-28T01:34:21.308762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-28T01:34:21.308951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-28T01:34:21.309419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-28T01:34:21.309600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-28T01:34:21.309854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-09-28T01:34:21.310096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-28T01:34:21.310306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-28T01:34:21.310506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-28T01:34:21.310814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-28T01:34:21.311034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-28T01:34:21.311217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-28T01:34:21.311403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-28T01:34:21.311598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-28T01:34:21.312012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-28T01:34:21.312203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-28T01:34:21.312546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-28T01:34:21.312832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-28T01:34:21.313070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-28T01:34:21.313271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-28T01:34:21.313460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-28T01:34:21.313703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-28T01:34:21.313956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-28T01:34:21.314138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-28T01:34:21.314333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-28T01:34:21.314560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-28T01:34:21.314896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-28T01:34:21.315161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-09-28T01:34:21.315426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-28T01:34:21.315684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-28T01:34:21.315867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-28T01:34:21.316105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-28T01:34:21.316289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-28T01:34:21.316494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-28T01:34:21.316742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-28T01:34:21.316966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-28T01:34:21.317184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-28T01:34:21.317443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-28T01:34:21.317693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-28T01:34:21.317930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-28T01:34:21.318125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-28T01:34:21.318320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-28T01:34:21.318520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-28T01:34:21.318755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-28T01:34:21.318997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-28T01:34:21.319200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-28T01:34:21.319440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-28T01:34:21.319710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-28T01:34:21.319929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-28T01:34:21.320233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-28T01:34:21.320432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-28T01:34:21.320674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-28T01:34:21.320879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-28T01:34:21.321109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-28T01:34:21.321343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-09-28T01:34:21.321538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-28T01:34:21.321784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-09-28T01:34:21.321950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-28T01:34:21.322163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-28T01:34:21.322373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-28T01:34:21.322559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-28T01:34:21.322933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-28T01:34:21.323164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-28T01:34:21.323350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-28T01:34:21.323840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-28T01:34:21.324077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-28T01:34:21.324285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-28T01:34:21.324491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-28T01:34:21.324686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-28T01:34:21.324907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-28T01:34:21.325108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-28T01:34:21.325337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-09-28T01:34:21.325570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-28T01:34:21.326144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-28T01:34:21.326318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-28T01:34:21.326576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-28T01:34:21.326804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-28T01:34:21.327003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-28T01:34:21.327186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-28T01:34:21.327381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-28T01:34:21.327553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-28T01:34:21.327775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-09-28T01:34:21.327979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-28T01:34:21.328167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-28T01:34:21.328413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-09-28T01:34:21.328609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-28T01:34:21.328939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-28T01:34:21.329130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-28T01:34:21.329308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-28T01:34:21.329498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-28T01:34:21.329784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-28T01:34:21.329987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-28T01:34:21.330166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-28T01:34:21.330525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-28T01:34:21.330846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-28T01:34:21.331105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-28T01:34:21.331340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-28T01:34:21.331844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-28T01:34:21.332068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-28T01:34:21.332282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-28T01:34:21.332481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-28T01:34:21.332703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-28T01:34:21.332895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-28T01:34:21.333093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-28T01:34:21.333430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-28T01:34:21.333635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-28T01:34:21.334207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-28T01:34:21.334445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-28T01:34:21.334874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-09-28T01:34:21.335113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-28T01:34:21.335342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-28T01:34:21.335503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-28T01:34:21.335707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-28T01:34:21.335888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-28T01:34:21.336070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-28T01:34:21.336299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-28T01:34:21.336497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-28T01:34:21.336887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-28T01:34:21.337129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-28T01:34:21.337308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-28T01:34:21.337511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-28T01:34:21.337818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-28T01:34:21.338137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-28T01:34:21.338365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-28T01:34:21.338805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-28T01:34:21.339090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-28T01:34:21.339339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-28T01:34:21.339511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-28T01:34:21.339722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-28T01:34:21.339966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-28T01:34:21.340165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-28T01:34:21.340364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-28T01:34:21.340594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-28T01:34:21.340803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-28T01:34:21.341020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-28T01:34:21.341230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-28T01:34:21.341426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-28T01:34:21.341630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-28T01:34:21.341893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-28T01:34:21.342097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-28T01:34:21.342331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-28T01:34:21.342546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-28T01:34:21.342913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-28T01:34:21.343102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-28T01:34:21.343310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-28T01:34:21.343535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-28T01:34:21.343751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-28T01:34:21.343958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-28T01:34:21.344263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-28T01:34:21.344447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-28T01:34:21.344638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-28T01:34:21.344920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-28T01:34:21.345298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-28T01:34:21.345589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-28T01:34:21.345796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-28T01:34:21.346362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-28T01:34:21.346564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-28T01:34:21.346822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-28T01:34:21.346997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-28T01:34:21.347249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-28T01:34:21.347449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-28T01:34:21.347691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-28T01:34:21.347882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-28T01:34:21.348109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-28T01:34:21.348316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-28T01:34:21.348492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-28T01:34:21.348684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-28T01:34:21.348953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-28T01:34:21.349139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-28T01:34:21.349305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-28T01:34:21.349531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-28T01:34:21.349719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-28T01:34:21.349967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-28T01:34:21.350161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-28T01:34:21.350374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-28T01:34:21.350572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-28T01:34:21.350869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-28T01:34:21.351041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-28T01:34:21.351317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-28T01:34:21.351538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-28T01:34:21.351728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-28T01:34:21.352040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-28T01:34:21.352213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-28T01:34:21.352432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-28T01:34:21.352636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-28T01:34:21.353019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-28T01:34:21.353191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-28T01:34:21.353481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-28T01:34:21.353672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-28T01:34:21.353858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-28T01:34:21.354040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-28T01:34:21.354253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-28T01:34:21.354432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-28T01:34:21.354610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-28T01:34:21.354849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-28T01:34:21.355122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-28T01:34:21.355333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-28T01:34:21.355538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-28T01:34:21.355757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-28T01:34:21.356262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-28T01:34:21.356463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-28T01:34:21.356737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-28T01:34:21.356950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-28T01:34:21.357362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-28T01:34:21.357550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-09-28T01:34:21.357791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-28T01:34:21.357969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-28T01:34:21.358156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-28T01:34:21.358374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-28T01:34:21.358611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-28T01:34:21.359016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-28T01:34:21.359223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-28T01:34:21.359408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-28T01:34:21.359596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-28T01:34:21.359788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-28T01:34:21.359968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-28T01:34:21.360165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-28T01:34:21.360595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-28T01:34:21.360817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-28T01:34:21.361008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-28T01:34:21.361209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-28T01:34:21.361489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-09-28T01:34:21.361708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-28T01:34:21.361910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-28T01:34:21.362103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-28T01:34:21.362455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-28T01:34:21.362696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-28T01:34:21.362887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-28T01:34:21.363142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-28T01:34:21.363404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-28T01:34:21.363617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-28T01:34:21.363837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-28T01:34:21.364012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-28T01:34:21.364246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-28T01:34:21.364744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-28T01:34:21.364966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-28T01:34:21.365194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-28T01:34:21.365449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-28T01:34:21.365746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-28T01:34:21.366143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-28T01:34:21.366371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-28T01:34:21.366615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-28T01:34:21.366941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-28T01:34:21.367128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-28T01:34:21.367453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-28T01:34:21.367635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-28T01:34:21.367880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-09-28T01:34:21.368141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-28T01:34:21.368309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-28T01:34:21.368608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-28T01:34:21.368802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-28T01:34:21.369020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-28T01:34:21.369395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-28T01:34:21.369706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-28T01:34:21.369894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-28T01:34:21.370118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-28T01:34:21.370310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-28T01:34:21.370489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-28T01:34:21.370791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-28T01:34:21.370969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-09-28T01:34:21.371225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-28T01:34:21.371444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-28T01:34:21.371779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-28T01:34:21.371969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-28T01:34:21.372176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-28T01:34:21.372357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-28T01:34:21.372582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-28T01:34:21.372785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-28T01:34:21.373019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-28T01:34:21.373527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-09-28T01:34:21.373914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-28T01:34:21.374093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-28T01:34:21.374269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-28T01:34:21.374566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-28T01:34:21.374756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-28T01:34:21.374961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-28T01:34:21.375238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-28T01:34:21.375524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-28T01:34:21.375743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-28T01:34:21.375969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-28T01:34:21.376138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-28T01:34:21.376312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-28T01:34:21.376512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-28T01:34:21.376699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-28T01:34:21.376902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-28T01:34:21.377124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-28T01:34:21.377307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-28T01:34:21.377552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-09-28T01:34:21.377908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-28T01:34:21.378198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-28T01:34:21.378376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-28T01:34:21.378594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-28T01:34:21.378865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-28T01:34:21.379035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-28T01:34:21.379244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-28T01:34:21.379428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-28T01:34:21.379630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-28T01:34:21.379833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-28T01:34:21.380063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-28T01:34:21.380375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-28T01:34:21.380563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-28T01:34:21.380839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-28T01:34:21.381039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-28T01:34:21.381215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-28T01:34:21.381429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-28T01:34:21.381615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-28T01:34:21.381861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-28T01:34:21.382061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-28T01:34:21.382241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-28T01:34:21.382477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-28T01:34:21.382637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-28T01:34:21.382878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-28T01:34:21.383099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-28T01:34:21.383307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-28T01:34:21.383468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-28T01:34:21.383685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-28T01:34:21.383930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-28T01:34:21.384110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-28T01:34:21.384291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-28T01:34:21.384546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-28T01:34:21.384740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-28T01:34:21.384936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-28T01:34:21.385129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-28T01:34:21.385369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-28T01:34:21.385576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-28T01:34:21.385834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-28T01:34:21.386027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-28T01:34:21.386236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-28T01:34:21.386492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-28T01:34:21.387034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-28T01:34:21.387231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-28T01:34:21.387410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-28T01:34:21.387876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-28T01:34:21.388054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-28T01:34:21.388234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-28T01:34:21.388501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-28T01:34:21.388801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-09-28T01:34:21.389120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-28T01:34:21.389432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-28T01:34:21.389609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-28T01:34:21.389859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-28T01:34:21.390029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-28T01:34:21.390237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-28T01:34:21.390446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-28T01:34:21.390637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-28T01:34:21.390935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-28T01:34:21.391277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-28T01:34:21.391737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-28T01:34:21.391904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-28T01:34:21.392183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-28T01:34:21.392435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-28T01:34:21.392630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-28T01:34:21.392876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-28T01:34:21.393119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-28T01:34:21.393299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-28T01:34:21.393486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-28T01:34:21.393708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-28T01:34:21.393925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-09-28T01:34:21.394103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-28T01:34:21.394286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-28T01:34:21.394467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-28T01:34:21.394871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-28T01:34:21.395106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-28T01:34:21.395328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-28T01:34:21.395553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-28T01:34:21.395773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-28T01:34:21.395939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-28T01:34:21.396112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-28T01:34:21.396309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-28T01:34:21.396466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-28T01:34:21.396728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-28T01:34:21.397108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-28T01:34:21.397265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-28T01:34:21.397440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-28T01:34:21.397635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-28T01:34:21.397868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-28T01:34:21.398081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-09-28T01:34:21.398252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-28T01:34:21.398499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-28T01:34:21.398764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-28T01:34:21.398986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-28T01:34:21.399339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-09-28T01:34:21.399523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-28T01:34:21.399739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-28T01:34:21.399929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-28T01:34:21.400118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-28T01:34:21.400318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-28T01:34:21.400520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-28T01:34:21.400752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-28T01:34:21.400940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-28T01:34:21.401104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-28T01:34:21.401263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-28T01:34:21.401454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-28T01:34:21.401689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-28T01:34:21.401980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-28T01:34:21.402147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-28T01:34:21.402311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-28T01:34:21.402494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-28T01:34:21.402811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-28T01:34:21.402981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-28T01:34:21.403139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-28T01:34:21.403322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-28T01:34:21.403532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-28T01:34:21.403757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-09-28T01:34:21.403941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-28T01:34:21.404168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-28T01:34:21.404348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-09-28T01:34:21.404514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-28T01:34:21.404698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-28T01:34:21.404895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-28T01:34:21.405110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-09-28T01:34:21.405285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-28T01:34:21.405470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-28T01:34:21.405699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-28T01:34:21.405982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-28T01:34:21.406168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-28T01:34:21.406349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-28T01:34:21.406542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-28T01:34:21.406762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-28T01:34:21.406968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-28T01:34:21.407188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-28T01:34:21.407358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-09-28T01:34:21.407608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-28T01:34:21.407811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-28T01:34:21.407986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-28T01:34:21.408414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-28T01:34:21.408628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-28T01:34:21.408817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-28T01:34:21.409054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-28T01:34:21.409224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-28T01:34:21.409440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-28T01:34:21.409619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-28T01:34:21.409831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-28T01:34:21.410027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-28T01:34:21.410217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-28T01:34:21.410393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-28T01:34:21.410565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-28T01:34:21.410772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-28T01:34:21.410987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-28T01:34:21.411194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-28T01:34:21.411398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-28T01:34:21.411563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-28T01:34:21.411777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-28T01:34:21.411985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-28T01:34:21.412197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-28T01:34:21.412386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-28T01:34:21.412604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-28T01:34:21.412951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-28T01:34:21.413141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-28T01:34:21.413300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-28T01:34:21.413478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-28T01:34:21.413702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-28T01:34:21.413934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-28T01:34:21.414169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-28T01:34:21.414369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-28T01:34:21.414595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-28T01:34:21.414796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-28T01:34:21.414981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-28T01:34:21.415176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-28T01:34:21.415370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-28T01:34:21.415728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-28T01:34:21.415922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-28T01:34:21.416136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-28T01:34:21.416304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-28T01:34:21.416484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-28T01:34:21.416734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-28T01:34:21.416880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-28T01:34:21.417298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-28T01:34:21.417505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-28T01:34:21.417696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-28T01:34:21.417912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-28T01:34:21.418074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-28T01:34:21.418250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-28T01:34:21.418404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-28T01:34:21.418561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-28T01:34:21.418794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-28T01:34:21.418981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-28T01:34:21.419310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-28T01:34:21.419485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-28T01:34:21.419682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-28T01:34:21.419866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-28T01:34:21.420093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-28T01:34:21.420259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-28T01:34:21.420475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-28T01:34:21.420669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-28T01:34:21.420827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-28T01:34:21.420988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-28T01:34:21.421168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-28T01:34:21.421444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-28T01:34:21.421822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-28T01:34:21.422022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-28T01:34:21.422220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-28T01:34:21.422516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-28T01:34:21.422710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-28T01:34:21.422884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-28T01:34:21.423051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-28T01:34:21.423216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-28T01:34:21.423449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-28T01:34:21.423617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-28T01:34:21.423842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-09-28T01:34:21.423996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-28T01:34:21.424180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-28T01:34:21.424397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-28T01:34:21.424597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-28T01:34:21.425013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-28T01:34:21.425184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-28T01:34:21.425390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-28T01:34:21.425573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-28T01:34:21.425801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-28T01:34:21.425982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-28T01:34:21.426122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-28T01:34:21.426316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-28T01:34:21.426461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-28T01:34:21.426667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-28T01:34:21.426832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-28T01:34:21.427035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-28T01:34:21.427290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-28T01:34:21.427506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-28T01:34:21.427704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-28T01:34:21.427861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-28T01:34:21.428107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-28T01:34:21.428313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-28T01:34:21.428681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-28T01:34:21.428867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-28T01:34:21.429061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-09-28T01:34:21.429301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-09-28T01:34:21.429475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-28T01:34:21.429664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-28T01:34:21.429834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-28T01:34:21.429992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-28T01:34:21.430174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-28T01:34:21.430346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-28T01:34:21.430599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-28T01:34:21.430836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-28T01:34:21.431054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-28T01:34:21.431254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-28T01:34:21.431414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-28T01:34:21.431587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-28T01:34:21.431807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-28T01:34:21.431981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-28T01:34:21.432159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-28T01:34:21.432344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-28T01:34:21.432563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-28T01:34:21.432792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-28T01:34:21.433256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-28T01:34:21.433451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-28T01:34:21.433709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-28T01:34:21.433903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-28T01:34:21.434074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-09-28T01:34:21.434238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-28T01:34:21.434545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-28T01:34:21.434774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-28T01:34:21.434938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-28T01:34:21.435123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-28T01:34:21.435299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-28T01:34:21.435514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-28T01:34:21.435763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-09-28T01:34:21.435993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-28T01:34:21.436158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-28T01:34:21.436349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-28T01:34:21.436586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-28T01:34:21.436895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-28T01:34:21.437105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-28T01:34:21.437265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-28T01:34:21.437445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-28T01:34:21.437620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-28T01:34:21.437884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-28T01:34:21.438056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-28T01:34:21.438238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-28T01:34:21.438407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-28T01:34:21.438629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-09-28T01:34:21.438826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-28T01:34:21.438975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-28T01:34:21.439334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-28T01:34:21.439900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-28T01:34:21.440115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-28T01:34:21.440297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-28T01:34:21.440547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-28T01:34:21.440759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-28T01:34:21.440959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-28T01:34:21.441119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-28T01:34:21.441288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-28T01:34:21.441483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-28T01:34:21.441633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-28T01:34:21.441997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-28T01:34:21.442177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-28T01:34:21.442358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-28T01:34:21.442547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-28T01:34:21.442836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-28T01:34:21.443007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-28T01:34:21.443190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-28T01:34:21.443376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-28T01:34:21.443593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-28T01:34:21.443810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-28T01:34:21.444003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-28T01:34:21.444175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-28T01:34:21.444391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-28T01:34:21.444607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-28T01:34:21.444832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-28T01:34:21.444995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-28T01:34:21.445168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-28T01:34:21.445337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-28T01:34:21.445510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-28T01:34:21.445713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-28T01:34:21.445918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-28T01:34:21.446085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-28T01:34:21.446306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-28T01:34:21.446518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-28T01:34:21.446746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-28T01:34:21.446975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-28T01:34:21.447223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-28T01:34:21.447467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-28T01:34:21.447629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-09-28T01:34:21.447842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-28T01:34:21.448046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-28T01:34:21.448217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-28T01:34:21.448425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-28T01:34:21.448614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-28T01:34:21.448864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-28T01:34:21.449013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-28T01:34:21.449220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-28T01:34:21.449430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-28T01:34:21.449673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-28T01:34:21.449858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-28T01:34:21.450007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-28T01:34:21.450219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-28T01:34:21.450373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-28T01:34:21.450518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-28T01:34:21.450720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-28T01:34:21.450932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-28T01:34:21.451096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-09-28T01:34:21.451362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-28T01:34:21.451563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-28T01:34:21.451781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-28T01:34:21.451953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-28T01:34:21.452149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-09-28T01:34:21.452323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-28T01:34:21.452725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-09-28T01:34:21.452903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-28T01:34:21.453062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-28T01:34:21.453239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-28T01:34:21.453394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-28T01:34:21.453592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-28T01:34:21.453855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-28T01:34:21.454047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-28T01:34:21.454234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-28T01:34:21.454411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-28T01:34:21.454577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-28T01:34:21.454763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-28T01:34:21.454933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-28T01:34:21.455117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-28T01:34:21.455290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-28T01:34:21.455503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-28T01:34:21.455674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-28T01:34:21.455846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-28T01:34:21.456076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-28T01:34:21.456295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-28T01:34:21.456451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-28T01:34:21.456628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-28T01:34:21.456848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-28T01:34:21.457097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-28T01:34:21.457266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-28T01:34:21.457538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-28T01:34:21.457781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-28T01:34:21.457985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-28T01:34:21.458188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-28T01:34:21.458442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-28T01:34:21.458624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-28T01:34:21.459143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-28T01:34:21.459313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-28T01:34:21.459489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-28T01:34:21.459756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-28T01:34:21.459960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-28T01:34:21.460169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-28T01:34:21.460446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-28T01:34:21.460692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-28T01:34:21.460870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-28T01:34:21.461137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-28T01:34:21.461350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-28T01:34:21.461523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-28T01:34:21.461722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-28T01:34:21.461907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-28T01:34:21.462083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-09-28T01:34:21.462272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-28T01:34:21.462431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-28T01:34:21.462740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-28T01:34:21.462924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-28T01:34:21.463395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-28T01:34:21.463568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-28T01:34:21.463785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-28T01:34:21.463986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-28T01:34:21.464169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-28T01:34:21.464354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-28T01:34:21.464520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-28T01:34:21.464755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-28T01:34:21.464956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-28T01:34:21.465156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-28T01:34:21.465409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-28T01:34:21.465589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-28T01:34:21.465807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-28T01:34:21.466083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-28T01:34:21.466257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-28T01:34:21.466420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-28T01:34:21.466599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-28T01:34:21.466811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-28T01:34:21.467020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-28T01:34:21.467176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-28T01:34:21.467349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-28T01:34:21.467892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-28T01:34:21.468322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-28T01:34:21.468582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-28T01:34:21.468798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-28T01:34:21.468987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-28T01:34:21.469428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-28T01:34:21.469590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-28T01:34:21.469763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-28T01:34:21.469981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-28T01:34:21.470149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-28T01:34:21.470370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-28T01:34:21.470549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-28T01:34:21.470740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-28T01:34:21.470934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-28T01:34:21.471289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-28T01:34:21.471479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-28T01:34:21.471750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-28T01:34:21.471974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-28T01:34:21.472147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-28T01:34:21.472450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-28T01:34:21.472734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-28T01:34:21.472901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-28T01:34:21.473060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-28T01:34:21.473233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-28T01:34:21.473440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-28T01:34:21.473591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-28T01:34:21.473806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-28T01:34:21.473966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-28T01:34:21.474404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-28T01:34:21.474779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-28T01:34:21.475052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-28T01:34:21.475220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-28T01:34:21.475369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-28T01:34:21.475551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-28T01:34:21.475762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-28T01:34:21.475949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-28T01:34:21.476108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-28T01:34:21.476298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-28T01:34:21.476574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-28T01:34:21.476827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-28T01:34:21.477060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-28T01:34:21.477237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-28T01:34:21.477417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-28T01:34:21.477577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-28T01:34:21.477956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-28T01:34:21.478109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-28T01:34:21.478334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-28T01:34:21.478566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-28T01:34:21.478785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-28T01:34:21.478978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-28T01:34:21.479127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-28T01:34:21.479307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-28T01:34:21.479510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-28T01:34:21.479723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-28T01:34:21.479955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-28T01:34:21.480165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-09-28T01:34:21.480355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-28T01:34:21.480519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-28T01:34:21.480728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-28T01:34:21.480897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-28T01:34:21.481078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-28T01:34:21.481255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-28T01:34:21.481523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-28T01:34:21.481709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-28T01:34:21.481902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-28T01:34:21.482243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-28T01:34:21.482420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-28T01:34:21.482747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-28T01:34:21.482895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-28T01:34:21.483102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-28T01:34:21.483329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-28T01:34:21.483528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-28T01:34:21.483754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-28T01:34:21.483955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-28T01:34:21.484151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-28T01:34:21.484308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-28T01:34:21.484452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-28T01:34:21.484752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-28T01:34:21.484927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-28T01:34:21.485112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-28T01:34:21.485298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-28T01:34:21.485467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-28T01:34:21.485710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-28T01:34:21.485968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-28T01:34:21.486195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-28T01:34:21.486352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-28T01:34:21.486543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-09-28T01:34:21.486728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-28T01:34:21.486904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-09-28T01:34:21.487102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-28T01:34:21.487279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-28T01:34:21.487481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-28T01:34:21.487734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-28T01:34:21.488019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-28T01:34:21.488368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-28T01:34:21.488572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-28T01:34:21.488759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-28T01:34:21.488908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-28T01:34:21.489050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-28T01:34:21.489233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-28T01:34:21.489414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-28T01:34:21.489660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-28T01:34:21.489874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-28T01:34:21.490079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-28T01:34:21.490284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-28T01:34:21.490451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-28T01:34:21.490672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-28T01:34:21.490941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-28T01:34:21.491109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-28T01:34:21.491266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-28T01:34:21.491414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-28T01:34:21.491786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-28T01:34:21.491974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-28T01:34:21.492169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-28T01:34:21.492349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-28T01:34:21.492595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-28T01:34:21.492820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-28T01:34:21.492977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-28T01:34:21.493143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-28T01:34:21.493336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-28T01:34:21.493536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-28T01:34:21.493812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-28T01:34:21.494173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-28T01:34:21.494423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-09-28T01:34:21.494636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-09-28T01:34:21.494823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-28T01:34:21.495053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-28T01:34:21.495215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-28T01:34:21.495393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-28T01:34:21.495553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-28T01:34:21.495804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-28T01:34:21.496023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-28T01:34:21.496186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-28T01:34:21.496360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-28T01:34:21.496533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-28T01:34:21.496795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-28T01:34:21.497015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-28T01:34:21.497215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-28T01:34:21.497484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-28T01:34:21.497731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-28T01:34:21.497897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-28T01:34:21.498098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-28T01:34:21.498272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-28T01:34:21.498444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-28T01:34:21.498626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-28T01:34:21.498846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-28T01:34:21.499010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-28T01:34:21.499318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-28T01:34:21.499492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-28T01:34:21.499680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-28T01:34:21.499833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-28T01:34:21.500226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-28T01:34:21.500416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-28T01:34:21.500601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-28T01:34:21.500795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-28T01:34:21.500984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-28T01:34:21.501205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-28T01:34:21.501404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-09-28T01:34:21.501789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-28T01:34:21.501986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-28T01:34:21.502167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-28T01:34:21.502348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-28T01:34:21.502505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-28T01:34:21.502715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-28T01:34:21.502947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-28T01:34:21.503106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-28T01:34:21.503275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-28T01:34:21.503474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-28T01:34:21.503793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-28T01:34:21.504012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-28T01:34:21.504182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-28T01:34:21.504389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-28T01:34:21.504570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-28T01:34:21.504777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-28T01:34:21.504987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-28T01:34:21.505173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-28T01:34:21.505347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-28T01:34:21.505707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-28T01:34:21.505893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-28T01:34:21.506109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-28T01:34:21.506274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-28T01:34:21.506455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-28T01:34:21.506707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-28T01:34:21.506911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-28T01:34:21.507111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-28T01:34:21.507282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-28T01:34:21.507465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-28T01:34:21.507674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-28T01:34:21.507936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-28T01:34:21.508109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-28T01:34:21.508281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-28T01:34:21.508445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-28T01:34:21.508682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-09-28T01:34:21.509086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-28T01:34:21.509245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-28T01:34:21.509438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-28T01:34:21.509595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-28T01:34:21.509850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-28T01:34:21.510039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-28T01:34:21.510205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-28T01:34:21.510404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-28T01:34:21.510572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-28T01:34:21.510806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-28T01:34:21.510998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-28T01:34:21.511178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-28T01:34:21.511403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-28T01:34:21.511586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-28T01:34:21.511934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-28T01:34:21.512087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-28T01:34:21.512294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-28T01:34:21.512465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-28T01:34:21.512685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-28T01:34:21.513050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-28T01:34:21.513340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-28T01:34:21.513492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-28T01:34:21.513713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-28T01:34:21.513900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-28T01:34:21.514125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-28T01:34:21.514316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-28T01:34:21.514498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-28T01:34:21.514708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-28T01:34:21.514901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-28T01:34:21.515125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-28T01:34:21.515406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-28T01:34:21.515573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-28T01:34:21.515763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-28T01:34:21.515936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-28T01:34:21.516106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-09-28T01:34:21.516327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-28T01:34:21.516531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-28T01:34:21.516795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-28T01:34:21.516974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-28T01:34:21.517160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-28T01:34:21.517417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-28T01:34:21.517621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-28T01:34:21.517956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-28T01:34:21.518360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-28T01:34:21.518522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-28T01:34:21.518704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-28T01:34:21.518889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-28T01:34:21.519055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-28T01:34:21.519487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-28T01:34:21.519687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-28T01:34:21.520100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-28T01:34:21.520294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-28T01:34:21.520615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-28T01:34:21.520798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-28T01:34:21.521044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-28T01:34:21.521222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-28T01:34:21.521420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-28T01:34:21.521596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-28T01:34:21.521849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-28T01:34:21.522078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-28T01:34:21.522280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-28T01:34:21.522465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-28T01:34:21.522677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-28T01:34:21.522832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-28T01:34:21.523104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-28T01:34:21.523280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-28T01:34:21.523433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-28T01:34:21.523583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-28T01:34:21.523752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-28T01:34:21.523920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-28T01:34:21.524103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-28T01:34:21.524276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-28T01:34:21.524468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-28T01:34:21.524719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-28T01:34:21.524889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-28T01:34:21.525054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-28T01:34:21.525255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-28T01:34:21.525438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-28T01:34:21.525632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-28T01:34:21.525905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-28T01:34:21.526081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-28T01:34:21.526259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-28T01:34:21.526422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-28T01:34:21.526604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-28T01:34:21.526810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-28T01:34:21.530538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-28T01:34:21.531021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-28T01:34:21.531230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-28T01:34:21.531504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-28T01:34:21.531703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-28T01:34:21.531911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-28T01:34:21.532108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-28T01:34:21.532326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-28T01:34:21.532508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-28T01:34:21.532740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-28T01:34:21.532996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-28T01:34:21.533256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-09-28T01:34:21.533456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-28T01:34:21.533752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-28T01:34:21.533916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-28T01:34:21.534126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-28T01:34:21.534313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-28T01:34:21.534498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-28T01:34:21.534787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-28T01:34:21.534955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-28T01:34:21.535143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-28T01:34:21.535329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-28T01:34:21.535742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-28T01:34:21.535918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-28T01:34:21.536090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-28T01:34:21.536286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-28T01:34:21.536434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-28T01:34:21.536622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-28T01:34:21.536808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-28T01:34:21.536975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-28T01:34:21.537193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-28T01:34:21.537343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-28T01:34:21.537499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-28T01:34:21.537715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-28T01:34:21.537871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-28T01:34:21.538044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-28T01:34:21.538220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-28T01:34:21.538409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-28T01:34:21.538575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-28T01:34:21.538758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-28T01:34:21.538935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-28T01:34:21.539166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-28T01:34:21.539374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-28T01:34:21.539587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-28T01:34:21.540010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-28T01:34:21.540432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-28T01:34:21.540622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-28T01:34:21.540804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-28T01:34:21.540991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-28T01:34:21.541159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-28T01:34:21.541377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-28T01:34:21.541605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-09-28T01:34:21.541847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-28T01:34:21.542049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-28T01:34:21.542216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-28T01:34:21.542384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-28T01:34:21.542571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-28T01:34:21.542865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-28T01:34:21.543035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-28T01:34:21.543262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-28T01:34:21.543498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-28T01:34:21.543695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-28T01:34:21.544075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-28T01:34:21.544262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-28T01:34:21.544440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-28T01:34:21.544603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-28T01:34:21.544962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-28T01:34:21.545136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-28T01:34:21.545375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-28T01:34:21.545523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-28T01:34:21.545717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-28T01:34:21.545865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-28T01:34:21.546037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-28T01:34:21.546253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-28T01:34:21.546455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-28T01:34:21.546626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-28T01:34:21.546819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-28T01:34:21.547024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-28T01:34:21.547172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-28T01:34:21.547357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-28T01:34:21.547583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-28T01:34:21.547749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-28T01:34:21.547949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-28T01:34:21.548117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-28T01:34:21.548259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-28T01:34:21.548448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-28T01:34:21.548819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-28T01:34:21.549021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-28T01:34:21.549168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-28T01:34:21.549348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-28T01:34:21.549564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-28T01:34:21.549746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-28T01:34:21.549925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-28T01:34:21.550120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-28T01:34:21.550325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-28T01:34:21.550487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-28T01:34:21.550763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-28T01:34:21.550927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-28T01:34:21.551101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-28T01:34:21.551294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-28T01:34:21.551534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-28T01:34:21.551709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-28T01:34:21.551888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-28T01:34:21.552056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-28T01:34:21.552260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-28T01:34:21.552421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-28T01:34:21.552589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-28T01:34:21.552985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-28T01:34:21.553219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-28T01:34:21.553384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-28T01:34:21.553608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-28T01:34:21.553825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-28T01:34:21.554009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-28T01:34:21.554219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-28T01:34:21.554393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-28T01:34:21.554586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-28T01:34:21.554814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-28T01:34:21.555005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-28T01:34:21.555162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-09-28T01:34:21.555325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-28T01:34:21.555527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-28T01:34:21.555761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-28T01:34:21.555920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-28T01:34:21.556098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-28T01:34:21.556344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-28T01:34:21.556507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-28T01:34:21.556728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-28T01:34:21.556904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-28T01:34:21.557116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-09-28T01:34:21.557291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-28T01:34:21.557480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-28T01:34:21.557630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-28T01:34:21.557856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-28T01:34:21.558090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-28T01:34:21.558301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-28T01:34:21.558466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-28T01:34:21.558783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-28T01:34:21.558959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-28T01:34:21.559129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-28T01:34:21.559303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-28T01:34:21.559502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-28T01:34:21.559720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-28T01:34:21.560091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-28T01:34:21.560256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-28T01:34:21.560446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-28T01:34:21.560806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-28T01:34:21.560970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-28T01:34:21.561151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-28T01:34:21.561368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-09-28T01:34:21.561545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-28T01:34:21.561734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-28T01:34:21.561903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-28T01:34:21.562118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-28T01:34:21.562265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-28T01:34:21.562630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-09-28T01:34:21.562859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-28T01:34:21.563027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-28T01:34:21.563206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-28T01:34:21.563456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-28T01:34:21.563633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-28T01:34:21.563831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-28T01:34:21.563998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-28T01:34:21.564226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-28T01:34:21.564509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-28T01:34:21.564688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-28T01:34:21.564886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-28T01:34:21.565069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-28T01:34:21.565262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-28T01:34:21.565681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-28T01:34:21.565869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-28T01:34:21.566044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-28T01:34:21.566232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-28T01:34:21.566404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-28T01:34:21.566748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-28T01:34:21.566913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-28T01:34:21.567116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-28T01:34:21.567324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-28T01:34:21.567527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-28T01:34:21.567719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-28T01:34:21.567884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-28T01:34:21.568045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-28T01:34:21.568204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-28T01:34:21.568375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-28T01:34:21.568556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-28T01:34:21.568929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-28T01:34:21.569204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-28T01:34:21.569383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-28T01:34:21.569547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-28T01:34:21.569724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-28T01:34:21.569878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-28T01:34:21.570016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-28T01:34:21.570158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-28T01:34:21.570423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-28T01:34:21.570586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-28T01:34:21.570797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-28T01:34:21.570968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-28T01:34:21.571113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-28T01:34:21.571285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-28T01:34:21.571427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-28T01:34:21.571598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-28T01:34:21.571837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-28T01:34:21.572027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-28T01:34:21.572269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-28T01:34:21.572427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-28T01:34:21.572593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-28T01:34:21.572854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-28T01:34:21.573020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-28T01:34:21.573178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-28T01:34:21.573359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-28T01:34:21.573503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-28T01:34:21.573678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-28T01:34:21.573834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-28T01:34:21.573988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-28T01:34:21.574162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-28T01:34:21.574308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-28T01:34:21.574474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-28T01:34:21.574638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-28T01:34:21.574910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-28T01:34:21.575072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-28T01:34:21.575239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-28T01:34:21.575385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-28T01:34:21.575548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-28T01:34:21.575713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-28T01:34:21.575876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-28T01:34:21.576068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-28T01:34:21.576294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-28T01:34:21.576450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-28T01:34:21.576621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-28T01:34:21.576892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-28T01:34:21.577087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-28T01:34:21.577326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-28T01:34:21.577528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-28T01:34:21.577741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-28T01:34:21.578204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-28T01:34:21.578380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-28T01:34:21.578546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-28T01:34:21.578766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-28T01:34:21.578936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-28T01:34:21.579109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-28T01:34:21.579319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-28T01:34:21.579479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-09-28T01:34:21.579624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-28T01:34:21.579883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-28T01:34:21.580068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-28T01:34:21.580273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-28T01:34:21.580421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-28T01:34:21.580581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-28T01:34:21.580817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-28T01:34:21.581004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-28T01:34:21.581156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-28T01:34:21.581405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-28T01:34:21.581560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-28T01:34:21.581747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-28T01:34:21.581923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-28T01:34:21.582086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-28T01:34:21.582279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-28T01:34:21.582462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-28T01:34:21.582749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-28T01:34:21.582907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-28T01:34:21.583099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-28T01:34:21.583290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-28T01:34:21.583444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-28T01:34:21.583606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-28T01:34:21.583816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-28T01:34:21.583984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-28T01:34:21.584151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-28T01:34:21.584362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-28T01:34:21.584676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-28T01:34:21.584926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-28T01:34:21.585076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-28T01:34:21.585228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-28T01:34:21.585415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-28T01:34:21.585584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-28T01:34:21.585787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-28T01:34:21.585937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-28T01:34:21.586125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-28T01:34:21.586313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-28T01:34:21.586469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-28T01:34:21.586632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-28T01:34:21.586842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-28T01:34:21.587042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-28T01:34:21.587234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-28T01:34:21.587396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-28T01:34:21.587549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-28T01:34:21.587760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-28T01:34:21.587907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-28T01:34:21.588185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-28T01:34:21.588350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-28T01:34:21.588736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-28T01:34:21.588903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-28T01:34:21.589073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-28T01:34:21.589226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-09-28T01:34:21.589383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-28T01:34:21.589582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-28T01:34:21.590035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-28T01:34:21.590216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-28T01:34:21.590376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-28T01:34:21.590595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-28T01:34:21.590797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-28T01:34:21.590973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-28T01:34:21.591174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-28T01:34:21.591336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-28T01:34:21.591484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-28T01:34:21.591990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-28T01:34:21.592184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-28T01:34:21.592398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-28T01:34:21.592560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-28T01:34:21.592780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-28T01:34:21.593045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-28T01:34:21.593196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-28T01:34:21.593386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-28T01:34:21.593559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-28T01:34:21.593822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-28T01:34:21.593984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-28T01:34:21.594134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-28T01:34:21.594276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-09-28T01:34:21.594426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-28T01:34:21.594591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-28T01:34:21.594774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-28T01:34:21.594956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-28T01:34:21.595102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-28T01:34:21.595256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-28T01:34:21.595427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-28T01:34:21.595610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-28T01:34:21.595869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-28T01:34:21.596139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-28T01:34:21.596321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-09-28T01:34:21.596479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-28T01:34:21.596624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-28T01:34:21.596794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-28T01:34:21.596995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-28T01:34:21.597170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-28T01:34:21.597342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-28T01:34:21.597493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-28T01:34:21.597634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-28T01:34:21.597854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-28T01:34:21.598238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-28T01:34:21.598921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-28T01:34:21.599083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-28T01:34:21.599241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-28T01:34:21.599386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-28T01:34:21.599537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-28T01:34:21.599720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-28T01:34:21.599928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-28T01:34:21.600163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-28T01:34:21.600392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-28T01:34:21.600550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-09-28T01:34:21.600715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-28T01:34:21.600857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-28T01:34:21.601007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-28T01:34:21.601179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-28T01:34:21.601322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-28T01:34:21.601523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-09-28T01:34:21.601715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-28T01:34:21.601860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-28T01:34:21.602029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-28T01:34:21.602178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-28T01:34:21.602362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-28T01:34:21.602528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-28T01:34:21.602721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-28T01:34:21.602885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-28T01:34:21.603037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-28T01:34:21.603185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-28T01:34:21.603370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-28T01:34:21.603576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-28T01:34:21.603760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-28T01:34:21.603924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-28T01:34:21.604101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-28T01:34:21.604255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-28T01:34:21.604434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-28T01:34:21.604625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-28T01:34:21.604848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-28T01:34:21.605017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-28T01:34:21.605216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-28T01:34:21.605396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-28T01:34:21.605570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-28T01:34:21.605823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-28T01:34:21.605983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-28T01:34:21.606157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-28T01:34:21.606524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-28T01:34:21.606882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-28T01:34:21.607084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-28T01:34:21.607308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-28T01:34:21.607501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-28T01:34:21.607718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-28T01:34:21.607872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-28T01:34:21.608021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-28T01:34:21.608452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-28T01:34:21.608609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-28T01:34:21.608819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-28T01:34:21.609029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-28T01:34:21.609188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-28T01:34:21.609356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-28T01:34:21.609528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-28T01:34:21.609713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-28T01:34:21.609925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-28T01:34:21.610108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-28T01:34:21.610260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-28T01:34:21.610458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-28T01:34:21.610689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-09-28T01:34:21.610887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-28T01:34:21.611064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-28T01:34:21.611267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-28T01:34:21.611455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-28T01:34:21.611688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-28T01:34:21.612071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-28T01:34:21.612236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-28T01:34:21.612424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-28T01:34:21.612614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-28T01:34:21.612817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-28T01:34:21.613007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-28T01:34:21.613157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-28T01:34:21.613360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-28T01:34:21.613513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-28T01:34:21.613732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-28T01:34:21.613883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-28T01:34:21.614069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-28T01:34:21.614243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-28T01:34:21.614426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-28T01:34:21.614594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-28T01:34:21.614880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-28T01:34:21.615073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-28T01:34:21.615257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-28T01:34:21.615486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-09-28T01:34:21.615635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-28T01:34:21.615827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-28T01:34:21.616050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-28T01:34:21.616243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-28T01:34:21.616409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-28T01:34:21.616666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-28T01:34:21.616965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-28T01:34:21.617169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-09-28T01:34:21.617333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-28T01:34:21.617498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-28T01:34:21.617698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-28T01:34:21.617875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-28T01:34:21.618222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-28T01:34:21.618472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-28T01:34:21.618761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-28T01:34:21.618933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-28T01:34:21.619117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-09-28T01:34:21.619465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-28T01:34:21.619636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-28T01:34:21.619808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-28T01:34:21.619974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-28T01:34:21.620168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-28T01:34:21.620318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-28T01:34:21.620488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-28T01:34:21.620638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-28T01:34:21.620823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-09-28T01:34:21.620968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-28T01:34:21.621140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-28T01:34:21.621308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-28T01:34:21.621685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-09-28T01:34:21.621859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-09-28T01:34:21.622020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-28T01:34:21.622234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-09-28T01:34:21.622416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-28T01:34:21.622560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-28T01:34:21.622812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-28T01:34:21.623051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-28T01:34:21.623220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-28T01:34:21.623400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-28T01:34:21.623579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-28T01:34:21.623820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-28T01:34:21.623989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-28T01:34:21.624159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-28T01:34:21.624466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-09-28T01:34:21.624715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-28T01:34:21.625014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-28T01:34:21.625166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-28T01:34:21.625380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-28T01:34:21.625596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-28T01:34:21.625780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-28T01:34:21.626170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-28T01:34:21.626410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-28T01:34:21.626571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-28T01:34:21.626838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-28T01:34:21.627040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-28T01:34:21.627245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-28T01:34:21.627414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-28T01:34:21.627594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-28T01:34:21.627797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-28T01:34:21.627954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-28T01:34:21.628173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-28T01:34:21.628436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-28T01:34:21.628631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-28T01:34:21.628824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-28T01:34:21.628985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-28T01:34:21.629168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-28T01:34:21.629329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-28T01:34:21.629507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-28T01:34:21.629696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-28T01:34:21.630051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-28T01:34:21.630231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-28T01:34:21.630409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-28T01:34:21.630584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-28T01:34:21.630959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-28T01:34:21.631232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-28T01:34:21.631402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-28T01:34:21.631630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-28T01:34:21.631828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-28T01:34:21.632083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-28T01:34:21.632274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-28T01:34:21.632447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-28T01:34:21.632760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-28T01:34:21.632945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-28T01:34:21.633156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-28T01:34:21.633385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-28T01:34:21.633583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-28T01:34:21.633803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-28T01:34:21.633970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-28T01:34:21.634143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-28T01:34:21.634298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-28T01:34:21.634474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-28T01:34:21.634680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-28T01:34:21.634837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-28T01:34:21.635076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-28T01:34:21.635271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-28T01:34:21.635419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-28T01:34:21.635637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-28T01:34:21.635833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-28T01:34:21.636047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-28T01:34:21.636229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-28T01:34:21.636405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-09-28T01:34:21.636602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-28T01:34:21.637022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-28T01:34:21.637187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-28T01:34:21.637369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-28T01:34:21.637553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-28T01:34:21.637887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-28T01:34:21.638038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-28T01:34:21.638185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-28T01:34:21.638365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-28T01:34:21.638563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-28T01:34:21.638809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-28T01:34:21.638990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-28T01:34:21.639208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-28T01:34:21.639386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-28T01:34:21.639553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-28T01:34:21.639755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-28T01:34:21.639979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-28T01:34:21.640187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-28T01:34:21.640329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-28T01:34:21.640505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-28T01:34:21.640735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-28T01:34:21.640929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-28T01:34:21.641085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-28T01:34:21.641268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-28T01:34:21.641427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-28T01:34:21.641719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-28T01:34:21.641962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-28T01:34:21.642111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-28T01:34:21.642304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-28T01:34:21.642467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-28T01:34:21.642847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-28T01:34:21.643038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-28T01:34:21.643217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-28T01:34:21.643399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-28T01:34:21.643776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-28T01:34:21.643955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-28T01:34:21.644140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-28T01:34:21.644292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-28T01:34:21.644521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-28T01:34:21.644703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-28T01:34:21.644906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-28T01:34:21.645161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-28T01:34:21.645324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-28T01:34:21.645510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-28T01:34:21.645746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-28T01:34:21.645915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-28T01:34:21.646157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-28T01:34:21.646342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-28T01:34:21.646838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-28T01:34:21.647032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-28T01:34:21.647254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-28T01:34:21.647408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-28T01:34:21.647679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-28T01:34:21.647903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-28T01:34:21.648085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-28T01:34:21.648243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-28T01:34:21.648426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-28T01:34:21.648574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-28T01:34:21.648853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-28T01:34:21.649121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-09-28T01:34:21.649318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-28T01:34:21.649568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-28T01:34:21.649769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-28T01:34:21.649945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-28T01:34:21.650122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-28T01:34:21.650296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-28T01:34:21.650444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-28T01:34:21.650589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-28T01:34:21.650790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-28T01:34:21.650967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-28T01:34:21.651351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-28T01:34:21.651498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-28T01:34:21.651689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-28T01:34:21.651918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-28T01:34:21.652185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-09-28T01:34:21.652424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-28T01:34:21.652601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-28T01:34:21.652830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-28T01:34:21.653005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-28T01:34:21.653243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-28T01:34:21.653454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-28T01:34:21.653616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-28T01:34:21.653799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-28T01:34:21.653966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-28T01:34:21.654145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-28T01:34:21.654326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-28T01:34:21.654484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-28T01:34:21.654685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-28T01:34:21.654854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-28T01:34:21.655137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-28T01:34:21.655302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-28T01:34:21.655471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-28T01:34:21.655707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-28T01:34:21.656006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-28T01:34:21.656154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-28T01:34:21.656458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-28T01:34:21.656629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-28T01:34:21.656823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-28T01:34:21.657007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-28T01:34:21.657165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-28T01:34:21.657414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-09-28T01:34:21.657566] [INFO ] [LOCAL ] Deleted 2074 derivative data files. [2025-09-28T01:34:21.658114] [FATAL] [MAIN ] Exception during derivative generation: No module named 'BlacklistTracker' [2025-09-28T01:34:21.658396] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-09-28T01:34:21.658578] [INFO ] [STATE ] Last completion updated: 2025-09-28T01:34:21.658474 [2025-09-28T01:34:21.659015] [INFO ] [STATE ] TDM shutdown complete. [2025-09-28T01:34:29.567298] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-28T01:34:29.567545] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T01:34:29.567705] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T01:34:29.567780] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T01:34:31.122715] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T01:34:31.123078] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T01:34:31.123405] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T01:34:31.124399] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T01:34:31.124489] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T01:34:31.124582] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T01:34:31.124778] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T01:34:31.124885] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T01:34:31.125300] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T01:34:31.125388] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T01:34:31.125604] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T01:34:31.125719] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T01:34:31.125811] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T01:34:31.125906] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T01:34:31.151774] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T01:34:31.152094] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T01:34:31.152187] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T01:34:31.152281] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T01:34:31.152366] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T01:34:31.152765] [WARN ] [STATE ] State set to: RUNNING [2025-09-28T01:34:31.152848] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-09-28T01:34:31.152921] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T01:34:31.153101] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T01:34:31.153173] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T01:34:32.309256] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T01:34:32.309489] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T01:34:32.309764] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T01:34:32.310400] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T01:34:32.310479] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T01:34:32.310549] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T01:34:32.310702] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-28T01:34:32.310786] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T01:34:32.310858] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T01:34:32.311239] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T01:34:32.311310] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T01:34:32.311533] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T01:34:32.311634] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T01:34:32.311733] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T01:34:32.311803] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T01:34:32.337677] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T01:34:32.337817] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T01:34:32.337889] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T01:34:32.337957] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T01:34:32.338027] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T01:34:32.338122] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T01:34:32.338498] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T01:34:32.338568] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T01:34:32.338668] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-28T01:34:32.338739] [INFO ] [MAIN ] Running in parallel mode [2025-09-28T01:34:32.338945] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-28T01:34:32.975693] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:32.971267] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:33.127549] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:33.150963] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-28T01:34:33.150726] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:33.151729] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-28T01:34:33.151844] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-28T01:34:33.151291] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-28T01:34:33.152189] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-28T01:34:33.152336] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-28T01:34:33.152427] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-28T01:34:33.152638] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-28T01:34:33.152785] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-28T01:34:33.153052] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-28T01:34:33.153115] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-28T01:34:33.153358] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-28T01:34:33.664872] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-28T01:34:33.704976] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-28T01:34:33.753917] [INFO ] [MAIN ] A: Loaded 51487 existing records. [2025-09-28T01:34:33.748508] [INFO ] [MAIN ] AA: Loaded 54394 existing records. [2025-09-28T01:34:34.393801] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:34.363744] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:34:34.408761] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-28T01:34:34.387235] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:34:34.412578] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:34.412937] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-28T01:34:34.413119] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-28T01:34:34.413437] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-28T01:34:34.413916] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-28T01:34:34.416168] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-28T01:34:34.418215] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-28T01:34:34.418312] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-28T01:34:34.450056] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-28T01:34:34.493756] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-28T01:34:34.827538] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:34:34.873957] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-28T01:34:34.850937] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-28T01:34:34.898510] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:34:34.940670] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-09-28T01:34:34.966000] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:34:34.948165] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-28T01:34:34.998475] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-28T01:34:35.047262] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-28T01:34:35.051428] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-28T01:34:35.068541] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-28T01:34:35.068868] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 2.6s. Estimated remaining: 1h 47m 50s. Rate: 22.0 symbols/min [2025-09-28T01:34:35.241756] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:35.248999] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-28T01:34:35.325176] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-28T01:34:35.329129] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:35.351383] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-28T01:34:35.365103] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-28T01:34:35.448307] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:35.554850] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-28T01:34:35.555085] [INFO ] [MAIN ] AAP: Loaded 52789 existing records. [2025-09-28T01:34:35.650212] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-28T01:34:35.686332] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-28T01:34:35.777096] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:34:35.777487] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-28T01:34:35.777580] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-28T01:34:35.779269] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-28T01:34:35.779356] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-28T01:34:35.937782] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-28T01:34:36.018225] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-28T01:34:36.183593] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:36.184191] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-28T01:34:36.303293] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-28T01:34:36.304484] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-28T01:34:36.652598] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-28T01:34:36.653520] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-28T01:34:36.804672] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.15 seconds). [2025-09-28T01:34:36.805600] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-28T01:34:37.010188] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-28T01:34:37.011696] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-28T01:34:37.070790] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-28T01:34:37.081162] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-28T01:34:37.289934] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-28T01:34:37.291300] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-28T01:34:37.392476] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-28T01:34:37.403508] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-28T01:34:37.498831] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-28T01:34:37.499893] [INFO ] [REMOTE ] AAM: Full fetch complete (966 records). [2025-09-28T01:34:37.500896] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-28T01:34:37.501548] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T01:34:37.501685] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T01:34:37.501779] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T01:34:37.501893] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-28T01:34:37.502045] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-28T01:34:37.502140] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-28T01:34:37.502245] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-28T01:34:37.502368] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 5.1s. Estimated remaining: 1h 41m 56s. Rate: 23.2 symbols/min [2025-09-28T01:34:37.734699] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:37.735129] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-09-28T01:34:37.735292] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-09-28T01:34:37.735481] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-28T01:34:37.735764] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-28T01:34:37.735879] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-28T01:34:37.736065] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-28T01:34:38.065717] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-28T01:34:38.097044] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-28T01:34:38.170214] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:38.170610] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-28T01:34:38.793635] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-28T01:34:38.804261] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-28T01:34:39.482010] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-28T01:34:39.488175] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-28T01:34:39.551787] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-28T01:34:39.564147] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-28T01:34:39.659412] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-28T01:34:39.670706] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-28T01:34:40.348579] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-28T01:34:40.354344] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-28T01:34:40.615055] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-28T01:34:40.626127] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-28T01:34:41.075577] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-28T01:34:41.086084] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-28T01:34:41.495557] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-28T01:34:41.510586] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-28T01:34:41.529259] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-28T01:34:41.536109] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-28T01:34:42.322008] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-28T01:34:42.333924] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-28T01:34:42.608771] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-28T01:34:42.615613] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-28T01:34:42.678887] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-28T01:34:42.693014] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-28T01:34:43.745573] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-28T01:34:43.759719] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-28T01:34:43.783990] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-28T01:34:43.792433] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-28T01:34:43.876142] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-28T01:34:43.887477] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-28T01:34:44.222898] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-28T01:34:44.235412] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-28T01:34:45.192636] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-28T01:34:45.199439] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-28T01:34:45.730514] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-28T01:34:45.743450] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-28T01:34:45.797408] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-28T01:34:45.817500] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-28T01:34:46.187951] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-28T01:34:46.201485] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-28T01:34:46.500413] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-28T01:34:46.508155] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-28T01:34:47.347491] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-28T01:34:47.358021] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-28T01:34:47.791824] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-28T01:34:47.824920] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-28T01:34:47.837969] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-28T01:34:47.849558] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-28T01:34:47.969159] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-28T01:34:47.976886] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-28T01:34:49.019449] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-28T01:34:49.026234] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-28T01:34:49.227377] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-28T01:34:49.242354] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-28T01:34:49.693207] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-28T01:34:49.707226] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-28T01:34:49.847960] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-28T01:34:49.859957] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-28T01:34:50.436914] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-28T01:34:50.443309] [INFO ] [REMOTE ] AAT: Full fetch complete (42675 records). [2025-09-28T01:34:50.443525] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-28T01:34:50.882201] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-28T01:34:50.882589] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-28T01:34:50.883201] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-28T01:34:50.883293] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-28T01:34:50.884813] [DEBUG] [LOCAL ] AAT: Trimmed 42675 records to 31069 (keeping 200 days of data) [2025-09-28T01:34:51.063105] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-28T01:34:51.112116] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-28T01:34:51.147949] [DEBUG] [LOCAL ] AAT: Primary data saved (31069 records). [2025-09-28T01:34:51.148142] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-28T01:34:51.148266] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAT took 13.6s. Estimated remaining: 4h 7m 27s. Rate: 9.6 symbols/min [2025-09-28T01:34:51.333469] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:51.333740] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-28T01:34:51.333818] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-28T01:34:51.333958] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-28T01:34:51.334044] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-28T01:34:51.334135] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-28T01:34:51.334214] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-28T01:34:51.717487] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:51.718254] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-28T01:34:51.752777] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-28T01:34:51.781869] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-28T01:34:51.797452] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-28T01:34:51.810583] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-28T01:34:52.115688] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:34:52.116065] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-28T01:34:52.116155] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:34:52.116234] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-09-28T01:34:52.116306] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:34:52.116387] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-28T01:34:52.116487] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-28T01:34:52.116565] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-28T01:34:52.116693] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-28T01:34:52.116785] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAUC took 1.0s. Estimated remaining: 3h 15m 4s. Rate: 12.1 symbols/min [2025-09-28T01:34:52.302616] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:52.344597] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-28T01:34:52.344834] [INFO ] [MAIN ] AB: Loaded 28642 existing records. [2025-09-28T01:34:52.527613] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:34:52.527868] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-28T01:34:52.527951] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-28T01:34:52.528395] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-28T01:34:52.528475] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-28T01:34:52.900888] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:52.901361] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-28T01:34:52.979716] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-28T01:34:52.990817] [INFO ] [REMOTE ] A: Full fetch complete (73040 records). [2025-09-28T01:34:52.991047] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-28T01:34:53.405189] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-28T01:34:53.405772] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-28T01:34:53.406814] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-28T01:34:53.406962] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-28T01:34:53.408790] [DEBUG] [LOCAL ] A: Trimmed 73040 records to 51487 (keeping 200 days of data) [2025-09-28T01:34:53.566106] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-28T01:34:53.579024] [INFO ] [REMOTE ] AAP: Full fetch complete (75085 records). [2025-09-28T01:34:53.580344] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-28T01:34:53.949219] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-28T01:34:54.082500] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-28T01:34:54.237440] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-28T01:34:54.239402] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-28T01:34:54.242388] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-28T01:34:54.243492] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-28T01:34:54.254615] [DEBUG] [LOCAL ] AAP: Trimmed 75085 records to 52789 (keeping 200 days of data) [2025-09-28T01:34:54.463981] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-28T01:34:54.475323] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-28T01:34:54.500891] [DEBUG] [LOCAL ] A: Primary data saved (51487 records). [2025-09-28T01:34:54.501868] [INFO ] [MAIN ] A: Full history saved. [2025-09-28T01:34:54.503055] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. A took 22.2s. Estimated remaining: 2h 54m 48s. Rate: 13.5 symbols/min [2025-09-28T01:34:54.712273] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:54.953896] [DEBUG] [LOCAL ] AAP: Primary data saved (52789 records). [2025-09-28T01:34:54.955509] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-28T01:34:54.955345] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-28T01:34:54.956198] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AAP took 19.9s. Estimated remaining: 2h 28m 35s. Rate: 15.9 symbols/min [2025-09-28T01:34:54.956395] [INFO ] [MAIN ] ABBV: Loaded 54465 existing records. [2025-09-28T01:34:55.335063] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:55.341370] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:34:55.342026] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-28T01:34:55.342114] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-28T01:34:55.342716] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-28T01:34:55.342796] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-28T01:34:55.674986] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-28T01:34:55.695859] [INFO ] [MAIN ] ABCB: Loaded 31144 existing records. [2025-09-28T01:34:55.919218] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:55.925537] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-28T01:34:56.008076] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:34:56.008802] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-28T01:34:56.009633] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-28T01:34:56.010143] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-28T01:34:56.010396] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-28T01:34:56.265816] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-28T01:34:56.301316] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-28T01:34:56.340832] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-28T01:34:56.380899] [INFO ] [REMOTE ] AA: Full fetch complete (77538 records). [2025-09-28T01:34:56.386049] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-28T01:34:56.611744] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:56.623852] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-28T01:34:56.925263] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-28T01:34:56.925417] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-28T01:34:56.926245] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-28T01:34:56.926349] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-28T01:34:56.928928] [DEBUG] [LOCAL ] AA: Trimmed 77538 records to 54394 (keeping 200 days of data) [2025-09-28T01:34:57.282719] [DEBUG] [LOCAL ] AA: Primary data saved (54394 records). [2025-09-28T01:34:57.282994] [INFO ] [MAIN ] AA: Full history saved. [2025-09-28T01:34:57.283570] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AA took 24.9s. Estimated remaining: 2h 20m 24s. Rate: 16.8 symbols/min [2025-09-28T01:34:57.494156] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:34:57.567451] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-28T01:34:57.567673] [INFO ] [MAIN ] ABEV: Loaded 54055 existing records. [2025-09-28T01:34:57.850171] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:34:57.850685] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-28T01:34:57.850948] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-28T01:34:57.851361] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-28T01:34:57.867738] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-28T01:34:57.869047] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-28T01:34:57.925307] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-28T01:34:58.264804] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:34:58.288115] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-28T01:34:58.320424] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-28T01:34:58.330634] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-28T01:34:58.331713] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-28T01:34:58.344068] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-28T01:34:59.268485] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-28T01:34:59.275190] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-28T01:34:59.953869] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-28T01:34:59.964331] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-28T01:35:00.102625] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-28T01:35:00.114408] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-28T01:35:00.209196] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-28T01:35:00.221123] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-28T01:35:00.467408] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-28T01:35:00.473841] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-28T01:35:01.412576] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-28T01:35:01.421990] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-28T01:35:01.807244] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-28T01:35:01.815631] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-28T01:35:02.152157] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-28T01:35:02.164607] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-28T01:35:02.305931] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-28T01:35:02.316349] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-28T01:35:02.755001] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-28T01:35:02.761506] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-28T01:35:03.027011] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-28T01:35:03.035854] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-28T01:35:03.765004] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-28T01:35:03.776270] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-28T01:35:04.019790] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-28T01:35:04.024962] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-28T01:35:04.083684] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-28T01:35:04.095608] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-28T01:35:04.433797] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-28T01:35:04.441264] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-28T01:35:05.306429] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-28T01:35:05.334783] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-28T01:35:05.334043] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-28T01:35:05.360291] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-28T01:35:05.364152] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-28T01:35:05.370898] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-28T01:35:05.999319] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-28T01:35:06.011779] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-28T01:35:06.157748] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-28T01:35:06.165572] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-28T01:35:06.834778] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-28T01:35:06.843337] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-28T01:35:06.909700] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-28T01:35:06.915340] [INFO ] [REMOTE ] AB: Full fetch complete (45903 records). [2025-09-28T01:35:06.915555] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-28T01:35:07.347972] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-28T01:35:07.360931] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-28T01:35:07.365031] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-28T01:35:07.365392] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-28T01:35:07.367300] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-28T01:35:07.380910] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-28T01:35:07.381108] [DEBUG] [LOCAL ] AB: Trimmed 45903 records to 28642 (keeping 200 days of data) [2025-09-28T01:35:07.584365] [DEBUG] [LOCAL ] AB: Primary data saved (28642 records). [2025-09-28T01:35:07.584569] [INFO ] [MAIN ] AB: Full history saved. [2025-09-28T01:35:07.586683] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 15.5s. Estimated remaining: 2h 53m 31s. Rate: 13.6 symbols/min [2025-09-28T01:35:07.803621] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:07.829928] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-28T01:35:07.830242] [INFO ] [MAIN ] ABG: Loaded 19034 existing records. [2025-09-28T01:35:08.035313] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:35:08.036245] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-28T01:35:08.036680] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-28T01:35:08.037052] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-28T01:35:08.037136] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-28T01:35:08.272230] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-28T01:35:08.317387] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-28T01:35:08.509757] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-28T01:35:08.540546] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:08.552613] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-28T01:35:08.554354] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-28T01:35:09.135922] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-28T01:35:09.148053] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-28T01:35:09.547403] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-28T01:35:09.554533] [INFO ] [REMOTE ] ABCB: Full fetch complete (44442 records). [2025-09-28T01:35:09.554742] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-28T01:35:09.779460] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-28T01:35:09.859335] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-28T01:35:10.013379] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-28T01:35:10.013497] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-28T01:35:10.014014] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-28T01:35:10.014112] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-28T01:35:10.015867] [DEBUG] [LOCAL ] ABCB: Trimmed 44442 records to 31144 (keeping 200 days of data) [2025-09-28T01:35:10.205432] [DEBUG] [LOCAL ] ABCB: Primary data saved (31144 records). [2025-09-28T01:35:10.205597] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-28T01:35:10.205790] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 15.2s. Estimated remaining: 2h 45m 38s. Rate: 14.3 symbols/min [2025-09-28T01:35:10.402393] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:10.445910] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-28T01:35:10.446122] [INFO ] [MAIN ] ABM: Loaded 32915 existing records. [2025-09-28T01:35:10.660808] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:35:10.661492] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-28T01:35:10.661793] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-28T01:35:10.662730] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-28T01:35:10.662901] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-28T01:35:10.857255] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-28T01:35:10.895241] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-28T01:35:10.964927] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-28T01:35:10.998393] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-28T01:35:11.239729] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:11.242289] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-28T01:35:11.242714] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-28T01:35:11.248925] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-28T01:35:11.973283] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-28T01:35:11.977254] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-28T01:35:12.270040] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-28T01:35:12.276285] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-28T01:35:12.743969] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-28T01:35:12.749739] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-28T01:35:13.008210] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-28T01:35:13.033763] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-28T01:35:13.056212] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-28T01:35:13.069413] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-28T01:35:13.155929] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-28T01:35:13.165582] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-28T01:35:14.083856] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-28T01:35:14.091740] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-28T01:35:14.115325] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-28T01:35:14.122606] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-28T01:35:14.988748] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-28T01:35:15.001170] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-28T01:35:15.035077] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-28T01:35:15.039062] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-28T01:35:15.128293] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-28T01:35:15.140816] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-28T01:35:15.188474] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-28T01:35:15.195788] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-28T01:35:15.924777] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-28T01:35:15.928806] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-28T01:35:16.883134] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-28T01:35:16.907752] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-28T01:35:16.910023] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-28T01:35:16.918453] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-28T01:35:17.068344] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-28T01:35:17.078878] [INFO ] [REMOTE ] ABEV: Full fetch complete (77198 records). [2025-09-28T01:35:17.079070] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-28T01:35:17.541674] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-28T01:35:17.541909] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-28T01:35:17.543380] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-28T01:35:17.545678] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-28T01:35:17.545527] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-28T01:35:17.557845] [INFO ] [REMOTE ] ABBV: Full fetch complete (77719 records). [2025-09-28T01:35:17.558044] [DEBUG] [LOCAL ] ABEV: Trimmed 77198 records to 54055 (keeping 200 days of data) [2025-09-28T01:35:17.558886] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-28T01:35:18.093181] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-28T01:35:18.094591] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-28T01:35:18.096132] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-28T01:35:18.097431] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-28T01:35:18.112260] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-28T01:35:18.121250] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-28T01:35:18.125555] [DEBUG] [LOCAL ] ABBV: Trimmed 77719 records to 54465 (keeping 200 days of data) [2025-09-28T01:35:18.338899] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-28T01:35:18.358578] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-28T01:35:18.486272] [DEBUG] [LOCAL ] ABEV: Primary data saved (54055 records). [2025-09-28T01:35:18.487253] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-28T01:35:18.489467] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABEV took 21.2s. Estimated remaining: 3h 1m 36s. Rate: 13.0 symbols/min [2025-09-28T01:35:18.678014] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:18.681031] [DEBUG] [LOCAL ] ABR: No existing data file found in primary storage. [2025-09-28T01:35:18.681153] [WARN ] [MAIN ] ABR: No existing data found, performing full refresh instead. [2025-09-28T01:35:18.681319] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-28T01:35:18.681435] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-28T01:35:18.681562] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-09-28T01:35:18.681696] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-28T01:35:19.105111] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-28T01:35:19.184889] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:19.162800] [INFO ] [REMOTE ] ABG: Full fetch complete (26446 records). [2025-09-28T01:35:19.188335] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-28T01:35:19.190417] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-28T01:35:19.738712] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-28T01:35:19.740000] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-28T01:35:19.741638] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-28T01:35:19.745092] [DEBUG] [LOCAL ] ABBV: Primary data saved (54465 records). [2025-09-28T01:35:19.745277] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-28T01:35:19.746826] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABBV took 25.2s. Estimated remaining: 2h 49m 31s. Rate: 13.9 symbols/min [2025-09-28T01:35:19.747097] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-28T01:35:19.793416] [DEBUG] [LOCAL ] ABG: Trimmed 26446 records to 19034 (keeping 200 days of data) [2025-09-28T01:35:19.988477] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:20.033339] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-09-28T01:35:20.034165] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-09-28T01:35:20.035182] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-28T01:35:20.036537] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-28T01:35:20.036748] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-28T01:35:20.035855] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-28T01:35:20.046187] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-28T01:35:20.059812] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-28T01:35:20.451902] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:20.453171] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-28T01:35:20.468418] [DEBUG] [LOCAL ] ABG: Primary data saved (19034 records). [2025-09-28T01:35:20.468580] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-28T01:35:20.468779] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABG took 12.9s. Estimated remaining: 2h 37m 42s. Rate: 15.0 symbols/min [2025-09-28T01:35:20.667999] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:20.696328] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-28T01:35:20.696562] [INFO ] [MAIN ] ACA: Loaded 24034 existing records. [2025-09-28T01:35:20.897320] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:35:20.897546] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-28T01:35:20.897629] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-28T01:35:20.897946] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-28T01:35:20.898026] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-28T01:35:21.292037] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:21.292930] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-28T01:35:21.326476] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-28T01:35:21.340246] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-28T01:35:21.495251] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-28T01:35:21.503607] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-28T01:35:22.255586] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-28T01:35:22.267420] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-28T01:35:22.451211] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-28T01:35:22.455927] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-28T01:35:22.541440] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-28T01:35:22.549808] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-28T01:35:23.075804] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-28T01:35:23.087154] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-28T01:35:23.669681] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-28T01:35:23.675938] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-28T01:35:23.822459] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-28T01:35:23.831510] [INFO ] [REMOTE ] ABM: Full fetch complete (44682 records). [2025-09-28T01:35:23.831746] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-28T01:35:24.257473] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-28T01:35:24.257956] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-28T01:35:24.258562] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-28T01:35:24.258829] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-28T01:35:24.260486] [DEBUG] [LOCAL ] ABM: Trimmed 44682 records to 32915 (keeping 200 days of data) [2025-09-28T01:35:24.385443] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-28T01:35:24.403996] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-28T01:35:24.511075] [DEBUG] [LOCAL ] ABM: Primary data saved (32915 records). [2025-09-28T01:35:24.511263] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-28T01:35:24.513506] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 14.3s. Estimated remaining: 2h 37m 44s. Rate: 14.9 symbols/min [2025-09-28T01:35:24.703555] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:24.704137] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-09-28T01:35:24.704463] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-09-28T01:35:24.705197] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-28T01:35:24.705442] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-28T01:35:24.705621] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-28T01:35:24.706025] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-28T01:35:24.903017] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-28T01:35:24.967723] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-28T01:35:24.964333] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-28T01:35:25.029286] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-28T01:35:25.183073] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:25.183466] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-28T01:35:26.238303] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-28T01:35:26.250284] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-28T01:35:26.298217] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-28T01:35:26.306408] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-28T01:35:26.325769] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-28T01:35:26.334135] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-28T01:35:26.636022] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-28T01:35:26.648396] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-28T01:35:27.530385] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-28T01:35:27.537383] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-28T01:35:27.723843] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-28T01:35:27.731627] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-28T01:35:28.262468] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-28T01:35:28.274506] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-28T01:35:28.336228] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-28T01:35:28.349536] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-28T01:35:28.586190] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-28T01:35:28.592240] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-28T01:35:29.098111] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-28T01:35:29.105859] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-28T01:35:29.273960] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-28T01:35:29.279672] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-28T01:35:29.841192] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-28T01:35:29.853726] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-28T01:35:30.369518] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-28T01:35:30.375779] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-28T01:35:30.410277] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-28T01:35:30.422052] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-28T01:35:30.473253] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-28T01:35:30.482619] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-28T01:35:31.270341] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-28T01:35:31.276828] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-28T01:35:31.453138] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-28T01:35:31.465491] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-28T01:35:31.864961] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-28T01:35:31.876118] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-28T01:35:32.021298] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-28T01:35:32.030339] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-28T01:35:32.359061] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-28T01:35:32.363477] [INFO ] [REMOTE ] ACA: Full fetch complete (34298 records). [2025-09-28T01:35:32.363661] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-28T01:35:32.765509] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-28T01:35:32.765665] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-28T01:35:32.766134] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-28T01:35:32.766249] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-28T01:35:32.767547] [DEBUG] [LOCAL ] ACA: Trimmed 34298 records to 24034 (keeping 200 days of data) [2025-09-28T01:35:32.924235] [DEBUG] [LOCAL ] ACA: Primary data saved (24034 records). [2025-09-28T01:35:32.924637] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-28T01:35:32.924899] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 12.5s. Estimated remaining: 2h 50m 0s. Rate: 13.9 symbols/min [2025-09-28T01:35:33.106002] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:33.139305] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-28T01:35:33.151275] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-28T01:35:33.182569] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-28T01:35:33.182899] [INFO ] [MAIN ] ACEL: Loaded 27405 existing records. [2025-09-28T01:35:33.398406] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:35:33.399123] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-28T01:35:33.399349] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-28T01:35:33.400145] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-28T01:35:33.400253] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-28T01:35:33.741376] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-28T01:35:33.803619] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-28T01:35:33.852751] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-28T01:35:33.879466] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-28T01:35:33.888448] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:33.890441] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-28T01:35:34.879129] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-28T01:35:34.885387] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-28T01:35:35.135374] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-28T01:35:35.148475] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-28T01:35:35.189564] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-28T01:35:35.198443] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-28T01:35:35.730116] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-28T01:35:35.750380] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-28T01:35:36.036043] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-28T01:35:36.041661] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-28T01:35:36.658039] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-28T01:35:36.741957] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-28T01:35:36.808929] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-28T01:35:37.103748] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-28T01:35:37.517862] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-28T01:35:37.528315] [INFO ] [REMOTE ] ABR: Full fetch complete (75183 records). [2025-09-28T01:35:37.528541] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-28T01:35:37.614048] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-28T01:35:37.964623] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-28T01:35:37.964839] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-28T01:35:37.965742] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-28T01:35:37.965926] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-28T01:35:37.991620] [DEBUG] [LOCAL ] ABR: Trimmed 75183 records to 52817 (keeping 200 days of data) [2025-09-28T01:35:37.992827] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-28T01:35:38.414697] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-28T01:35:38.461131] [DEBUG] [LOCAL ] ABR: Primary data saved (52817 records). [2025-09-28T01:35:38.461394] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-28T01:35:38.461586] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABR took 20.0s. Estimated remaining: 2h 53m 6s. Rate: 13.6 symbols/min [2025-09-28T01:35:38.756067] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:38.756433] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-09-28T01:35:38.756530] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-09-28T01:35:38.756727] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-28T01:35:38.756829] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-28T01:35:38.756963] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-09-28T01:35:38.757061] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-28T01:35:39.208983] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:39.209286] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-28T01:35:39.376344] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-28T01:35:39.387614] [INFO ] [REMOTE ] ABT: Full fetch complete (77587 records). [2025-09-28T01:35:39.387845] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-28T01:35:39.829076] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-28T01:35:39.830113] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-28T01:35:39.830926] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-28T01:35:39.831950] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-28T01:35:39.839035] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-28T01:35:39.839531] [INFO ] [REMOTE ] ACCO: Full fetch complete (54178 records). [2025-09-28T01:35:39.839734] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-28T01:35:39.901170] [DEBUG] [LOCAL ] ABT: Trimmed 77587 records to 54400 (keeping 200 days of data) [2025-09-28T01:35:40.031085] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-28T01:35:40.384467] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-28T01:35:40.386967] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-28T01:35:40.387788] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-28T01:35:40.388189] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-28T01:35:40.393931] [DEBUG] [LOCAL ] ACCO: Trimmed 54178 records to 38214 (keeping 200 days of data) [2025-09-28T01:35:40.515576] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-28T01:35:40.784934] [DEBUG] [LOCAL ] ACCO: Primary data saved (38214 records). [2025-09-28T01:35:40.785859] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-28T01:35:40.786681] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ACCO took 16.3s. Estimated remaining: 2h 47m 55s. Rate: 14.0 symbols/min [2025-09-28T01:35:40.818171] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-28T01:35:40.973329] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:41.096074] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-28T01:35:41.096945] [INFO ] [MAIN ] ACI: Loaded 54044 existing records. [2025-09-28T01:35:41.214315] [DEBUG] [LOCAL ] ABT: Primary data saved (54400 records). [2025-09-28T01:35:41.214521] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-28T01:35:41.220357] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ABT took 21.5s. Estimated remaining: 2h 38m 58s. Rate: 14.8 symbols/min [2025-09-28T01:35:41.425880] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:35:41.454131] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-28T01:35:41.488432] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-28T01:35:41.488364] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:41.488965] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-28T01:35:41.489045] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-28T01:35:41.861669] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-28T01:35:41.883710] [INFO ] [MAIN ] ACM: Loaded 43767 existing records. [2025-09-28T01:35:41.908985] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:41.977687] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-28T01:35:42.115325] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:35:42.115693] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-28T01:35:42.115801] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-28T01:35:42.116178] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-28T01:35:42.116276] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-28T01:35:42.497971] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-28T01:35:42.533595] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:42.534392] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-28T01:35:43.013564] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.98 seconds). [2025-09-28T01:35:43.208909] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-28T01:35:43.843370] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-28T01:35:44.008931] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-28T01:35:44.133466] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-28T01:35:44.431707] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-28T01:35:44.808922] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-28T01:35:45.608951] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-28T01:35:45.884811] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-28T01:35:45.943086] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-28T01:35:46.408907] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-28T01:35:47.208919] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-28T01:35:47.589359] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-28T01:35:48.008901] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-28T01:35:48.092207] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-28T01:35:48.801571] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-28T01:35:48.810853] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-28T01:35:49.175774] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-28T01:35:49.608910] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-28T01:35:50.408966] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-28T01:35:51.208919] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-28T01:35:51.320910] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-28T01:35:51.520491] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-09-28T01:35:52.008892] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-28T01:35:52.125079] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-28T01:35:52.344363] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-28T01:35:52.349710] [INFO ] [REMOTE ] ACEL: Full fetch complete (38799 records). [2025-09-28T01:35:52.349860] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-28T01:35:52.735504] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-28T01:35:52.735781] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-28T01:35:52.736282] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-28T01:35:52.736407] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-28T01:35:52.739094] [DEBUG] [LOCAL ] ACEL: Trimmed 38799 records to 27405 (keeping 200 days of data) [2025-09-28T01:35:52.822840] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-28T01:35:52.909604] [DEBUG] [LOCAL ] ACEL: Primary data saved (27405 records). [2025-09-28T01:35:52.909907] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-28T01:35:52.910070] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 20.0s. Estimated remaining: 2h 55m 32s. Rate: 13.4 symbols/min [2025-09-28T01:35:53.085161] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:35:53.145901] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-28T01:35:53.146131] [INFO ] [MAIN ] ACN: Loaded 54204 existing records. [2025-09-28T01:35:53.334032] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:35:53.334300] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-28T01:35:53.334387] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-28T01:35:53.335813] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-28T01:35:53.335894] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-28T01:35:53.613153] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-28T01:35:53.727298] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:35:53.754598] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-28T01:35:54.408917] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-28T01:35:55.208912] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-28T01:35:55.462411] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-28T01:35:55.520574] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-28T01:35:55.581617] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-28T01:35:56.008917] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-28T01:35:56.808889] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-28T01:35:57.003713] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-28T01:35:57.486395] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-28T01:35:57.608921] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-28T01:35:58.408897] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-28T01:35:58.455413] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-28T01:35:59.208897] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-28T01:35:59.345597] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-28T01:36:00.008921] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-28T01:36:00.325877] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-28T01:36:00.808990] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-28T01:36:01.482552] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-28T01:36:01.608905] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-28T01:36:01.888499] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-28T01:36:02.172249] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-28T01:36:02.408951] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-28T01:36:03.216396] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-28T01:36:03.241717] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-28T01:36:04.008918] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-28T01:36:04.312248] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-28T01:36:04.808917] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-28T01:36:04.986089] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-28T01:36:05.599797] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-28T01:36:05.609117] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-28T01:36:06.408883] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-28T01:36:06.613874] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-28T01:36:07.208895] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-28T01:36:07.660246] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-28T01:36:07.836569] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-28T01:36:07.845792] [INFO ] [REMOTE ] ACM: Full fetch complete (62766 records). [2025-09-28T01:36:07.845958] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-28T01:36:08.015106] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-28T01:36:08.263693] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-28T01:36:08.263826] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-28T01:36:08.264515] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-28T01:36:08.264603] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-28T01:36:08.266188] [DEBUG] [LOCAL ] ACM: Trimmed 62766 records to 43767 (keeping 200 days of data) [2025-09-28T01:36:08.557772] [DEBUG] [LOCAL ] ACM: Primary data saved (43767 records). [2025-09-28T01:36:08.557948] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-28T01:36:08.558077] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACM took 27.3s. Estimated remaining: 3h 18m 31s. Rate: 11.8 symbols/min [2025-09-28T01:36:08.801034] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:36:08.811712] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-28T01:36:08.833985] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-28T01:36:08.846628] [INFO ] [REMOTE ] ACI: Full fetch complete (77048 records). [2025-09-28T01:36:08.846863] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-28T01:36:09.116508] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-28T01:36:09.156493] [INFO ] [MAIN ] ACP: Loaded 31428 existing records. [2025-09-28T01:36:09.492136] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-28T01:36:09.499466] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-28T01:36:09.499380] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:36:09.500444] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-28T01:36:09.500869] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-28T01:36:09.500633] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-28T01:36:09.501206] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-28T01:36:09.501993] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-28T01:36:09.502167] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-28T01:36:09.583543] [DEBUG] [LOCAL ] ACI: Trimmed 77048 records to 54044 (keeping 200 days of data) [2025-09-28T01:36:09.996785] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:36:09.998287] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-28T01:36:10.247756] [DEBUG] [LOCAL ] ACI: Primary data saved (54044 records). [2025-09-28T01:36:10.247988] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-28T01:36:10.249179] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 29.5s. Estimated remaining: 3h 11m 49s. Rate: 12.3 symbols/min [2025-09-28T01:36:10.438931] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:36:10.458227] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-28T01:36:10.458421] [INFO ] [MAIN ] ACR: Loaded 6352 existing records. [2025-09-28T01:36:10.647262] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:36:10.647672] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-28T01:36:10.647794] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-28T01:36:10.648046] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-28T01:36:10.648126] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-28T01:36:11.075888] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:36:11.076976] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-28T01:36:11.080537] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (3.07 seconds). [2025-09-28T01:36:11.132492] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-28T01:36:11.208925] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-28T01:36:11.567598] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-28T01:36:11.676857] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-28T01:36:12.008920] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-28T01:36:12.807741] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-28T01:36:12.808938] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-28T01:36:13.300783] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-28T01:36:13.608917] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-28T01:36:14.408937] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-28T01:36:15.146018] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-28T01:36:15.208909] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-28T01:36:15.271277] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-28T01:36:16.008921] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-28T01:36:16.563371] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-28T01:36:16.642461] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-28T01:36:16.719757] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-28T01:36:16.808919] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-28T01:36:17.608972] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-28T01:36:18.408971] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-28T01:36:18.953159] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-28T01:36:19.208943] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-28T01:36:19.877791] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-28T01:36:20.008944] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-28T01:36:20.513104] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-09-28T01:36:20.808886] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-28T01:36:20.890615] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-28T01:36:21.024507] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-28T01:36:21.608966] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-28T01:36:22.029947] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-28T01:36:22.408942] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-28T01:36:23.213612] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-28T01:36:23.214869] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-28T01:36:23.709449] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-28T01:36:23.720533] [INFO ] [REMOTE ] ACN: Full fetch complete (77108 records). [2025-09-28T01:36:23.720796] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-28T01:36:24.014061] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-28T01:36:24.148757] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-28T01:36:24.148899] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-28T01:36:24.149877] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-28T01:36:24.149973] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-28T01:36:24.155527] [DEBUG] [LOCAL ] ACN: Trimmed 77108 records to 54204 (keeping 200 days of data) [2025-09-28T01:36:24.509489] [DEBUG] [LOCAL ] ACN: Primary data saved (54204 records). [2025-09-28T01:36:24.509696] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-28T01:36:24.509842] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACN took 31.6s. Estimated remaining: 3h 29m 12s. Rate: 11.2 symbols/min [2025-09-28T01:36:24.721065] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:36:24.724081] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-28T01:36:24.766870] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-28T01:36:24.767239] [INFO ] [MAIN ] ACRE: Loaded 34027 existing records. [2025-09-28T01:36:24.814003] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-28T01:36:24.855816] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-28T01:36:24.975528] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:36:24.975858] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-28T01:36:24.975943] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-28T01:36:24.976786] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-28T01:36:24.976873] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-28T01:36:25.345055] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:36:25.608935] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-28T01:36:26.143189] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-28T01:36:26.408953] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-28T01:36:27.087961] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-28T01:36:27.112258] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-28T01:36:27.208884] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-28T01:36:28.008914] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-28T01:36:28.606188] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-28T01:36:28.808928] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-28T01:36:29.608958] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-28T01:36:30.266360] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-28T01:36:30.408887] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-28T01:36:30.671512] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-28T01:36:30.870250] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-28T01:36:31.104934] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-28T01:36:31.208934] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-28T01:36:31.783602] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-28T01:36:32.008965] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-28T01:36:32.808900] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-28T01:36:33.293815] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-28T01:36:33.608930] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-28T01:36:34.201785] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-28T01:36:34.203188] [INFO ] [REMOTE ] ACR: Full fetch complete (8571 records). [2025-09-28T01:36:34.203288] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-28T01:36:34.373245] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-28T01:36:34.415682] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-28T01:36:34.629045] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-28T01:36:34.629201] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-28T01:36:34.629466] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-28T01:36:34.629574] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-28T01:36:34.630137] [DEBUG] [LOCAL ] ACR: Trimmed 8571 records to 6352 (keeping 200 days of data) [2025-09-28T01:36:34.668972] [DEBUG] [LOCAL ] ACR: Primary data saved (6352 records). [2025-09-28T01:36:34.669150] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-28T01:36:34.669348] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACR took 24.4s. Estimated remaining: 3h 37m 42s. Rate: 10.8 symbols/min [2025-09-28T01:36:34.845136] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:36:34.854607] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-28T01:36:34.854785] [INFO ] [MAIN ] ACV: Loaded 7095 existing records. [2025-09-28T01:36:35.048305] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:36:35.048566] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-28T01:36:35.048666] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-28T01:36:35.048886] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-28T01:36:35.048966] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-28T01:36:35.220870] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-28T01:36:35.435124] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:36:36.008956] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-28T01:36:36.642072] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-28T01:36:36.808879] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-28T01:36:36.894452] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-28T01:36:37.230088] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-28T01:36:37.244869] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-28T01:36:37.245081] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-28T01:36:37.611029] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-28T01:36:37.661582] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-28T01:36:37.661833] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-28T01:36:37.663017] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-28T01:36:37.663200] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-28T01:36:37.666292] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54598 (keeping 200 days of data) [2025-09-28T01:36:38.009570] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-28T01:36:38.019003] [INFO ] [REMOTE ] ACP: Full fetch complete (47511 records). [2025-09-28T01:36:38.020581] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-28T01:36:38.181128] [DEBUG] [LOCAL ] ACHR: Primary data saved (54598 records). [2025-09-28T01:36:38.198695] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-28T01:36:38.210199] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACHR took 59.7s. Estimated remaining: 3h 34m 10s. Rate: 11.0 symbols/min [2025-09-28T01:36:38.276082] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-28T01:36:38.416961] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-28T01:36:38.633982] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-28T01:36:38.648584] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-28T01:36:38.651922] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:36:38.652536] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-28T01:36:38.653110] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-28T01:36:38.654244] [DEBUG] [LOCAL ] ACP: Trimmed 47511 records to 31428 (keeping 200 days of data) [2025-09-28T01:36:38.803469] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-28T01:36:38.808745] [INFO ] [MAIN ] ACVA: Loaded 50072 existing records. [2025-09-28T01:36:39.062945] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:36:39.064741] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-28T01:36:39.064839] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-28T01:36:39.067228] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-28T01:36:39.068403] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-28T01:36:39.188785] [DEBUG] [LOCAL ] ACP: Primary data saved (31428 records). [2025-09-28T01:36:39.192144] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-28T01:36:39.192625] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACP took 30.6s. Estimated remaining: 3h 26m 45s. Rate: 11.4 symbols/min [2025-09-28T01:36:39.219169] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-28T01:36:39.613899] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:36:39.647268] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-28T01:36:39.673358] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:36:39.673758] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-28T01:36:39.674690] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-28T01:36:39.674831] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-28T01:36:39.674976] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-28T01:36:39.675087] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-28T01:36:39.967089] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-28T01:36:40.011824] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-28T01:36:40.011952] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-28T01:36:40.110164] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:36:40.808920] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-28T01:36:41.022547] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:36:41.022920] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-28T01:36:41.023009] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:36:41.023087] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-09-28T01:36:41.023157] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:36:41.023232] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-28T01:36:41.023350] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-28T01:36:41.023425] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-28T01:36:41.023520] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-28T01:36:41.023617] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. AD took 1.8s. Estimated remaining: 3h 21m 16s. Rate: 11.7 symbols/min [2025-09-28T01:36:41.202511] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:36:41.251413] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-28T01:36:41.251589] [INFO ] [MAIN ] ADC: Loaded 46934 existing records. [2025-09-28T01:36:41.433047] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:36:41.433396] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-28T01:36:41.433476] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-28T01:36:41.434893] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-28T01:36:41.434972] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-28T01:36:41.609290] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-28T01:36:41.847136] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:36:41.852057] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-28T01:36:42.408897] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-28T01:36:43.208930] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-28T01:36:43.271406] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-28T01:36:44.009634] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-28T01:36:44.017487] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-28T01:36:44.018381] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-28T01:36:44.808922] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-28T01:36:45.526154] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-28T01:36:45.608896] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-28T01:36:46.408884] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-28T01:36:46.484869] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-28T01:36:47.167943] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-28T01:36:47.208900] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-28T01:36:47.856480] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-28T01:36:48.008911] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-28T01:36:48.690712] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-28T01:36:48.791451] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-28T01:36:48.808845] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-28T01:36:49.293032] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-28T01:36:49.608921] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-28T01:36:50.408905] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-28T01:36:51.011987] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-28T01:36:51.025108] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-28T01:36:51.208915] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-28T01:36:52.008923] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-28T01:36:52.484026] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-28T01:36:52.490913] [INFO ] [REMOTE ] ACRE: Full fetch complete (50537 records). [2025-09-28T01:36:52.491095] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-28T01:36:52.600821] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-28T01:36:52.813981] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-28T01:36:52.902582] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-28T01:36:52.902728] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-28T01:36:52.903450] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-28T01:36:52.903564] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-28T01:36:52.905291] [DEBUG] [LOCAL ] ACRE: Trimmed 50537 records to 34027 (keeping 200 days of data) [2025-09-28T01:36:53.113042] [DEBUG] [LOCAL ] ACRE: Primary data saved (34027 records). [2025-09-28T01:36:53.113257] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-28T01:36:53.113500] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACRE took 28.6s. Estimated remaining: 3h 31m 37s. Rate: 11.1 symbols/min [2025-09-28T01:36:53.292421] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:36:53.331669] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-28T01:36:53.331859] [INFO ] [MAIN ] ADCT: Loaded 34670 existing records. [2025-09-28T01:36:53.522963] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:36:53.523232] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-28T01:36:53.523334] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-28T01:36:53.524159] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-28T01:36:53.524244] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-28T01:36:53.614021] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-28T01:36:53.963126] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:36:54.282134] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-28T01:36:54.408902] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-28T01:36:55.208898] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-28T01:36:55.433252] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-28T01:36:56.009167] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-28T01:36:56.012327] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-28T01:36:56.044782] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-28T01:36:56.808947] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-28T01:36:57.261793] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-28T01:36:57.264382] [INFO ] [REMOTE ] ACV: Full fetch complete (9780 records). [2025-09-28T01:36:57.264507] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-28T01:36:57.614108] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-28T01:36:57.724181] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-28T01:36:57.724573] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-28T01:36:57.724979] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-28T01:36:57.725069] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-28T01:36:57.726018] [DEBUG] [LOCAL ] ACV: Trimmed 9780 records to 7095 (keeping 200 days of data) [2025-09-28T01:36:57.799249] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-28T01:36:57.811119] [DEBUG] [LOCAL ] ACV: Primary data saved (7095 records). [2025-09-28T01:36:57.811742] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-28T01:36:57.811885] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACV took 23.1s. Estimated remaining: 3h 30m 29s. Rate: 11.1 symbols/min [2025-09-28T01:36:57.985087] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:36:58.058022] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-28T01:36:58.058221] [INFO ] [MAIN ] ADM: Loaded 54175 existing records. [2025-09-28T01:36:58.248040] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:36:58.248388] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-28T01:36:58.248474] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-28T01:36:58.249513] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-28T01:36:58.249596] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-28T01:36:58.435029] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-28T01:36:58.637497] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:36:59.157215] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-28T01:36:59.208870] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-28T01:37:00.008915] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-28T01:37:00.045177] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-28T01:37:00.787617] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-28T01:37:00.808875] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-28T01:37:01.608957] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-28T01:37:02.297476] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-28T01:37:02.408955] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-28T01:37:02.456383] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-28T01:37:03.208960] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-28T01:37:03.507670] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-28T01:37:03.793722] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-28T01:37:04.008943] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-28T01:37:04.683156] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-28T01:37:04.808941] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-28T01:37:05.608929] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-28T01:37:05.843410] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-28T01:37:06.232483] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-28T01:37:06.408903] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-28T01:37:06.873195] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-28T01:37:07.208941] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-28T01:37:08.008924] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-28T01:37:08.261352] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-28T01:37:08.744349] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-28T01:37:08.808857] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-28T01:37:09.214255] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-28T01:37:09.608953] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-28T01:37:10.279903] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-28T01:37:10.408911] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-28T01:37:11.208927] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-28T01:37:11.557345] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-28T01:37:12.008901] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-28T01:37:12.046439] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-28T01:37:12.178835] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-28T01:37:12.808950] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-28T01:37:13.608869] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-28T01:37:13.640792] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-28T01:37:13.651392] [INFO ] [REMOTE ] ACVA: Full fetch complete (70254 records). [2025-09-28T01:37:13.651669] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-28T01:37:14.121342] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-28T01:37:14.121672] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-28T01:37:14.122409] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-28T01:37:14.122516] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-28T01:37:14.124154] [DEBUG] [LOCAL ] ACVA: Trimmed 70254 records to 50072 (keeping 200 days of data) [2025-09-28T01:37:14.420870] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-28T01:37:14.430985] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-28T01:37:14.453398] [DEBUG] [LOCAL ] ACVA: Primary data saved (50072 records). [2025-09-28T01:37:14.453580] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-28T01:37:14.453769] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 36.2s. Estimated remaining: 3h 46m 6s. Rate: 10.4 symbols/min [2025-09-28T01:37:14.645327] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:37:14.692930] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-28T01:37:14.693145] [INFO ] [MAIN ] ADNT: Loaded 48095 existing records. [2025-09-28T01:37:14.886779] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:37:14.887116] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-28T01:37:14.887200] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-28T01:37:14.887691] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-28T01:37:14.887774] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-28T01:37:15.220261] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-28T01:37:15.265537] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:37:15.551269] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-28T01:37:16.008909] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-28T01:37:16.066997] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-28T01:37:16.077208] [INFO ] [REMOTE ] ADC: Full fetch complete (66035 records). [2025-09-28T01:37:16.077452] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-28T01:37:16.517881] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-28T01:37:16.518113] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-28T01:37:16.518894] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-28T01:37:16.518984] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-28T01:37:16.520507] [DEBUG] [LOCAL ] ADC: Trimmed 66035 records to 46934 (keeping 200 days of data) [2025-09-28T01:37:16.776588] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-28T01:37:16.809881] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-28T01:37:16.860984] [DEBUG] [LOCAL ] ADC: Primary data saved (46934 records). [2025-09-28T01:37:16.861253] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-28T01:37:16.867240] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADC took 35.8s. Estimated remaining: 3h 41m 27s. Rate: 10.6 symbols/min [2025-09-28T01:37:17.047437] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:37:17.108037] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-28T01:37:17.108250] [INFO ] [MAIN ] ADT: Loaded 54253 existing records. [2025-09-28T01:37:17.294962] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:37:17.295266] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-28T01:37:17.295350] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-28T01:37:17.296753] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-28T01:37:17.296835] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-28T01:37:17.614038] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-28T01:37:17.676882] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:37:17.972954] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-28T01:37:18.408885] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-28T01:37:18.545034] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-28T01:37:19.145064] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-28T01:37:19.208878] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-28T01:37:20.008912] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-28T01:37:20.327954] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-28T01:37:20.586518] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-28T01:37:20.594711] [INFO ] [REMOTE ] ADCT: Full fetch complete (51606 records). [2025-09-28T01:37:20.594973] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-28T01:37:20.814822] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-28T01:37:21.008810] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-28T01:37:21.008936] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-28T01:37:21.009588] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-28T01:37:21.009711] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-28T01:37:21.010987] [DEBUG] [LOCAL ] ADCT: Trimmed 51606 records to 34670 (keeping 200 days of data) [2025-09-28T01:37:21.208168] [DEBUG] [LOCAL ] ADCT: Primary data saved (34670 records). [2025-09-28T01:37:21.208344] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-28T01:37:21.208473] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADCT took 28.1s. Estimated remaining: 3h 39m 37s. Rate: 10.7 symbols/min [2025-09-28T01:37:21.390828] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:37:21.420904] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-28T01:37:21.456096] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-28T01:37:21.456278] [INFO ] [MAIN ] ADX: Loaded 28180 existing records. [2025-09-28T01:37:21.612222] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-28T01:37:21.642632] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:37:21.642952] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-28T01:37:21.643037] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-28T01:37:21.643482] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-28T01:37:21.643566] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-28T01:37:22.019194] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:37:22.408928] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-28T01:37:22.825533] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-28T01:37:23.220074] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-28T01:37:23.228793] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-28T01:37:23.363151] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-28T01:37:24.008994] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-28T01:37:24.439444] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-28T01:37:24.808934] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-28T01:37:25.473409] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-28T01:37:25.608934] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-28T01:37:26.408960] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-28T01:37:26.709721] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-28T01:37:27.208883] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-28T01:37:27.344348] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-28T01:37:27.371904] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-28T01:37:28.008939] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-28T01:37:28.809018] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-28T01:37:29.008150] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-28T01:37:29.608876] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-28T01:37:29.737947] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-28T01:37:30.213056] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-28T01:37:30.408909] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-28T01:37:31.075587] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-28T01:37:31.208908] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-28T01:37:31.965040] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-28T01:37:32.008910] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-28T01:37:32.808890] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-28T01:37:33.139893] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-28T01:37:33.151547] [INFO ] [REMOTE ] ADM: Full fetch complete (77223 records). [2025-09-28T01:37:33.151784] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-28T01:37:33.575184] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-28T01:37:33.575397] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-28T01:37:33.576864] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-28T01:37:33.577169] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-28T01:37:33.579666] [DEBUG] [LOCAL ] ADM: Trimmed 77223 records to 54175 (keeping 200 days of data) [2025-09-28T01:37:33.647931] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-28T01:37:33.757447] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-28T01:37:33.989583] [DEBUG] [LOCAL ] ADM: Primary data saved (54175 records). [2025-09-28T01:37:33.989838] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-28T01:37:33.989979] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADM took 36.2s. Estimated remaining: 3h 48m 32s. Rate: 10.2 symbols/min [2025-09-28T01:37:34.166813] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:37:34.213910] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-28T01:37:34.236892] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-28T01:37:34.237114] [INFO ] [MAIN ] AEE: Loaded 50875 existing records. [2025-09-28T01:37:34.416763] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-28T01:37:34.440349] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:37:34.441992] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-28T01:37:34.442088] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-28T01:37:34.442629] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-28T01:37:34.442743] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-28T01:37:34.829523] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:37:35.208939] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-28T01:37:35.441376] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-28T01:37:36.008907] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-28T01:37:36.176975] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-28T01:37:36.452479] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-28T01:37:36.808933] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-28T01:37:37.608906] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-28T01:37:37.782520] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-28T01:37:37.858470] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-28T01:37:38.409003] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-28T01:37:39.076718] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-28T01:37:39.208935] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-28T01:37:39.724881] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-28T01:37:40.008932] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-28T01:37:40.819253] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-28T01:37:40.826905] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-28T01:37:41.311769] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-28T01:37:41.608926] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-28T01:37:42.408903] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-28T01:37:42.734291] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-28T01:37:42.768570] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-28T01:37:43.208951] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-28T01:37:43.738817] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-28T01:37:43.748448] [INFO ] [REMOTE ] ADNT: Full fetch complete (68058 records). [2025-09-28T01:37:43.748711] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-28T01:37:44.018345] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-28T01:37:44.166911] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-28T01:37:44.167146] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-28T01:37:44.168198] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-28T01:37:44.168295] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-28T01:37:44.170518] [DEBUG] [LOCAL ] ADNT: Trimmed 68058 records to 48095 (keeping 200 days of data) [2025-09-28T01:37:44.408119] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-28T01:37:44.426550] [INFO ] [REMOTE ] ADX: Full fetch complete (42107 records). [2025-09-28T01:37:44.428202] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-28T01:37:44.818222] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-28T01:37:44.819987] [DEBUG] [LOCAL ] ADNT: Primary data saved (48095 records). [2025-09-28T01:37:44.894541] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-28T01:37:44.895800] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-28T01:37:44.877050] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-28T01:37:44.896013] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 30.4s. Estimated remaining: 3h 54m 35s. Rate: 10.0 symbols/min [2025-09-28T01:37:44.896630] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-28T01:37:44.909255] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-28T01:37:45.005214] [DEBUG] [LOCAL ] ADX: Trimmed 42107 records to 28180 (keeping 200 days of data) [2025-09-28T01:37:45.181557] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:37:45.201358] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-28T01:37:45.203003] [INFO ] [MAIN ] AEFC: Loaded 8643 existing records. [2025-09-28T01:37:45.413167] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:37:45.417987] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-28T01:37:45.420740] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-28T01:37:45.421025] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-28T01:37:45.442109] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-28T01:37:45.595580] [DEBUG] [LOCAL ] ADX: Primary data saved (28180 records). [2025-09-28T01:37:45.627347] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-28T01:37:45.679455] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADX took 24.5s. Estimated remaining: 3h 48m 18s. Rate: 10.2 symbols/min [2025-09-28T01:37:46.090046] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:37:46.093399] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-28T01:37:46.091880] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:37:46.097335] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-28T01:37:46.162593] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-28T01:37:46.162829] [INFO ] [MAIN ] AEG: Loaded 50307 existing records. [2025-09-28T01:37:46.346420] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:37:46.346696] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-28T01:37:46.346782] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-28T01:37:46.347437] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-28T01:37:46.347519] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-28T01:37:46.411539] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-28T01:37:46.718390] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:37:46.747912] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-28T01:37:46.897162] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-28T01:37:47.208906] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-28T01:37:48.008921] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-28T01:37:48.342162] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-28T01:37:48.799163] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-28T01:37:48.809029] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-28T01:37:49.608895] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-28T01:37:49.931173] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-28T01:37:50.400067] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-28T01:37:50.409268] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-28T01:37:50.450108] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-28T01:37:51.208949] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-28T01:37:51.703878] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-28T01:37:52.008949] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-28T01:37:52.214563] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-28T01:37:52.733865] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-28T01:37:52.808898] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-28T01:37:53.608876] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-28T01:37:53.678577] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-28T01:37:54.408956] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-28T01:37:55.208869] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-28T01:37:55.363302] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-28T01:37:56.000603] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-28T01:37:56.010325] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-28T01:37:56.803716] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-28T01:37:56.808868] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-28T01:37:57.046395] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-28T01:37:57.057256] [INFO ] [REMOTE ] ADT: Full fetch complete (77204 records). [2025-09-28T01:37:57.057471] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-28T01:37:57.478055] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-28T01:37:57.478177] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-28T01:37:57.478977] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-28T01:37:57.479064] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-28T01:37:57.480639] [DEBUG] [LOCAL ] ADT: Trimmed 77204 records to 54253 (keeping 200 days of data) [2025-09-28T01:37:57.611153] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-28T01:37:57.830173] [DEBUG] [LOCAL ] ADT: Primary data saved (54253 records). [2025-09-28T01:37:57.830434] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-28T01:37:57.830772] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADT took 41.0s. Estimated remaining: 3h 55m 25s. Rate: 9.9 symbols/min [2025-09-28T01:37:58.013638] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:37:58.013905] [DEBUG] [LOCAL ] AEM: No existing data file found in primary storage. [2025-09-28T01:37:58.013982] [WARN ] [MAIN ] AEM: No existing data found, performing full refresh instead. [2025-09-28T01:37:58.014134] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-28T01:37:58.014220] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-28T01:37:58.014341] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-28T01:37:58.014442] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-28T01:37:58.396503] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:37:58.408858] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-28T01:37:58.499850] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-28T01:37:59.208945] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-28T01:37:59.514294] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-28T01:37:59.924837] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-28T01:38:00.008933] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-28T01:38:00.227134] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-28T01:38:00.491221] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-28T01:38:00.808942] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-28T01:38:01.595326] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-28T01:38:01.608921] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-28T01:38:02.229489] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-28T01:38:02.231252] [INFO ] [REMOTE ] AEFC: Full fetch complete (12319 records). [2025-09-28T01:38:02.231424] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-28T01:38:02.415608] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-28T01:38:02.669925] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-28T01:38:02.670471] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-28T01:38:02.670919] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-28T01:38:02.671021] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-28T01:38:02.671830] [DEBUG] [LOCAL ] AEFC: Trimmed 12319 records to 8643 (keeping 200 days of data) [2025-09-28T01:38:02.736063] [DEBUG] [LOCAL ] AEFC: Primary data saved (8643 records). [2025-09-28T01:38:02.736237] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-28T01:38:02.736401] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEFC took 17.8s. Estimated remaining: 3h 54m 3s. Rate: 10.0 symbols/min [2025-09-28T01:38:02.924628] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:38:02.994032] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-28T01:38:02.994249] [INFO ] [MAIN ] AEO: Loaded 54336 existing records. [2025-09-28T01:38:03.179709] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:38:03.179973] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-28T01:38:03.180058] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-28T01:38:03.181303] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-28T01:38:03.181392] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-28T01:38:03.214032] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-28T01:38:03.622207] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:38:04.008928] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-28T01:38:04.388739] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-28T01:38:04.634844] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-28T01:38:04.808961] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-28T01:38:05.608980] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-28T01:38:05.843422] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-28T01:38:06.408899] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-28T01:38:06.650461] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-28T01:38:07.208988] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-28T01:38:07.493515] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-28T01:38:08.008885] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-28T01:38:08.130733] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-28T01:38:08.808929] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-28T01:38:09.068425] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-28T01:38:09.608931] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-28T01:38:10.053005] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-28T01:38:10.408909] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-28T01:38:10.779291] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-28T01:38:11.208878] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-28T01:38:11.308483] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-28T01:38:11.320338] [INFO ] [REMOTE ] AEE: Full fetch complete (72553 records). [2025-09-28T01:38:11.320548] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-28T01:38:11.740419] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-28T01:38:11.740558] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-28T01:38:11.741532] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-28T01:38:11.741632] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-28T01:38:11.743562] [DEBUG] [LOCAL ] AEE: Trimmed 72553 records to 50875 (keeping 200 days of data) [2025-09-28T01:38:12.034486] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-28T01:38:12.074906] [DEBUG] [LOCAL ] AEE: Primary data saved (50875 records). [2025-09-28T01:38:12.075195] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-28T01:38:12.075355] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 38.1s. Estimated remaining: 3h 57m 32s. Rate: 9.8 symbols/min [2025-09-28T01:38:12.270764] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-28T01:38:12.299897] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:38:12.300921] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-09-28T01:38:12.301004] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-09-28T01:38:12.301124] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-28T01:38:12.301197] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-28T01:38:12.301279] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-09-28T01:38:12.301350] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-28T01:38:12.692804] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:38:12.720709] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-28T01:38:12.808913] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-28T01:38:13.608945] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-28T01:38:14.253392] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-28T01:38:14.320841] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-28T01:38:14.408940] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-28T01:38:15.208886] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-28T01:38:15.472522] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-28T01:38:16.008872] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-28T01:38:16.431696] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-28T01:38:16.808881] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-28T01:38:16.882237] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-28T01:38:17.470322] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-28T01:38:17.608914] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-28T01:38:18.408909] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-28T01:38:18.528195] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-28T01:38:19.208876] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-28T01:38:19.295611] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-28T01:38:20.008944] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-28T01:38:20.400430] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-28T01:38:20.808901] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-28T01:38:21.223580] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-28T01:38:21.295937] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-28T01:38:21.306483] [INFO ] [REMOTE ] AEG: Full fetch complete (70286 records). [2025-09-28T01:38:21.306690] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-28T01:38:21.610218] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-28T01:38:21.709127] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-28T01:38:21.709263] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-28T01:38:21.710039] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-28T01:38:21.710177] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-28T01:38:21.712430] [DEBUG] [LOCAL ] AEG: Trimmed 70286 records to 50307 (keeping 200 days of data) [2025-09-28T01:38:22.021366] [DEBUG] [LOCAL ] AEG: Primary data saved (50307 records). [2025-09-28T01:38:22.021545] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-28T01:38:22.021697] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 36.3s. Estimated remaining: 4h 1m 29s. Rate: 9.7 symbols/min [2025-09-28T01:38:22.411904] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-28T01:38:22.414979] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-28T01:38:23.214117] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-28T01:38:23.226862] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-28T01:38:24.009038] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-28T01:38:24.525356] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-28T01:38:24.808977] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-28T01:38:25.156791] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-28T01:38:25.464660] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-28T01:38:25.608951] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-28T01:38:26.408917] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-28T01:38:26.807599] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-28T01:38:26.818152] [INFO ] [REMOTE ] AEM: Full fetch complete (77144 records). [2025-09-28T01:38:26.818343] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-28T01:38:27.255735] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-28T01:38:27.255903] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-28T01:38:27.256841] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-28T01:38:27.256972] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-28T01:38:27.276894] [DEBUG] [LOCAL ] AEM: Trimmed 77144 records to 54243 (keeping 200 days of data) [2025-09-28T01:38:27.293062] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-28T01:38:27.397697] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-28T01:38:27.672802] [DEBUG] [LOCAL ] AEM: Primary data saved (54243 records). [2025-09-28T01:38:27.673009] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-28T01:38:27.673154] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 29.8s. Estimated remaining: 4h 0m 48s. Rate: 9.7 symbols/min [2025-09-28T01:38:28.197108] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-28T01:38:28.210613] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-28T01:38:29.453181] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-28T01:38:29.469706] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-28T01:38:29.968220] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-28T01:38:29.980001] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-28T01:38:31.494323] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-28T01:38:31.504807] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-28T01:38:31.718285] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-28T01:38:31.730155] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-28T01:38:33.160353] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-28T01:38:33.171159] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-28T01:38:33.430612] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-28T01:38:33.441896] [INFO ] [REMOTE ] AEO: Full fetch complete (77444 records). [2025-09-28T01:38:33.442072] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-28T01:38:33.846217] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-28T01:38:33.846343] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-28T01:38:33.847202] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-28T01:38:33.847292] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-28T01:38:33.849077] [DEBUG] [LOCAL ] AEO: Trimmed 77444 records to 54336 (keeping 200 days of data) [2025-09-28T01:38:34.196964] [DEBUG] [LOCAL ] AEO: Primary data saved (54336 records). [2025-09-28T01:38:34.197208] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-28T01:38:34.199872] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AEO took 31.5s. Estimated remaining: 4h 1m 2s. Rate: 9.7 symbols/min [2025-09-28T01:38:34.552575] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-28T01:38:34.570211] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-28T01:38:36.278849] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-28T01:38:36.292677] [INFO ] [REMOTE ] AER: Full fetch complete (69548 records). [2025-09-28T01:38:36.292955] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-28T01:38:36.698988] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-28T01:38:36.699128] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-28T01:38:36.699891] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-28T01:38:36.699978] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-28T01:38:36.701532] [DEBUG] [LOCAL ] AER: Trimmed 69548 records to 49271 (keeping 200 days of data) [2025-09-28T01:38:37.015901] [DEBUG] [LOCAL ] AER: Primary data saved (49271 records). [2025-09-28T01:38:37.016090] [INFO ] [MAIN ] AER: Full history saved. [2025-09-28T01:38:37.016213] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AER took 24.9s. Estimated remaining: 3h 57m 39s. Rate: 9.8 symbols/min [2025-09-28T01:38:37.641539] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:38:37.769223] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:38:37.783031] [DEBUG] [LOCAL ] AESI: No existing data file found in primary storage. [2025-09-28T01:38:37.793848] [WARN ] [MAIN ] AESI: No existing data found, performing full refresh instead. [2025-09-28T01:38:37.793762] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:38:37.803615] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-28T01:38:37.807977] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:38:37.808906] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-28T01:38:37.809245] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-28T01:38:37.809402] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-28T01:38:37.809141] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-28T01:38:37.809610] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-28T01:38:37.824431] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-28T01:38:37.855985] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-28T01:38:37.897894] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-28T01:38:37.913766] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-28T01:38:37.913929] [INFO ] [MAIN ] AFB: Loaded 11422 existing records. [2025-09-28T01:38:37.931983] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-28T01:38:38.545484] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:38:38.484543] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-28T01:38:38.581764] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-28T01:38:38.587169] [INFO ] [MAIN ] AES: Loaded 54450 existing records. [2025-09-28T01:38:38.640516] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-28T01:38:38.846538] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:38:38.857045] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-28T01:38:38.878782] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-28T01:38:38.957619] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-28T01:38:38.982964] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:38:39.014325] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-28T01:38:39.338745] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:38:39.355921] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:38:39.387326] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-28T01:38:39.411763] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-28T01:38:39.426767] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-28T01:38:39.426997] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:38:39.452105] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-28T01:38:39.475682] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-28T01:38:39.464999] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-09-28T01:38:39.494897] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:38:39.560812] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-28T01:38:39.657259] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-28T01:38:39.672395] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:38:39.672673] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-28T01:38:39.696462] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-28T01:38:39.696838] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-28T01:38:39.697179] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.7s. Estimated remaining: 3h 54m 17s. Rate: 9.9 symbols/min [2025-09-28T01:38:40.082752] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:38:40.162780] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:38:40.163334] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-28T01:38:40.193258] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-28T01:38:40.193434] [INFO ] [MAIN ] AFG: Loaded 33021 existing records. [2025-09-28T01:38:40.378242] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:38:40.378463] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-28T01:38:40.378543] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-28T01:38:40.378979] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-28T01:38:40.379061] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-28T01:38:40.673210] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-28T01:38:40.702668] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-28T01:38:40.792257] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:38:40.793049] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-28T01:38:40.820690] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-28T01:38:40.830167] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-28T01:38:41.477721] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-28T01:38:41.480835] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-28T01:38:41.801541] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-28T01:38:41.807416] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-28T01:38:42.214184] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-28T01:38:42.226276] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-28T01:38:42.297220] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-28T01:38:42.300219] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-28T01:38:42.438793] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-28T01:38:42.448358] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-28T01:38:42.834632] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-28T01:38:42.984972] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-28T01:38:43.208913] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-28T01:38:44.008999] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-28T01:38:44.083386] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-28T01:38:44.147778] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-28T01:38:44.530948] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-28T01:38:44.626502] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-28T01:38:44.808902] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-28T01:38:45.608915] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-28T01:38:46.310094] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-28T01:38:46.408910] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-28T01:38:47.208868] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-28T01:38:47.608318] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-28T01:38:47.858953] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-28T01:38:48.008869] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-28T01:38:48.808917] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-28T01:38:48.898154] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-28T01:38:49.425762] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-28T01:38:49.440119] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-28T01:38:49.608978] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-28T01:38:50.408926] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-28T01:38:50.830966] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-28T01:38:51.208912] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-28T01:38:52.008889] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-28T01:38:52.160390] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-28T01:38:52.225779] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-28T01:38:52.808915] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-28T01:38:53.608946] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-28T01:38:54.036366] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-28T01:38:54.408882] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-28T01:38:54.547600] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-28T01:38:55.074525] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-28T01:38:55.101979] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-28T01:38:55.208929] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-28T01:38:56.008954] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-28T01:38:56.808909] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-28T01:38:56.849256] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-28T01:38:57.326353] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-28T01:38:57.608934] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-28T01:38:58.086710] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-28T01:38:58.408914] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-28T01:38:59.208915] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-28T01:38:59.291429] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-28T01:38:59.826220] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-28T01:39:00.008967] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-28T01:39:00.030615] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-28T01:39:00.033869] [INFO ] [REMOTE ] AFB: Full fetch complete (16499 records). [2025-09-28T01:39:00.034066] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-28T01:39:00.436526] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-28T01:39:00.436684] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-28T01:39:00.437050] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-28T01:39:00.437174] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-28T01:39:00.437924] [DEBUG] [LOCAL ] AFB: Trimmed 16499 records to 11422 (keeping 200 days of data) [2025-09-28T01:39:00.511071] [DEBUG] [LOCAL ] AFB: Primary data saved (11422 records). [2025-09-28T01:39:00.511259] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-28T01:39:00.511404] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 23.5s. Estimated remaining: 4h 7m 51s. Rate: 9.4 symbols/min [2025-09-28T01:39:00.684924] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:39:00.690120] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-28T01:39:00.690246] [INFO ] [MAIN ] AFGB: Loaded 2404 existing records. [2025-09-28T01:39:00.814081] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-28T01:39:00.881613] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:39:00.881965] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-28T01:39:00.882045] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-28T01:39:00.882327] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-28T01:39:00.882449] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-28T01:39:01.244221] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:39:01.608904] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-28T01:39:02.222792] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-28T01:39:02.408889] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-28T01:39:02.775833] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-28T01:39:02.892387] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-28T01:39:02.899074] [INFO ] [REMOTE ] AFG: Full fetch complete (45743 records). [2025-09-28T01:39:02.899204] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-28T01:39:03.214056] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-28T01:39:03.296703] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-28T01:39:03.296845] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-28T01:39:03.297515] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-28T01:39:03.297605] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-28T01:39:03.302663] [DEBUG] [LOCAL ] AFG: Trimmed 45743 records to 33021 (keeping 200 days of data) [2025-09-28T01:39:03.516387] [DEBUG] [LOCAL ] AFG: Primary data saved (33021 records). [2025-09-28T01:39:03.516580] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-28T01:39:03.516758] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AFG took 23.8s. Estimated remaining: 4h 4m 41s. Rate: 9.5 symbols/min [2025-09-28T01:39:03.692269] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:39:03.697978] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-28T01:39:03.698093] [INFO ] [MAIN ] AFGC: Loaded 2602 existing records. [2025-09-28T01:39:03.882140] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:39:03.882382] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-28T01:39:03.882460] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-28T01:39:03.882766] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-28T01:39:03.882845] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-28T01:39:04.014068] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-28T01:39:04.269215] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:39:04.402338] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-28T01:39:04.800520] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-28T01:39:04.808838] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-28T01:39:04.901445] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-28T01:39:04.911415] [INFO ] [REMOTE ] AESI: Full fetch complete (70321 records). [2025-09-28T01:39:04.911593] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-28T01:39:05.329025] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-28T01:39:05.329447] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-28T01:39:05.330325] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-28T01:39:05.330414] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-28T01:39:05.333352] [DEBUG] [LOCAL ] AESI: Trimmed 70321 records to 50213 (keeping 200 days of data) [2025-09-28T01:39:05.432023] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-28T01:39:05.620782] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-28T01:39:05.659274] [DEBUG] [LOCAL ] AESI: Primary data saved (50213 records). [2025-09-28T01:39:05.659420] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-28T01:39:05.659567] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AESI took 28.6s. Estimated remaining: 4h 0m 55s. Rate: 9.7 symbols/min [2025-09-28T01:39:05.838312] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:39:05.843611] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-28T01:39:05.843748] [INFO ] [MAIN ] AFGD: Loaded 1859 existing records. [2025-09-28T01:39:06.039217] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:39:06.039535] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-28T01:39:06.039629] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-28T01:39:06.039980] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-28T01:39:06.040057] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-28T01:39:06.147870] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-28T01:39:06.404516] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:39:06.408849] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-28T01:39:07.010432] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-28T01:39:07.208912] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-28T01:39:07.690697] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-28T01:39:08.008923] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-28T01:39:08.808912] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-28T01:39:09.291803] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-28T01:39:09.608872] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-28T01:39:10.006196] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-28T01:39:10.114611] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-28T01:39:10.408920] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-28T01:39:11.208920] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-28T01:39:11.651096] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-28T01:39:12.008885] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-28T01:39:12.350181] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-28T01:39:12.352062] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-28T01:39:12.808974] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-28T01:39:13.342135] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-28T01:39:13.608912] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-28T01:39:14.036754] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-28T01:39:14.408978] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-28T01:39:14.875290] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-28T01:39:15.208910] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-28T01:39:16.008932] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-28T01:39:16.461450] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-28T01:39:16.808895] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-28T01:39:17.138719] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-28T01:39:17.149263] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-09-28T01:39:17.149444] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-28T01:39:17.374701] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-28T01:39:17.612833] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-28T01:39:17.614087] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-28T01:39:17.614167] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-28T01:39:17.614981] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-28T01:39:17.615163] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-28T01:39:17.617005] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 54450 (keeping 200 days of data) [2025-09-28T01:39:17.975146] [DEBUG] [LOCAL ] AES: Primary data saved (54450 records). [2025-09-28T01:39:17.975343] [INFO ] [MAIN ] AES: Full history saved. [2025-09-28T01:39:17.975476] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AES took 41.0s. Estimated remaining: 4h 6m 4s. Rate: 9.5 symbols/min [2025-09-28T01:39:18.139529] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-28T01:39:18.161456] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:39:18.163680] [DEBUG] [LOCAL ] AFGE: No existing data file found in primary storage. [2025-09-28T01:39:18.163760] [WARN ] [MAIN ] AFGE: No existing data found, performing full refresh instead. [2025-09-28T01:39:18.163884] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-28T01:39:18.163958] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-28T01:39:18.164045] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-09-28T01:39:18.164121] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-28T01:39:18.414950] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-28T01:39:18.546195] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:39:18.941297] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-28T01:39:19.208912] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-28T01:39:19.763434] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-28T01:39:20.008917] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-28T01:39:20.402924] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-28T01:39:20.808936] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-28T01:39:21.265229] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-28T01:39:21.608917] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-28T01:39:22.049718] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-28T01:39:22.408939] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-28T01:39:22.856559] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-28T01:39:23.208946] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-28T01:39:23.842296] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-28T01:39:24.008931] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-28T01:39:24.395332] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-28T01:39:24.808910] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-28T01:39:25.258531] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-28T01:39:25.608928] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-28T01:39:26.200607] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-28T01:39:26.408925] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-28T01:39:26.882118] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-28T01:39:26.883445] [INFO ] [REMOTE ] AFGC: Full fetch complete (3727 records). [2025-09-28T01:39:26.883576] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-28T01:39:27.214208] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-28T01:39:27.461735] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-28T01:39:27.461869] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-28T01:39:27.462073] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-28T01:39:27.462165] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-28T01:39:27.462898] [DEBUG] [LOCAL ] AFGC: Trimmed 3727 records to 2602 (keeping 200 days of data) [2025-09-28T01:39:27.489586] [DEBUG] [LOCAL ] AFGC: Primary data saved (2602 records). [2025-09-28T01:39:27.489872] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-28T01:39:27.490044] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGC took 24.0s. Estimated remaining: 4h 8m 38s. Rate: 9.4 symbols/min [2025-09-28T01:39:27.727212] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:39:27.727486] [DEBUG] [LOCAL ] AFL: No existing data file found in primary storage. [2025-09-28T01:39:27.727564] [WARN ] [MAIN ] AFL: No existing data found, performing full refresh instead. [2025-09-28T01:39:27.727710] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-28T01:39:27.727787] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-28T01:39:27.727872] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-09-28T01:39:27.727944] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-28T01:39:27.800734] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-28T01:39:28.014067] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-28T01:39:28.132460] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:39:28.627378] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-28T01:39:28.808902] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-28T01:39:29.296742] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-28T01:39:29.608903] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-28T01:39:30.238821] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-28T01:39:30.408925] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-28T01:39:31.208909] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-28T01:39:31.890257] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-28T01:39:32.008863] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-28T01:39:32.272706] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-28T01:39:32.335948] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-28T01:39:32.808910] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-28T01:39:33.253295] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-28T01:39:33.254409] [INFO ] [REMOTE ] AFGB: Full fetch complete (3649 records). [2025-09-28T01:39:33.254507] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-28T01:39:33.620877] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-28T01:39:33.646988] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-28T01:39:33.647088] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-28T01:39:33.647264] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-28T01:39:33.647344] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-28T01:39:33.647956] [DEBUG] [LOCAL ] AFGB: Trimmed 3649 records to 2404 (keeping 200 days of data) [2025-09-28T01:39:33.664291] [DEBUG] [LOCAL ] AFGB: Primary data saved (2404 records). [2025-09-28T01:39:33.664425] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-28T01:39:33.664546] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGB took 33.2s. Estimated remaining: 4h 8m 20s. Rate: 9.4 symbols/min [2025-09-28T01:39:33.838199] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:39:33.899871] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-28T01:39:33.900070] [INFO ] [MAIN ] AG: Loaded 54423 existing records. [2025-09-28T01:39:34.086317] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:39:34.086564] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-28T01:39:34.086665] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-28T01:39:34.087321] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-28T01:39:34.087401] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-28T01:39:34.414034] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-28T01:39:34.458284] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:39:34.888254] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-28T01:39:35.208865] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-28T01:39:35.451288] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-28T01:39:36.008914] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-28T01:39:36.457460] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-28T01:39:36.808900] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-28T01:39:37.201273] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-28T01:39:37.237876] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-28T01:39:37.608907] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-28T01:39:37.994155] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-28T01:39:38.408955] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-28T01:39:39.208900] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-28T01:39:39.785846] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-28T01:39:40.008905] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-28T01:39:40.526776] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-28T01:39:40.527844] [INFO ] [REMOTE ] AFGE: Full fetch complete (3490 records). [2025-09-28T01:39:40.527941] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-28T01:39:40.732960] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-28T01:39:40.814003] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-28T01:39:40.966134] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-28T01:39:40.966300] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-28T01:39:40.966466] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-28T01:39:40.966555] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-28T01:39:40.967109] [DEBUG] [LOCAL ] AFGE: Trimmed 3490 records to 2512 (keeping 200 days of data) [2025-09-28T01:39:40.983169] [DEBUG] [LOCAL ] AFGE: Primary data saved (2512 records). [2025-09-28T01:39:40.983284] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-28T01:39:40.983394] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGE took 23.0s. Estimated remaining: 4h 8m 57s. Rate: 9.3 symbols/min [2025-09-28T01:39:41.161428] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:39:41.208796] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-28T01:39:41.208978] [INFO ] [MAIN ] AGCO: Loaded 43086 existing records. [2025-09-28T01:39:41.367296] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-28T01:39:41.394490] [INFO ] [REMOTE ] AFGD: Full fetch complete (3178 records). [2025-09-28T01:39:41.400226] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:39:41.400507] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-28T01:39:41.401098] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-28T01:39:41.446081] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-28T01:39:41.486594] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-28T01:39:41.509703] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-28T01:39:41.618736] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-28T01:39:42.117528] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-28T01:39:42.139246] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-28T01:39:42.177255] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:39:42.177429] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-28T01:39:42.177855] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-28T01:39:42.178281] [DEBUG] [LOCAL ] AFGD: Trimmed 3178 records to 1859 (keeping 200 days of data) [2025-09-28T01:39:42.190502] [DEBUG] [LOCAL ] AFGD: Primary data saved (1859 records). [2025-09-28T01:39:42.190664] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-28T01:39:42.190793] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGD took 36.5s. Estimated remaining: 4h 4m 43s. Rate: 9.5 symbols/min [2025-09-28T01:39:42.360868] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:39:42.381204] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-28T01:39:42.381373] [INFO ] [MAIN ] AGD: Loaded 17937 existing records. [2025-09-28T01:39:42.413989] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-28T01:39:42.564438] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:39:42.564710] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-28T01:39:42.564791] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-28T01:39:42.565057] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-28T01:39:42.565134] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-28T01:39:42.922666] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:39:43.208938] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-28T01:39:43.353241] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-28T01:39:43.821922] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-28T01:39:44.008929] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-28T01:39:44.166482] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-28T01:39:44.808913] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-28T01:39:45.608913] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-28T01:39:46.047258] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-28T01:39:46.341898] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-28T01:39:46.408896] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-28T01:39:47.208873] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-28T01:39:47.447784] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-28T01:39:47.973498] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-28T01:39:48.008850] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-28T01:39:48.298613] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-28T01:39:48.808927] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-28T01:39:49.608872] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-28T01:39:49.715155] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-28T01:39:49.921469] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-28T01:39:50.408896] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-28T01:39:51.209263] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-28T01:39:51.238036] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-28T01:39:51.351582] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-28T01:39:52.008907] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-28T01:39:52.808890] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-28T01:39:53.045319] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-28T01:39:53.608928] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-28T01:39:54.103544] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-28T01:39:54.167556] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-28T01:39:54.408915] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-28T01:39:55.209250] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-28T01:39:55.215054] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-28T01:39:56.013976] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-28T01:39:56.030393] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-28T01:39:56.198560] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-28T01:39:56.808925] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-28T01:39:57.608908] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-28T01:39:58.124439] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-28T01:39:58.143783] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-28T01:39:58.408956] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-28T01:39:59.079887] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-28T01:39:59.208908] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-28T01:40:00.008891] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-28T01:40:00.514462] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-28T01:40:00.808896] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-28T01:40:01.117712] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-28T01:40:01.330140] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-28T01:40:01.608974] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-28T01:40:02.309572] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-28T01:40:02.408886] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-28T01:40:03.208875] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-28T01:40:03.440122] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-28T01:40:04.008906] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-28T01:40:04.143974] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-28T01:40:04.808897] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-28T01:40:05.132003] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-28T01:40:05.344887] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-28T01:40:05.608933] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-28T01:40:06.408899] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-28T01:40:06.719306] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-28T01:40:06.729983] [INFO ] [REMOTE ] AFL: Full fetch complete (76918 records). [2025-09-28T01:40:06.730156] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-28T01:40:07.146259] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-28T01:40:07.146396] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-28T01:40:07.147232] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-28T01:40:07.147324] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-28T01:40:07.149044] [DEBUG] [LOCAL ] AFL: Trimmed 76918 records to 53915 (keeping 200 days of data) [2025-09-28T01:40:07.231003] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-28T01:40:07.551726] [DEBUG] [LOCAL ] AFL: Primary data saved (53915 records). [2025-09-28T01:40:07.552000] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-28T01:40:07.552293] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 40.1s. Estimated remaining: 4h 19m 21s. Rate: 8.9 symbols/min [2025-09-28T01:40:07.747082] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:40:07.809431] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-28T01:40:07.809670] [INFO ] [MAIN ] AGI: Loaded 54195 existing records. [2025-09-28T01:40:08.005911] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:40:08.006340] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-28T01:40:08.006481] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-28T01:40:08.006846] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-28T01:40:08.007008] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-28T01:40:08.140235] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-28T01:40:08.183822] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-28T01:40:08.184082] [INFO ] [REMOTE ] AGCO: Full fetch complete (61985 records). [2025-09-28T01:40:08.211173] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-28T01:40:08.325755] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-28T01:40:08.690515] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-28T01:40:08.821266] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:40:08.835191] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-28T01:40:08.935524] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-28T01:40:08.935671] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-28T01:40:08.936450] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-28T01:40:08.936544] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-28T01:40:08.939663] [DEBUG] [LOCAL ] AGCO: Trimmed 61985 records to 43086 (keeping 200 days of data) [2025-09-28T01:40:09.237971] [DEBUG] [LOCAL ] AGCO: Primary data saved (43086 records). [2025-09-28T01:40:09.238137] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-28T01:40:09.238291] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGCO took 28.3s. Estimated remaining: 4h 15m 26s. Rate: 9.1 symbols/min [2025-09-28T01:40:09.425279] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:40:09.484137] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-28T01:40:09.484328] [INFO ] [MAIN ] AGL: Loaded 53191 existing records. [2025-09-28T01:40:09.614015] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-28T01:40:09.675538] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:40:09.675825] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-28T01:40:09.675907] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-28T01:40:09.676631] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-28T01:40:09.676735] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-28T01:40:10.048014] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-28T01:40:10.053975] [INFO ] [REMOTE ] AGD: Full fetch complete (25388 records). [2025-09-28T01:40:10.072501] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-28T01:40:10.076256] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:40:10.422838] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-28T01:40:10.476357] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-28T01:40:10.476729] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-28T01:40:10.477165] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-28T01:40:10.477247] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-28T01:40:10.479122] [DEBUG] [LOCAL ] AGD: Trimmed 25388 records to 17937 (keeping 200 days of data) [2025-09-28T01:40:10.609534] [DEBUG] [LOCAL ] AGD: Primary data saved (17937 records). [2025-09-28T01:40:10.609810] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-28T01:40:10.610037] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGD took 28.4s. Estimated remaining: 4h 11m 26s. Rate: 9.2 symbols/min [2025-09-28T01:40:10.792514] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:40:10.826224] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-28T01:40:10.846186] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-28T01:40:10.846348] [INFO ] [MAIN ] AGM: Loaded 10125 existing records. [2025-09-28T01:40:11.034135] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:40:11.034378] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-28T01:40:11.034456] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-28T01:40:11.034688] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-28T01:40:11.034765] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-28T01:40:11.216379] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-28T01:40:11.421171] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:40:11.546511] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-28T01:40:12.008921] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-28T01:40:12.134256] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-28T01:40:12.679843] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-28T01:40:12.808919] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-28T01:40:13.132318] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-28T01:40:13.143615] [INFO ] [REMOTE ] AG: Full fetch complete (77586 records). [2025-09-28T01:40:13.143892] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-28T01:40:13.612952] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-28T01:40:13.614440] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-28T01:40:13.614594] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-28T01:40:13.615753] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-28T01:40:13.616090] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-28T01:40:13.619406] [DEBUG] [LOCAL ] AG: Trimmed 77586 records to 54423 (keeping 200 days of data) [2025-09-28T01:40:13.973969] [DEBUG] [LOCAL ] AG: Primary data saved (54423 records). [2025-09-28T01:40:13.974181] [INFO ] [MAIN ] AG: Full history saved. [2025-09-28T01:40:13.974357] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AG took 40.3s. Estimated remaining: 4h 9m 2s. Rate: 9.3 symbols/min [2025-09-28T01:40:14.165425] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:40:14.201126] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-28T01:40:14.201338] [INFO ] [MAIN ] AGO: Loaded 28356 existing records. [2025-09-28T01:40:14.390496] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:40:14.390779] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-28T01:40:14.390868] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-28T01:40:14.391112] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-28T01:40:14.391191] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-28T01:40:14.414705] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-28T01:40:14.783301] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:40:14.811170] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-28T01:40:15.208864] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-28T01:40:15.225175] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-28T01:40:15.315762] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-28T01:40:16.008850] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-28T01:40:16.256140] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-28T01:40:16.808968] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-28T01:40:17.601265] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-28T01:40:17.610834] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-28T01:40:18.408981] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-28T01:40:18.696020] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-28T01:40:18.855682] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-28T01:40:19.208946] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-28T01:40:20.008925] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-28T01:40:20.129345] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-28T01:40:20.680361] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-28T01:40:20.742631] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-28T01:40:20.808886] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-28T01:40:21.608911] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-28T01:40:22.355070] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-28T01:40:22.408865] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-28T01:40:22.913077] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-28T01:40:23.208924] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-28T01:40:23.252685] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-28T01:40:24.008892] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-28T01:40:24.328481] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-28T01:40:24.808908] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-28T01:40:25.608881] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-28T01:40:26.078578] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-28T01:40:26.158712] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-28T01:40:26.408903] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-28T01:40:27.208926] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-28T01:40:27.549111] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-28T01:40:27.618974] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-28T01:40:28.008903] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-28T01:40:28.808886] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-28T01:40:29.079614] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-28T01:40:29.480749] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-28T01:40:29.555287] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-28T01:40:29.608920] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-28T01:40:30.408900] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-28T01:40:31.208895] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-28T01:40:31.320362] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-28T01:40:31.453141] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-28T01:40:32.008867] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-28T01:40:32.091595] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-28T01:40:32.808905] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-28T01:40:33.608914] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-28T01:40:33.752800] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-28T01:40:33.772997] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-28T01:40:34.408904] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-28T01:40:35.125932] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-28T01:40:35.208922] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-28T01:40:35.428375] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-28T01:40:35.849525] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-28T01:40:35.852669] [INFO ] [REMOTE ] AGM: Full fetch complete (12620 records). [2025-09-28T01:40:35.852799] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-28T01:40:36.016491] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-28T01:40:36.244498] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-28T01:40:36.244628] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-28T01:40:36.245004] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-28T01:40:36.245149] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-28T01:40:36.245942] [DEBUG] [LOCAL ] AGM: Trimmed 12620 records to 10125 (keeping 200 days of data) [2025-09-28T01:40:36.315076] [DEBUG] [LOCAL ] AGM: Primary data saved (10125 records). [2025-09-28T01:40:36.315262] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-28T01:40:36.315392] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGM took 25.7s. Estimated remaining: 4h 20m 17s. Rate: 8.9 symbols/min [2025-09-28T01:40:36.494921] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:40:36.530712] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-28T01:40:36.530897] [INFO ] [MAIN ] AGRO: Loaded 34097 existing records. [2025-09-28T01:40:36.738324] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:40:36.738668] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-28T01:40:36.738753] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-28T01:40:36.739069] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-28T01:40:36.739160] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-28T01:40:36.814084] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-28T01:40:37.130878] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:40:37.608906] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-28T01:40:37.959251] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-28T01:40:38.403532] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-28T01:40:38.413619] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-28T01:40:38.415343] [INFO ] [REMOTE ] AGI: Full fetch complete (76769 records). [2025-09-28T01:40:38.415554] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-28T01:40:38.824845] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-28T01:40:38.825072] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-28T01:40:38.825971] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-28T01:40:38.826169] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-28T01:40:38.847879] [DEBUG] [LOCAL ] AGI: Trimmed 76769 records to 54195 (keeping 200 days of data) [2025-09-28T01:40:38.848852] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-28T01:40:39.201679] [DEBUG] [LOCAL ] AGI: Primary data saved (54195 records). [2025-09-28T01:40:39.201909] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-28T01:40:39.204695] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGI took 31.7s. Estimated remaining: 4h 17m 28s. Rate: 9.0 symbols/min [2025-09-28T01:40:39.217332] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-28T01:40:39.397224] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:40:39.414812] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-28T01:40:39.461930] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-28T01:40:39.462107] [INFO ] [MAIN ] AGX: Loaded 33823 existing records. [2025-09-28T01:40:39.646755] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:40:39.647029] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-28T01:40:39.647149] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-28T01:40:39.647691] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-28T01:40:39.647771] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-28T01:40:40.016567] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:40:40.016636] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-28T01:40:40.808913] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-28T01:40:41.363930] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-28T01:40:41.477877] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-28T01:40:41.608917] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-28T01:40:41.866869] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-28T01:40:42.408907] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-28T01:40:43.055043] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-28T01:40:43.208921] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-28T01:40:44.008873] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-28T01:40:44.264078] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-28T01:40:44.670310] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-28T01:40:44.808894] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-28T01:40:45.335877] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-28T01:40:45.608914] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-28T01:40:46.408900] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-28T01:40:46.485074] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-28T01:40:47.208901] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-28T01:40:47.420936] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-28T01:40:47.432046] [INFO ] [REMOTE ] AGL: Full fetch complete (75474 records). [2025-09-28T01:40:47.432265] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-28T01:40:47.863890] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-28T01:40:47.864181] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-28T01:40:47.865340] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-28T01:40:47.865482] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-28T01:40:47.896071] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-28T01:40:47.902993] [DEBUG] [LOCAL ] AGL: Trimmed 75474 records to 53191 (keeping 200 days of data) [2025-09-28T01:40:48.009021] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-28T01:40:48.225055] [DEBUG] [LOCAL ] AGL: Primary data saved (53191 records). [2025-09-28T01:40:48.225286] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-28T01:40:48.225433] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGL took 39.0s. Estimated remaining: 4h 18m 59s. Rate: 8.9 symbols/min [2025-09-28T01:40:48.417989] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:40:48.418233] [DEBUG] [LOCAL ] AHH: No existing data file found in primary storage. [2025-09-28T01:40:48.418311] [WARN ] [MAIN ] AHH: No existing data found, performing full refresh instead. [2025-09-28T01:40:48.418430] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-28T01:40:48.418504] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-28T01:40:48.418590] [DEBUG] [LOCAL ] AHH: No primary data file found to delete. [2025-09-28T01:40:48.418687] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-28T01:40:48.818347] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:40:48.810276] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-28T01:40:48.820551] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-28T01:40:49.314789] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-28T01:40:49.608940] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-28T01:40:50.081248] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-28T01:40:50.408891] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-28T01:40:50.799902] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-28T01:40:51.208925] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-28T01:40:51.900104] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-28T01:40:52.008936] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-28T01:40:52.402975] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-28T01:40:52.808906] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-28T01:40:53.530749] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-28T01:40:53.608971] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-28T01:40:54.051188] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-28T01:40:54.414078] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-28T01:40:54.422593] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-28T01:40:54.429550] [INFO ] [REMOTE ] AGO: Full fetch complete (39304 records). [2025-09-28T01:40:54.429753] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-28T01:40:54.827041] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-28T01:40:54.827172] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-28T01:40:54.827740] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-28T01:40:54.827859] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-28T01:40:54.828967] [DEBUG] [LOCAL ] AGO: Trimmed 39304 records to 28356 (keeping 200 days of data) [2025-09-28T01:40:55.012878] [DEBUG] [LOCAL ] AGO: Primary data saved (28356 records). [2025-09-28T01:40:55.013094] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-28T01:40:55.013263] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 41.0s. Estimated remaining: 4h 18m 55s. Rate: 8.9 symbols/min [2025-09-28T01:40:55.190589] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:40:55.190894] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-28T01:40:55.190996] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-28T01:40:55.191168] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-28T01:40:55.191260] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-28T01:40:55.191381] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-28T01:40:55.191478] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-28T01:40:55.214048] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-28T01:40:55.568305] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:40:55.782682] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-28T01:40:56.008967] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-28T01:40:56.808874] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-28T01:40:56.968124] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-28T01:40:57.270947] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-28T01:40:57.278576] [INFO ] [REMOTE ] AGRO: Full fetch complete (49824 records). [2025-09-28T01:40:57.278825] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-28T01:40:57.613981] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-28T01:40:57.682909] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-28T01:40:57.683058] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-28T01:40:57.683743] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-28T01:40:57.683877] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-28T01:40:57.685159] [DEBUG] [LOCAL ] AGRO: Trimmed 49824 records to 34097 (keeping 200 days of data) [2025-09-28T01:40:57.868782] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:40:57.870356] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-28T01:40:57.870486] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:40:57.870901] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-09-28T01:40:57.871554] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:40:57.872783] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-28T01:40:57.873433] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-28T01:40:57.874144] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-28T01:40:57.875912] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-28T01:40:57.876325] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AHL took 2.9s. Estimated remaining: 4h 16m 15s. Rate: 9.0 symbols/min [2025-09-28T01:40:58.089022] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:40:58.095040] [DEBUG] [LOCAL ] AGRO: Primary data saved (34097 records). [2025-09-28T01:40:58.095236] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-28T01:40:58.095376] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGRO took 21.8s. Estimated remaining: 4h 11m 56s. Rate: 9.2 symbols/min [2025-09-28T01:40:58.284004] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:40:58.316798] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-28T01:40:58.330506] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-28T01:40:58.330716] [INFO ] [MAIN ] AHT: Loaded 6181 existing records. [2025-09-28T01:40:58.411690] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-28T01:40:58.455776] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-28T01:40:58.482292] [INFO ] [MAIN ] AHR: Loaded 49946 existing records. [2025-09-28T01:40:58.563885] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:40:58.581194] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-28T01:40:58.613422] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-28T01:40:58.654592] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-28T01:40:58.654757] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-28T01:40:58.855105] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:40:58.858149] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-28T01:40:58.858584] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-28T01:40:58.879788] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-28T01:40:58.912112] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-28T01:40:59.220416] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-28T01:40:59.350388] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:40:59.520520] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:41:00.008881] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-28T01:41:00.250027] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-28T01:41:00.808959] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-28T01:41:00.938013] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-28T01:41:01.242326] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-28T01:41:01.608979] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-28T01:41:02.334368] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-28T01:41:02.408941] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-28T01:41:03.215803] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-28T01:41:03.236559] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-28T01:41:03.968862] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-28T01:41:04.008910] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-28T01:41:04.775459] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-28T01:41:04.808926] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-28T01:41:05.608905] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-28T01:41:05.853129] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-28T01:41:06.344072] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-28T01:41:06.408954] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-28T01:41:06.995413] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-28T01:41:07.208941] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-28T01:41:07.940171] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-28T01:41:08.008874] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-28T01:41:08.334508] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-28T01:41:08.808923] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-28T01:41:09.529848] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-28T01:41:09.608974] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-28T01:41:10.408874] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-28T01:41:10.448940] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-28T01:41:10.647234] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-28T01:41:10.654080] [INFO ] [REMOTE ] AGX: Full fetch complete (48815 records). [2025-09-28T01:41:10.654239] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-28T01:41:11.053574] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-28T01:41:11.053734] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-28T01:41:11.054304] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-28T01:41:11.054389] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-28T01:41:11.055588] [DEBUG] [LOCAL ] AGX: Trimmed 48815 records to 33823 (keeping 200 days of data) [2025-09-28T01:41:11.226793] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-28T01:41:11.279955] [DEBUG] [LOCAL ] AGX: Primary data saved (33823 records). [2025-09-28T01:41:11.280120] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-28T01:41:11.280244] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGX took 32.1s. Estimated remaining: 4h 16m 6s. Rate: 9.0 symbols/min [2025-09-28T01:41:11.457781] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:41:11.514061] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-28T01:41:11.514251] [INFO ] [MAIN ] AI: Loaded 54529 existing records. [2025-09-28T01:41:11.703243] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:41:11.703453] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-28T01:41:11.703533] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-28T01:41:11.703869] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-28T01:41:11.703955] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-28T01:41:12.019609] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-28T01:41:12.137498] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-28T01:41:12.161541] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:41:12.816278] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-28T01:41:12.850329] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-28T01:41:12.859468] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-28T01:41:13.608900] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-28T01:41:14.336590] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-28T01:41:14.409004] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-28T01:41:15.208946] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-28T01:41:15.983146] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-28T01:41:15.994161] [INFO ] [REMOTE ] AHH: Full fetch complete (60230 records). [2025-09-28T01:41:15.994416] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-28T01:41:16.030714] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-28T01:41:16.413553] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-28T01:41:16.413981] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-28T01:41:16.415123] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-28T01:41:16.434970] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-28T01:41:16.452381] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-09-28T01:41:16.465236] [DEBUG] [LOCAL ] AHH: Trimmed 60230 records to 41885 (keeping 200 days of data) [2025-09-28T01:41:16.744398] [DEBUG] [LOCAL ] AHH: Primary data saved (41885 records). [2025-09-28T01:41:16.744588] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-28T01:41:16.744748] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHH took 28.5s. Estimated remaining: 4h 15m 14s. Rate: 9.1 symbols/min [2025-09-28T01:41:16.813847] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-28T01:41:16.906089] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-28T01:41:16.942926] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:41:16.975025] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-28T01:41:17.031177] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-28T01:41:17.031362] [INFO ] [MAIN ] AIG: Loaded 54254 existing records. [2025-09-28T01:41:17.220846] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:41:17.221102] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-28T01:41:17.221182] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-28T01:41:17.221459] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-28T01:41:17.221540] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-28T01:41:17.583052] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:41:17.608891] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-28T01:41:18.408906] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-28T01:41:19.208914] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-28T01:41:19.414291] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-28T01:41:19.457788] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-28T01:41:20.008928] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-28T01:41:20.085815] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-28T01:41:20.122365] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-28T01:41:20.808945] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-28T01:41:21.420032] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-28T01:41:21.608913] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-28T01:41:22.394379] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-28T01:41:22.408862] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-28T01:41:23.208896] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-28T01:41:23.472679] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-28T01:41:23.684631] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-28T01:41:24.014190] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-28T01:41:24.035863] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-28T01:41:24.808918] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-28T01:41:25.608917] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-28T01:41:25.788711] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-28T01:41:26.408973] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-28T01:41:27.152520] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-28T01:41:27.189040] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-28T01:41:27.199497] [INFO ] [REMOTE ] AHR: Full fetch complete (70937 records). [2025-09-28T01:41:27.199713] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-28T01:41:27.214065] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-28T01:41:27.610229] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-28T01:41:27.610361] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-28T01:41:27.611152] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-28T01:41:27.611242] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-28T01:41:27.612903] [DEBUG] [LOCAL ] AHR: Trimmed 70937 records to 49946 (keeping 200 days of data) [2025-09-28T01:41:27.925549] [DEBUG] [LOCAL ] AHR: Primary data saved (49946 records). [2025-09-28T01:41:27.925744] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-28T01:41:27.925873] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHR took 30.0s. Estimated remaining: 4h 17m 57s. Rate: 9.0 symbols/min [2025-09-28T01:41:28.009473] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-28T01:41:28.113029] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:41:28.120035] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-28T01:41:28.120416] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-28T01:41:28.122929] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-28T01:41:28.123428] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-28T01:41:28.123511] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-28T01:41:28.123615] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-28T01:41:28.123732] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-28T01:41:28.534675] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-28T01:41:28.540384] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:41:28.808911] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-28T01:41:29.031180] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:41:29.031534] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-28T01:41:29.031625] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:41:29.031725] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-09-28T01:41:29.031801] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:41:29.031881] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-28T01:41:29.032005] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-28T01:41:29.032081] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-28T01:41:29.032182] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-28T01:41:29.032281] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AII took 1.1s. Estimated remaining: 4h 14m 26s. Rate: 9.1 symbols/min [2025-09-28T01:41:29.209845] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:41:29.234361] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-28T01:41:29.234546] [INFO ] [MAIN ] AIN: Loaded 24906 existing records. [2025-09-28T01:41:29.417898] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:41:29.418145] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-28T01:41:29.418230] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-28T01:41:29.418552] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-28T01:41:29.418629] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-28T01:41:29.620733] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-28T01:41:29.813523] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:41:30.258433] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-28T01:41:30.259423] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-28T01:41:30.408913] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-28T01:41:31.173921] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-28T01:41:31.176086] [INFO ] [REMOTE ] AHT: Full fetch complete (9396 records). [2025-09-28T01:41:31.176189] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-28T01:41:31.214005] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-28T01:41:31.634511] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-28T01:41:31.634687] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-28T01:41:31.634939] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-28T01:41:31.635019] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-28T01:41:31.635547] [DEBUG] [LOCAL ] AHT: Trimmed 9396 records to 6181 (keeping 200 days of data) [2025-09-28T01:41:31.671089] [DEBUG] [LOCAL ] AHT: Primary data saved (6181 records). [2025-09-28T01:41:31.671247] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-28T01:41:31.671384] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AHT took 33.6s. Estimated remaining: 4h 11m 56s. Rate: 9.2 symbols/min [2025-09-28T01:41:31.846695] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:41:31.862484] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-28T01:41:31.862713] [INFO ] [MAIN ] AIO: Loaded 13477 existing records. [2025-09-28T01:41:32.018774] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-28T01:41:32.052937] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:41:32.054091] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-28T01:41:32.054173] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-28T01:41:32.054555] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-28T01:41:32.054636] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-28T01:41:32.439252] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:41:32.453848] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-28T01:41:32.808917] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-28T01:41:33.608900] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-28T01:41:33.904701] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-28T01:41:33.939931] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-28T01:41:34.408919] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-28T01:41:34.621231] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-28T01:41:35.208916] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-28T01:41:36.008896] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-28T01:41:36.183376] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-28T01:41:36.223206] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-28T01:41:36.808905] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-28T01:41:37.608905] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-28T01:41:38.382693] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-28T01:41:38.408937] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-28T01:41:38.440767] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-28T01:41:38.595400] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-28T01:41:39.150848] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-28T01:41:39.208919] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-28T01:41:40.008909] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-28T01:41:40.533916] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-28T01:41:40.808914] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-28T01:41:41.609014] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-28T01:41:41.696119] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-28T01:41:42.395413] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-28T01:41:42.408877] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-28T01:41:42.838755] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-28T01:41:43.208891] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-28T01:41:43.429294] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-28T01:41:44.008938] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-28T01:41:44.117561] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-28T01:41:44.808915] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-28T01:41:45.271549] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-28T01:41:45.608950] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-28T01:41:46.414297] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-28T01:41:46.418298] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-28T01:41:46.759924] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-28T01:41:47.209012] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-28T01:41:48.009002] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-28T01:41:48.441990] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-28T01:41:48.808926] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-28T01:41:48.952079] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-28T01:41:49.138685] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-28T01:41:49.609001] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-28T01:41:50.155832] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-28T01:41:50.244158] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-28T01:41:50.408958] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-28T01:41:51.208880] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-28T01:41:51.239504] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-28T01:41:51.244469] [INFO ] [REMOTE ] AIN: Full fetch complete (33250 records). [2025-09-28T01:41:51.244590] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-28T01:41:51.620959] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-28T01:41:51.621080] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-28T01:41:51.621532] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-28T01:41:51.621614] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-28T01:41:51.622489] [DEBUG] [LOCAL ] AIN: Trimmed 33250 records to 24906 (keeping 200 days of data) [2025-09-28T01:41:51.782117] [DEBUG] [LOCAL ] AIN: Primary data saved (24906 records). [2025-09-28T01:41:51.782286] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-28T01:41:51.782430] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIN took 22.8s. Estimated remaining: 4h 19m 50s. Rate: 8.9 symbols/min [2025-09-28T01:41:51.956088] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:41:51.956320] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-09-28T01:41:51.956396] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-09-28T01:41:51.956512] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-28T01:41:51.956586] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-28T01:41:51.956697] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-09-28T01:41:51.956771] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-28T01:41:52.019582] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-28T01:41:52.315433] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:41:52.808895] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-28T01:41:52.995001] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-28T01:41:53.608952] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-28T01:41:53.805210] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-28T01:41:54.035900] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-28T01:41:54.408938] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-28T01:41:55.208879] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-28T01:41:55.380170] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-28T01:41:55.438562] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-28T01:41:56.011531] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-28T01:41:56.014962] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-28T01:41:56.018108] [INFO ] [REMOTE ] AIO: Full fetch complete (20055 records). [2025-09-28T01:41:56.018217] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-28T01:41:56.390218] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-28T01:41:56.390352] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-28T01:41:56.390770] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-28T01:41:56.390854] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-28T01:41:56.391589] [DEBUG] [LOCAL ] AIO: Trimmed 20055 records to 13477 (keeping 200 days of data) [2025-09-28T01:41:56.479311] [DEBUG] [LOCAL ] AIO: Primary data saved (13477 records). [2025-09-28T01:41:56.479501] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-28T01:41:56.479638] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIO took 24.8s. Estimated remaining: 4h 18m 31s. Rate: 8.9 symbols/min [2025-09-28T01:41:56.652306] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:41:56.684547] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-28T01:41:56.684783] [INFO ] [MAIN ] AIT: Loaded 28208 existing records. [2025-09-28T01:41:56.814007] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-28T01:41:56.872938] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:41:56.873168] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-28T01:41:56.873246] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-28T01:41:56.873710] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-28T01:41:56.873790] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-28T01:41:57.241258] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:41:57.608921] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-28T01:41:57.831169] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-28T01:41:57.841823] [INFO ] [REMOTE ] AIG: Full fetch complete (77379 records). [2025-09-28T01:41:57.842002] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-28T01:41:58.240509] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-28T01:41:58.240634] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-28T01:41:58.241447] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-28T01:41:58.241534] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-28T01:41:58.243226] [DEBUG] [LOCAL ] AIG: Trimmed 77379 records to 54254 (keeping 200 days of data) [2025-09-28T01:41:58.433431] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-28T01:41:58.597920] [DEBUG] [LOCAL ] AIG: Primary data saved (54254 records). [2025-09-28T01:41:58.598136] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-28T01:41:58.598307] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIG took 41.9s. Estimated remaining: 4h 15m 46s. Rate: 9.0 symbols/min [2025-09-28T01:41:58.783321] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:41:58.795521] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-28T01:41:58.837021] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-28T01:41:58.837236] [INFO ] [MAIN ] AIV: Loaded 40950 existing records. [2025-09-28T01:41:59.020121] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:41:59.020335] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-28T01:41:59.020418] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-28T01:41:59.020895] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-28T01:41:59.020977] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-28T01:41:59.218701] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-28T01:41:59.416974] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:41:59.468135] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-28T01:41:59.479712] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-28T01:41:59.480047] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-28T01:41:59.550863] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-28T01:41:59.917236] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-28T01:41:59.917363] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-28T01:41:59.918181] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-28T01:41:59.918268] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-28T01:41:59.919881] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54529 (keeping 200 days of data) [2025-09-28T01:42:00.020140] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-28T01:42:00.270456] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-28T01:42:00.307971] [DEBUG] [LOCAL ] AI: Primary data saved (54529 records). [2025-09-28T01:42:00.308174] [INFO ] [MAIN ] AI: Full history saved. [2025-09-28T01:42:00.310902] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AI took 49.0s. Estimated remaining: 4h 12m 52s. Rate: 9.1 symbols/min [2025-09-28T01:42:00.488244] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:42:00.527917] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-28T01:42:00.528117] [INFO ] [MAIN ] AIZ: Loaded 30543 existing records. [2025-09-28T01:42:00.711715] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:42:00.711976] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-28T01:42:00.712064] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-28T01:42:00.713441] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-28T01:42:00.713526] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-28T01:42:00.817384] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-28T01:42:01.089092] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:42:01.522152] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-28T01:42:01.608940] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-28T01:42:02.408874] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-28T01:42:02.441830] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-28T01:42:02.872522] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-28T01:42:03.208953] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-28T01:42:03.780526] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-28T01:42:04.008947] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-28T01:42:04.597887] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-28T01:42:04.808931] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-28T01:42:05.416329] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-28T01:42:05.608916] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-28T01:42:06.303793] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-28T01:42:06.408960] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-28T01:42:06.924027] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-28T01:42:07.208936] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-28T01:42:07.816092] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-28T01:42:08.008904] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-28T01:42:08.645811] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-28T01:42:08.808895] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-28T01:42:09.136454] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-28T01:42:09.608919] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-28T01:42:09.860764] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-28T01:42:10.409149] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-28T01:42:11.027381] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-28T01:42:11.208934] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-28T01:42:11.808945] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-28T01:42:12.008940] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-28T01:42:12.636864] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-28T01:42:12.808879] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-28T01:42:12.857776] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-28T01:42:13.608899] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-28T01:42:13.999733] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-28T01:42:14.408925] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-28T01:42:15.000982] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-28T01:42:15.208917] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-28T01:42:15.507924] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-28T01:42:15.512293] [INFO ] [REMOTE ] AIT: Full fetch complete (39468 records). [2025-09-28T01:42:15.512526] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-28T01:42:15.922043] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-28T01:42:15.922176] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-28T01:42:15.922820] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-28T01:42:15.922970] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-28T01:42:15.924203] [DEBUG] [LOCAL ] AIT: Trimmed 39468 records to 28208 (keeping 200 days of data) [2025-09-28T01:42:16.026686] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-28T01:42:16.133902] [DEBUG] [LOCAL ] AIT: Primary data saved (28208 records). [2025-09-28T01:42:16.134120] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-28T01:42:16.134367] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIT took 19.7s. Estimated remaining: 4h 17m 53s. Rate: 8.9 symbols/min [2025-09-28T01:42:16.315611] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:42:16.323384] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-28T01:42:16.323532] [INFO ] [MAIN ] AIZN: Loaded 3935 existing records. [2025-09-28T01:42:16.526022] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:42:16.526460] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-28T01:42:16.526542] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-28T01:42:16.526818] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-28T01:42:16.526905] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-28T01:42:16.814581] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-28T01:42:16.922838] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:42:16.932598] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-28T01:42:17.438119] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-28T01:42:17.608935] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-28T01:42:17.893612] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-28T01:42:18.408931] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-28T01:42:18.737194] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-28T01:42:18.745191] [INFO ] [REMOTE ] AIR: Full fetch complete (38294 records). [2025-09-28T01:42:18.745419] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-28T01:42:18.870369] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-28T01:42:19.183513] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-28T01:42:19.183660] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-28T01:42:19.184210] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-28T01:42:19.184312] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-28T01:42:19.185389] [DEBUG] [LOCAL ] AIR: Trimmed 38294 records to 28152 (keeping 200 days of data) [2025-09-28T01:42:19.244030] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-28T01:42:19.378707] [DEBUG] [LOCAL ] AIR: Primary data saved (28152 records). [2025-09-28T01:42:19.378959] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-28T01:42:19.379118] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIR took 27.6s. Estimated remaining: 4h 15m 52s. Rate: 9.0 symbols/min [2025-09-28T01:42:19.562578] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:42:19.624285] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-28T01:42:19.624483] [INFO ] [MAIN ] AJG: Loaded 47710 existing records. [2025-09-28T01:42:19.810818] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:42:19.811050] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-28T01:42:19.811130] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-28T01:42:19.811627] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-28T01:42:19.811749] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-28T01:42:19.928468] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-28T01:42:20.016385] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-28T01:42:20.193923] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:42:20.808917] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-28T01:42:21.268371] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-28T01:42:21.552943] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-28T01:42:21.608904] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-28T01:42:22.408914] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-28T01:42:23.103425] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-28T01:42:23.208977] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-28T01:42:24.008967] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-28T01:42:24.132384] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-28T01:42:24.664950] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-28T01:42:24.808878] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-28T01:42:24.999780] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-28T01:42:25.608905] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-28T01:42:26.186162] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-28T01:42:26.213507] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-28T01:42:26.408892] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-28T01:42:27.208916] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-28T01:42:27.803361] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-28T01:42:28.008892] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-28T01:42:28.197352] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-28T01:42:28.808902] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-28T01:42:29.371768] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-28T01:42:29.608889] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-28T01:42:29.815502] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-28T01:42:29.971286] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-28T01:42:30.408903] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-28T01:42:31.208905] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-28T01:42:32.017591] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-28T01:42:32.020762] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-28T01:42:32.604912] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-28T01:42:32.808906] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-28T01:42:33.433544] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-28T01:42:33.608903] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-28T01:42:33.749766] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-28T01:42:34.408873] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-28T01:42:34.503435] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-28T01:42:34.509508] [INFO ] [REMOTE ] AIZ: Full fetch complete (43010 records). [2025-09-28T01:42:34.509680] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-28T01:42:34.925612] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-28T01:42:34.925850] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-28T01:42:34.926606] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-28T01:42:34.926732] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-28T01:42:34.928141] [DEBUG] [LOCAL ] AIZ: Trimmed 43010 records to 30543 (keeping 200 days of data) [2025-09-28T01:42:35.037797] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-28T01:42:35.145606] [DEBUG] [LOCAL ] AIZ: Primary data saved (30543 records). [2025-09-28T01:42:35.145813] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-28T01:42:35.145967] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIZ took 34.8s. Estimated remaining: 4h 20m 40s. Rate: 8.8 symbols/min [2025-09-28T01:42:35.213990] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-28T01:42:35.327510] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:42:35.327793] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-28T01:42:35.327872] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-28T01:42:35.328004] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-28T01:42:35.328078] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-28T01:42:35.328162] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-28T01:42:35.328235] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-28T01:42:35.718256] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:42:36.008905] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-28T01:42:36.668683] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-28T01:42:36.670031] [INFO ] [REMOTE ] AIZN: Full fetch complete (5742 records). [2025-09-28T01:42:36.670130] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-28T01:42:36.833210] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-28T01:42:37.131861] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-28T01:42:37.132115] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-28T01:42:37.132341] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-28T01:42:37.132440] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-28T01:42:37.133322] [DEBUG] [LOCAL ] AIZN: Trimmed 5742 records to 3935 (keeping 200 days of data) [2025-09-28T01:42:37.159773] [DEBUG] [LOCAL ] AIZN: Primary data saved (3935 records). [2025-09-28T01:42:37.160104] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-28T01:42:37.160324] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZN took 21.0s. Estimated remaining: 4h 18m 1s. Rate: 8.9 symbols/min [2025-09-28T01:42:37.280576] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-28T01:42:37.394615] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:42:37.442989] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-28T01:42:37.443177] [INFO ] [MAIN ] AKR: Loaded 46481 existing records. [2025-09-28T01:42:37.612713] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-28T01:42:37.628848] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:42:37.629985] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-28T01:42:37.630069] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-28T01:42:37.630344] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-28T01:42:37.630423] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-28T01:42:38.007381] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:42:38.066898] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-28T01:42:38.408905] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-28T01:42:38.855292] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-28T01:42:39.208905] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-28T01:42:39.488483] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-28T01:42:39.704005] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-28T01:42:40.008906] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-28T01:42:40.491122] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-28T01:42:40.808964] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-28T01:42:41.608924] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-28T01:42:42.066791] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-28T01:42:42.408879] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-28T01:42:42.458100] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-28T01:42:43.208957] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-28T01:42:44.008883] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-28T01:42:44.094023] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-28T01:42:44.776624] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-28T01:42:44.786777] [INFO ] [REMOTE ] AIV: Full fetch complete (59432 records). [2025-09-28T01:42:44.786983] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-28T01:42:44.819225] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-28T01:42:45.190115] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-28T01:42:45.190262] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-28T01:42:45.191002] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-28T01:42:45.191110] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-28T01:42:45.193920] [DEBUG] [LOCAL ] AIV: Trimmed 59432 records to 40950 (keeping 200 days of data) [2025-09-28T01:42:45.456079] [DEBUG] [LOCAL ] AIV: Primary data saved (40950 records). [2025-09-28T01:42:45.456277] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-28T01:42:45.456418] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIV took 46.9s. Estimated remaining: 4h 18m 43s. Rate: 8.9 symbols/min [2025-09-28T01:42:45.612786] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-28T01:42:45.649791] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:42:45.680164] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-28T01:42:45.729859] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-28T01:42:45.730043] [INFO ] [MAIN ] AL: Loaded 44831 existing records. [2025-09-28T01:42:45.919870] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:42:45.920148] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-28T01:42:45.920233] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-28T01:42:45.920597] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-28T01:42:45.920705] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-28T01:42:46.162862] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-28T01:42:46.325997] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:42:46.408872] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-28T01:42:46.673231] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-28T01:42:47.208874] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-28T01:42:47.975316] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-28T01:42:48.008862] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-28T01:42:48.569016] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-28T01:42:48.701969] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-28T01:42:48.808956] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-28T01:42:49.608927] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-28T01:42:50.281919] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-28T01:42:50.408938] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-28T01:42:51.208882] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-28T01:42:51.394309] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-28T01:42:51.647819] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-28T01:42:51.737120] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-28T01:42:52.008954] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-28T01:42:52.808928] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-28T01:42:53.067086] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-28T01:42:53.608880] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-28T01:42:53.700528] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-28T01:42:54.408917] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-28T01:42:55.217614] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-28T01:42:55.236717] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-28T01:42:55.940775] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-28T01:42:56.008869] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-28T01:42:56.808876] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-28T01:42:56.869367] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-28T01:42:56.882635] [INFO ] [REMOTE ] AJG: Full fetch complete (69776 records). [2025-09-28T01:42:56.882991] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-28T01:42:57.199026] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-28T01:42:57.302253] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-28T01:42:57.302400] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-28T01:42:57.303332] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-28T01:42:57.303520] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-28T01:42:57.305606] [DEBUG] [LOCAL ] AJG: Trimmed 69776 records to 47710 (keeping 200 days of data) [2025-09-28T01:42:57.432770] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-28T01:42:57.609111] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-28T01:42:57.669466] [DEBUG] [LOCAL ] AJG: Primary data saved (47710 records). [2025-09-28T01:42:57.669728] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-28T01:42:57.669911] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AJG took 38.3s. Estimated remaining: 4h 21m 26s. Rate: 8.8 symbols/min [2025-09-28T01:42:57.853287] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:42:57.910454] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-28T01:42:57.910668] [INFO ] [MAIN ] ALB: Loaded 54000 existing records. [2025-09-28T01:42:58.014584] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-28T01:42:58.018456] [INFO ] [REMOTE ] AKA: Full fetch complete (2428 records). [2025-09-28T01:42:58.034354] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-28T01:42:58.205549] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:42:58.221400] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-28T01:42:58.221507] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-28T01:42:58.256891] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-28T01:42:58.289446] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T01:42:58.289670] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-28T01:42:58.289782] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T01:42:58.354661] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T01:42:58.382677] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-28T01:42:58.393114] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-28T01:42:58.393483] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-28T01:42:58.409181] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-28T01:42:58.434768] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-28T01:42:58.455757] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AKA took 23.3s. Estimated remaining: 4h 18m 14s. Rate: 8.9 symbols/min [2025-09-28T01:42:58.836625] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:42:58.857688] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:42:58.915486] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-28T01:42:58.915703] [INFO ] [MAIN ] ALC: Loaded 51537 existing records. [2025-09-28T01:42:59.096743] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:42:59.097030] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-28T01:42:59.097120] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-28T01:42:59.097513] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-28T01:42:59.097596] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-28T01:42:59.214004] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-28T01:42:59.470282] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:43:00.008946] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-28T01:43:00.063599] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-28T01:43:00.808928] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-28T01:43:01.605105] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-28T01:43:01.616229] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-28T01:43:01.643795] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-28T01:43:02.192138] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-28T01:43:02.408916] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-28T01:43:02.867573] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-28T01:43:03.208908] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-28T01:43:04.008884] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-28T01:43:04.448616] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-28T01:43:04.808909] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-28T01:43:04.869920] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-28T01:43:05.360927] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-28T01:43:05.608932] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-28T01:43:06.414742] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-28T01:43:06.427327] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-28T01:43:07.208922] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-28T01:43:07.342799] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-28T01:43:08.008944] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-28T01:43:08.389437] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-28T01:43:08.459806] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-28T01:43:08.808924] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-28T01:43:09.608935] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-28T01:43:09.755500] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-28T01:43:10.283683] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-28T01:43:10.408883] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-28T01:43:11.214034] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-28T01:43:11.233970] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-28T01:43:11.921183] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-28T01:43:12.008959] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-28T01:43:12.808901] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-28T01:43:13.032323] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-28T01:43:13.608871] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-28T01:43:13.708575] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-28T01:43:13.719344] [INFO ] [REMOTE ] AL: Full fetch complete (62378 records). [2025-09-28T01:43:13.719578] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-28T01:43:14.142556] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-28T01:43:14.142718] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-28T01:43:14.143512] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-28T01:43:14.143598] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-28T01:43:14.146085] [DEBUG] [LOCAL ] AL: Trimmed 62378 records to 44831 (keeping 200 days of data) [2025-09-28T01:43:14.411151] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-28T01:43:14.453720] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-28T01:43:14.467724] [DEBUG] [LOCAL ] AL: Primary data saved (44831 records). [2025-09-28T01:43:14.468354] [INFO ] [MAIN ] AL: Full history saved. [2025-09-28T01:43:14.468497] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 29.0s. Estimated remaining: 4h 22m 47s. Rate: 8.7 symbols/min [2025-09-28T01:43:14.642161] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:43:14.672487] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-28T01:43:14.672714] [INFO ] [MAIN ] ALE: Loaded 30788 existing records. [2025-09-28T01:43:14.860356] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:43:14.860727] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-28T01:43:14.860811] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-28T01:43:14.861148] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-28T01:43:14.861225] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-28T01:43:15.215523] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-28T01:43:15.221275] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:43:15.881057] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-28T01:43:16.008967] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-28T01:43:16.288977] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-28T01:43:16.791856] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-28T01:43:16.801216] [INFO ] [REMOTE ] AKR: Full fetch complete (65494 records). [2025-09-28T01:43:16.801387] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-28T01:43:16.814068] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-28T01:43:17.166787] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-28T01:43:17.293251] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-28T01:43:17.293408] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-28T01:43:17.294203] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-28T01:43:17.294296] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-28T01:43:17.295951] [DEBUG] [LOCAL ] AKR: Trimmed 65494 records to 46481 (keeping 200 days of data) [2025-09-28T01:43:17.589975] [DEBUG] [LOCAL ] AKR: Primary data saved (46481 records). [2025-09-28T01:43:17.590158] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-28T01:43:17.590356] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AKR took 40.4s. Estimated remaining: 4h 20m 48s. Rate: 8.8 symbols/min [2025-09-28T01:43:17.608903] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-28T01:43:18.408898] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-28T01:43:18.801396] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-28T01:43:19.208988] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-28T01:43:19.297615] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-28T01:43:19.434989] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-28T01:43:20.008925] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-28T01:43:20.808936] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-28T01:43:21.110968] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-28T01:43:21.177509] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-28T01:43:21.608921] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-28T01:43:22.408983] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-28T01:43:22.583707] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-28T01:43:23.208927] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-28T01:43:23.636386] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-28T01:43:23.831170] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-28T01:43:24.008926] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-28T01:43:24.808935] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-28T01:43:24.949822] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-28T01:43:25.608902] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-28T01:43:26.194421] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-28T01:43:26.252899] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-28T01:43:26.408910] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-28T01:43:27.208883] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-28T01:43:27.485118] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-28T01:43:27.579421] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-28T01:43:28.008915] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-28T01:43:28.808906] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-28T01:43:29.420064] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-28T01:43:29.430638] [INFO ] [REMOTE ] ALB: Full fetch complete (76789 records). [2025-09-28T01:43:29.430882] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-28T01:43:29.861823] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-28T01:43:29.862493] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-28T01:43:29.863678] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-28T01:43:29.863939] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-28T01:43:29.900205] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-28T01:43:29.910742] [DEBUG] [LOCAL ] ALB: Trimmed 76789 records to 54000 (keeping 200 days of data) [2025-09-28T01:43:29.912534] [INFO ] [REMOTE ] ALC: Full fetch complete (72764 records). [2025-09-28T01:43:29.913292] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-28T01:43:30.160751] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-28T01:43:30.192448] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-28T01:43:30.496380] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-28T01:43:30.497919] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-28T01:43:30.499591] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-28T01:43:30.500313] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-28T01:43:30.506301] [DEBUG] [LOCAL ] ALC: Trimmed 72764 records to 51537 (keeping 200 days of data) [2025-09-28T01:43:30.982031] [DEBUG] [LOCAL ] ALB: Primary data saved (54000 records). [2025-09-28T01:43:30.983415] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-28T01:43:30.984157] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALB took 33.3s. Estimated remaining: 4h 23m 55s. Rate: 8.7 symbols/min [2025-09-28T01:43:31.065377] [DEBUG] [LOCAL ] ALC: Primary data saved (51537 records). [2025-09-28T01:43:31.065664] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-28T01:43:31.065796] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALC took 32.6s. Estimated remaining: 4h 20m 30s. Rate: 8.8 symbols/min [2025-09-28T01:43:31.827171] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-28T01:43:31.835508] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-28T01:43:33.299621] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-28T01:43:33.307898] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-28T01:43:34.732057] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-28T01:43:34.739830] [INFO ] [REMOTE ] ALE: Full fetch complete (42465 records). [2025-09-28T01:43:34.740027] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-28T01:43:35.137354] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-28T01:43:35.137545] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-28T01:43:35.138121] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-28T01:43:35.138228] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-28T01:43:35.139523] [DEBUG] [LOCAL ] ALE: Trimmed 42465 records to 30788 (keeping 200 days of data) [2025-09-28T01:43:35.326974] [DEBUG] [LOCAL ] ALE: Primary data saved (30788 records). [2025-09-28T01:43:35.327178] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-28T01:43:35.327322] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALE took 20.9s. Estimated remaining: 4h 19m 10s. Rate: 8.8 symbols/min [2025-09-28T01:43:35.942531] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:43:36.022511] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:43:36.103376] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:43:36.105157] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:43:36.123081] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-28T01:43:36.123329] [INFO ] [MAIN ] ALG: Loaded 10562 existing records. [2025-09-28T01:43:36.224999] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-28T01:43:36.251770] [INFO ] [MAIN ] ALEX: Loaded 31769 existing records. [2025-09-28T01:43:36.441630] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-28T01:43:36.461021] [INFO ] [MAIN ] ALK: Loaded 53840 existing records. [2025-09-28T01:43:36.540705] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:43:36.633062] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-28T01:43:36.701733] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-28T01:43:36.713043] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:43:36.715176] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-28T01:43:36.715052] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-28T01:43:36.713737] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-28T01:43:36.726713] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-28T01:43:36.726952] [INFO ] [MAIN ] ALIT: Loaded 53534 existing records. [2025-09-28T01:43:36.726498] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-28T01:43:36.788474] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-28T01:43:36.819398] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-28T01:43:36.876033] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:43:36.907610] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-28T01:43:37.076208] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-28T01:43:37.148156] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-28T01:43:37.163994] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-28T01:43:37.338683] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:43:37.516970] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-28T01:43:37.584476] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-28T01:43:37.692320] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-28T01:43:37.697746] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-28T01:43:38.103843] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:43:38.142744] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-28T01:43:38.184175] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:43:38.213667] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-28T01:43:38.426972] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:43:38.477622] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-28T01:43:38.581180] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:43:38.581546] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-28T01:43:39.114426] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-28T01:43:39.117621] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-28T01:43:39.282797] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-28T01:43:39.289985] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-28T01:43:40.004495] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-28T01:43:40.007840] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-28T01:43:40.153975] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-28T01:43:40.160736] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-28T01:43:40.266717] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-28T01:43:40.277971] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-28T01:43:40.401504] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-28T01:43:40.412464] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-28T01:43:40.837453] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-28T01:43:40.840490] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-28T01:43:40.893378] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-28T01:43:40.898879] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-28T01:43:41.896981] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-28T01:43:41.901194] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-28T01:43:41.941370] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-28T01:43:41.992535] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-28T01:43:42.030790] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-28T01:43:42.408915] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-28T01:43:42.788291] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-28T01:43:43.208930] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-28T01:43:44.008883] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-28T01:43:44.250487] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-28T01:43:44.584404] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-28T01:43:44.808900] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-28T01:43:44.851431] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-28T01:43:45.608907] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-28T01:43:46.408901] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-28T01:43:46.685260] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-28T01:43:46.960332] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-28T01:43:47.208927] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-28T01:43:47.852706] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-28T01:43:48.008894] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-28T01:43:48.237826] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-28T01:43:48.808918] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-28T01:43:49.608898] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-28T01:43:49.850221] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-28T01:43:50.101368] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-28T01:43:50.408960] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-28T01:43:51.094222] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-28T01:43:51.208898] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-28T01:43:52.008890] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-28T01:43:52.417059] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-28T01:43:52.808871] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-28T01:43:52.818214] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-28T01:43:53.112033] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-28T01:43:53.608933] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-28T01:43:54.182339] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-28T01:43:54.408515] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-28T01:43:54.410877] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-28T01:43:55.208921] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-28T01:43:56.008943] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-28T01:43:56.024838] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-28T01:43:56.027299] [INFO ] [REMOTE ] ALG: Full fetch complete (15901 records). [2025-09-28T01:43:56.027418] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-28T01:43:56.489743] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-28T01:43:56.490505] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-28T01:43:56.491766] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-28T01:43:56.492358] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-28T01:43:56.503458] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-28T01:43:56.504938] [DEBUG] [LOCAL ] ALG: Trimmed 15901 records to 10562 (keeping 200 days of data) [2025-09-28T01:43:56.576067] [DEBUG] [LOCAL ] ALG: Primary data saved (10562 records). [2025-09-28T01:43:56.576264] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-28T01:43:56.576394] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALG took 21.2s. Estimated remaining: 4h 25m 52s. Rate: 8.6 symbols/min [2025-09-28T01:43:56.748791] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:43:56.816297] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-28T01:43:56.820108] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-28T01:43:56.820312] [INFO ] [MAIN ] ALL: Loaded 50903 existing records. [2025-09-28T01:43:57.013083] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:43:57.020690] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-28T01:43:57.031547] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-28T01:43:57.032497] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-28T01:43:57.032599] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-28T01:43:57.066379] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-28T01:43:57.404147] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:43:57.608945] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-28T01:43:58.408876] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-28T01:43:58.639006] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-28T01:43:59.208887] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-28T01:43:59.421733] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-28T01:43:59.453543] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-28T01:43:59.460173] [INFO ] [REMOTE ] ALEX: Full fetch complete (44646 records). [2025-09-28T01:43:59.460308] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-28T01:43:59.855293] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-28T01:43:59.855425] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-28T01:43:59.856053] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-28T01:43:59.856142] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-28T01:43:59.857279] [DEBUG] [LOCAL ] ALEX: Trimmed 44646 records to 31769 (keeping 200 days of data) [2025-09-28T01:44:00.011799] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-28T01:44:00.061357] [DEBUG] [LOCAL ] ALEX: Primary data saved (31769 records). [2025-09-28T01:44:00.061638] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-28T01:44:00.061828] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 24.7s. Estimated remaining: 4h 24m 8s. Rate: 8.7 symbols/min [2025-09-28T01:44:00.253123] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:44:00.311570] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-28T01:44:00.311894] [INFO ] [MAIN ] ALLE: Loaded 45637 existing records. [2025-09-28T01:44:00.521523] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:44:00.521906] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-28T01:44:00.521997] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-28T01:44:00.522465] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-28T01:44:00.522554] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-28T01:44:00.811391] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-28T01:44:00.927682] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:44:01.127593] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-28T01:44:01.338988] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-28T01:44:01.608947] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-28T01:44:02.408910] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-28T01:44:02.772371] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-28T01:44:02.854113] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-28T01:44:03.208946] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-28T01:44:04.008935] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-28T01:44:04.232816] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-28T01:44:04.631495] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-28T01:44:04.808938] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-28T01:44:05.608881] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-28T01:44:05.795072] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-28T01:44:06.414012] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-28T01:44:06.431920] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-28T01:44:07.002792] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-28T01:44:07.013295] [INFO ] [REMOTE ] ALK: Full fetch complete (76838 records). [2025-09-28T01:44:07.013483] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-28T01:44:07.209374] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-28T01:44:07.444088] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-28T01:44:07.444225] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-28T01:44:07.445129] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-28T01:44:07.445221] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-28T01:44:07.448114] [DEBUG] [LOCAL ] ALK: Trimmed 76838 records to 53840 (keeping 200 days of data) [2025-09-28T01:44:07.777365] [DEBUG] [LOCAL ] ALK: Primary data saved (53840 records). [2025-09-28T01:44:07.777549] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-28T01:44:07.777698] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALK took 32.4s. Estimated remaining: 4h 24m 23s. Rate: 8.7 symbols/min [2025-09-28T01:44:07.950039] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:44:08.004521] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-28T01:44:08.004729] [INFO ] [MAIN ] ALLY: Loaded 53997 existing records. [2025-09-28T01:44:08.036765] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-28T01:44:08.200734] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:44:08.201537] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-28T01:44:08.201685] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-28T01:44:08.202382] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-28T01:44:08.202468] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-28T01:44:08.671451] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-28T01:44:08.675822] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:44:08.732526] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-28T01:44:08.808995] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-28T01:44:09.608942] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-28T01:44:09.970564] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-28T01:44:10.408926] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-28T01:44:10.698909] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-28T01:44:11.143102] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-28T01:44:11.208893] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-28T01:44:12.009108] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-28T01:44:12.142950] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-28T01:44:12.808866] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-28T01:44:13.057467] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-28T01:44:13.608890] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-28T01:44:13.879937] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-28T01:44:14.156247] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-28T01:44:14.408928] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-28T01:44:15.208954] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-28T01:44:15.353912] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-28T01:44:16.008929] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-28T01:44:16.278396] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-28T01:44:16.470521] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-28T01:44:16.808915] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-28T01:44:17.608882] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-28T01:44:17.717668] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-28T01:44:17.729029] [INFO ] [REMOTE ] ALIT: Full fetch complete (76414 records). [2025-09-28T01:44:17.729218] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-28T01:44:18.200537] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-28T01:44:18.200727] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-28T01:44:18.201611] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-28T01:44:18.201782] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-28T01:44:18.209585] [DEBUG] [LOCAL ] ALIT: Trimmed 76414 records to 53534 (keeping 200 days of data) [2025-09-28T01:44:18.363358] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-28T01:44:18.439842] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-28T01:44:18.595897] [DEBUG] [LOCAL ] ALIT: Primary data saved (53534 records). [2025-09-28T01:44:18.596116] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-28T01:44:18.598947] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALIT took 43.3s. Estimated remaining: 4h 26m 2s. Rate: 8.6 symbols/min [2025-09-28T01:44:18.782994] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:44:18.840267] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-28T01:44:18.840555] [INFO ] [MAIN ] ALSN: Loaded 43953 existing records. [2025-09-28T01:44:19.067915] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:44:19.068338] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-28T01:44:19.068526] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-28T01:44:19.068888] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-28T01:44:19.068976] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-28T01:44:19.210184] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-28T01:44:19.479548] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-28T01:44:19.523271] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:44:20.008874] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-28T01:44:20.089043] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-28T01:44:20.808895] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-28T01:44:21.228258] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-28T01:44:21.591468] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-28T01:44:21.608850] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-28T01:44:22.408889] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-28T01:44:22.604843] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-28T01:44:23.208894] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-28T01:44:23.361423] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-28T01:44:24.008904] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-28T01:44:24.046292] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-28T01:44:24.633233] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-28T01:44:24.643417] [INFO ] [REMOTE ] ALL: Full fetch complete (72523 records). [2025-09-28T01:44:24.643673] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-28T01:44:24.815175] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-28T01:44:25.064071] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-28T01:44:25.064240] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-28T01:44:25.065099] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-28T01:44:25.065208] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-28T01:44:25.067909] [DEBUG] [LOCAL ] ALL: Trimmed 72523 records to 50903 (keeping 200 days of data) [2025-09-28T01:44:25.405893] [DEBUG] [LOCAL ] ALL: Primary data saved (50903 records). [2025-09-28T01:44:25.406078] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-28T01:44:25.406219] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALL took 28.8s. Estimated remaining: 4h 25m 50s. Rate: 8.6 symbols/min [2025-09-28T01:44:25.585676] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:44:25.614002] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-28T01:44:25.614998] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-28T01:44:25.616108] [INFO ] [MAIN ] ALTG: Loaded 24161 existing records. [2025-09-28T01:44:25.805695] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:44:25.806066] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-28T01:44:25.806289] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-28T01:44:25.806803] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-28T01:44:25.806883] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-28T01:44:26.070350] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-28T01:44:26.244386] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:44:26.408891] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-28T01:44:26.530529] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-28T01:44:26.540270] [INFO ] [REMOTE ] ALLE: Full fetch complete (64880 records). [2025-09-28T01:44:26.540427] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-28T01:44:26.940534] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-28T01:44:26.940715] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-28T01:44:26.941730] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-28T01:44:26.941822] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-28T01:44:26.943710] [DEBUG] [LOCAL ] ALLE: Trimmed 64880 records to 45637 (keeping 200 days of data) [2025-09-28T01:44:27.209109] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-28T01:44:27.259149] [DEBUG] [LOCAL ] ALLE: Primary data saved (45637 records). [2025-09-28T01:44:27.259336] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-28T01:44:27.259502] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALLE took 27.2s. Estimated remaining: 4h 23m 27s. Rate: 8.7 symbols/min [2025-09-28T01:44:27.442422] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:44:27.466703] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-28T01:44:27.484036] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-28T01:44:27.484237] [INFO ] [MAIN ] ALUR: Loaded 10950 existing records. [2025-09-28T01:44:27.697489] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:44:27.697851] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-28T01:44:27.697932] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-28T01:44:27.698188] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-28T01:44:27.698265] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-28T01:44:28.012353] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-28T01:44:28.088130] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:44:28.120632] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-28T01:44:28.294906] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-28T01:44:28.808904] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-28T01:44:29.458856] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-28T01:44:29.608904] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-28T01:44:30.408896] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-28T01:44:30.649554] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-28T01:44:31.216488] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-28T01:44:31.241838] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-28T01:44:31.277777] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-28T01:44:32.008898] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-28T01:44:32.808870] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-28T01:44:33.048160] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-28T01:44:33.291065] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-28T01:44:33.608903] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-28T01:44:34.172063] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-28T01:44:34.408901] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-28T01:44:34.975474] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-28T01:44:35.208912] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-28T01:44:36.008870] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-28T01:44:36.192411] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-28T01:44:36.203634] [INFO ] [REMOTE ] ALLY: Full fetch complete (76895 records). [2025-09-28T01:44:36.203879] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-28T01:44:36.607815] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-28T01:44:36.653924] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-28T01:44:36.654097] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-28T01:44:36.655287] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-28T01:44:36.655436] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-28T01:44:36.659209] [DEBUG] [LOCAL ] ALLY: Trimmed 76895 records to 53997 (keeping 200 days of data) [2025-09-28T01:44:36.855961] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-28T01:44:37.026682] [DEBUG] [LOCAL ] ALLY: Primary data saved (53997 records). [2025-09-28T01:44:37.026969] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-28T01:44:37.027172] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 29.2s. Estimated remaining: 4h 24m 35s. Rate: 8.6 symbols/min [2025-09-28T01:44:37.233988] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:44:37.279267] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-28T01:44:37.279446] [INFO ] [MAIN ] ALV: Loaded 43217 existing records. [2025-09-28T01:44:37.471491] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:44:37.471819] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-28T01:44:37.471899] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-28T01:44:37.472157] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-28T01:44:37.472233] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-28T01:44:37.610952] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-28T01:44:37.810491] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-28T01:44:37.917829] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:44:37.919469] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-28T01:44:38.408903] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-28T01:44:38.441029] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-28T01:44:39.208862] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-28T01:44:39.295140] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-28T01:44:40.008909] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-28T01:44:40.267246] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-28T01:44:40.809024] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-28T01:44:41.593157] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-28T01:44:41.608854] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-28T01:44:42.352124] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-28T01:44:42.408932] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-28T01:44:43.208866] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-28T01:44:43.241271] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-28T01:44:43.949401] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-28T01:44:44.008864] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-28T01:44:44.313494] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-28T01:44:44.808907] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-28T01:44:45.504971] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-28T01:44:45.617034] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-28T01:44:45.621221] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-28T01:44:46.408925] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-28T01:44:47.199303] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-28T01:44:47.201779] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-28T01:44:47.213621] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-28T01:44:48.008906] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-28T01:44:48.136803] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-28T01:44:48.808899] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-28T01:44:49.089474] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-28T01:44:49.608929] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-28T01:44:50.383176] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-28T01:44:50.410451] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-28T01:44:50.413298] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-28T01:44:50.422925] [INFO ] [REMOTE ] ALSN: Full fetch complete (62130 records). [2025-09-28T01:44:50.423120] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-28T01:44:50.836776] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-28T01:44:50.836963] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-28T01:44:50.837808] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-28T01:44:50.837896] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-28T01:44:50.839281] [DEBUG] [LOCAL ] ALSN: Trimmed 62130 records to 43953 (keeping 200 days of data) [2025-09-28T01:44:51.116380] [DEBUG] [LOCAL ] ALSN: Primary data saved (43953 records). [2025-09-28T01:44:51.116552] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-28T01:44:51.117321] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALSN took 32.5s. Estimated remaining: 4h 27m 33s. Rate: 8.5 symbols/min [2025-09-28T01:44:51.214038] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-28T01:44:51.298491] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:44:51.309328] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-28T01:44:51.309498] [INFO ] [MAIN ] ALX: Loaded 6121 existing records. [2025-09-28T01:44:51.492584] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:44:51.493025] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-28T01:44:51.493146] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-28T01:44:51.498719] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-28T01:44:51.507603] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-28T01:44:51.580050] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-28T01:44:51.784847] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-28T01:44:51.825984] [INFO ] [REMOTE ] ALUR: Full fetch complete (20607 records). [2025-09-28T01:44:51.834940] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-28T01:44:51.999232] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:44:52.010691] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-28T01:44:52.296397] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-28T01:44:52.296526] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-28T01:44:52.296921] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-28T01:44:52.300378] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-28T01:44:52.301616] [DEBUG] [LOCAL ] ALUR: Trimmed 20607 records to 10950 (keeping 200 days of data) [2025-09-28T01:44:52.366099] [DEBUG] [LOCAL ] ALUR: Primary data saved (10950 records). [2025-09-28T01:44:52.366279] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-28T01:44:52.366447] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALUR took 25.1s. Estimated remaining: 4h 24m 58s. Rate: 8.6 symbols/min [2025-09-28T01:44:52.540798] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:44:52.600717] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-28T01:44:52.600902] [INFO ] [MAIN ] AM: Loaded 52887 existing records. [2025-09-28T01:44:52.785798] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:44:52.786064] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-28T01:44:52.786147] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-28T01:44:52.787714] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-28T01:44:52.787798] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-28T01:44:52.819446] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-28T01:44:53.166215] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:44:53.472558] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-28T01:44:53.608940] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-28T01:44:54.408932] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-28T01:44:55.208976] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-28T01:44:55.364961] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-28T01:44:55.560183] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (3.55 seconds). [2025-09-28T01:44:55.825327] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-28T01:44:56.008877] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-28T01:44:56.119711] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-28T01:44:56.365398] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-28T01:44:56.808944] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-28T01:44:57.608907] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-28T01:44:57.825542] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-28T01:44:58.408950] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-28T01:44:58.738724] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-28T01:44:59.091155] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-28T01:44:59.208900] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-28T01:44:59.723814] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-28T01:45:00.008950] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-28T01:45:00.808939] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-28T01:45:01.513562] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-28T01:45:01.609013] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-28T01:45:01.869907] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-28T01:45:02.408904] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-28T01:45:02.735273] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-28T01:45:02.743190] [INFO ] [REMOTE ] ALTG: Full fetch complete (33723 records). [2025-09-28T01:45:02.743448] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-28T01:45:03.139659] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-28T01:45:03.139793] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-28T01:45:03.140410] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-28T01:45:03.140509] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-28T01:45:03.141469] [DEBUG] [LOCAL ] ALTG: Trimmed 33723 records to 24161 (keeping 200 days of data) [2025-09-28T01:45:03.229533] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-28T01:45:03.293204] [DEBUG] [LOCAL ] ALTG: Primary data saved (24161 records). [2025-09-28T01:45:03.293386] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-28T01:45:03.293543] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALTG took 37.9s. Estimated remaining: 4h 26m 31s. Rate: 8.6 symbols/min [2025-09-28T01:45:03.471382] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:45:03.509975] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-28T01:45:03.510162] [INFO ] [MAIN ] AMBC: Loaded 37453 existing records. [2025-09-28T01:45:03.690397] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:45:03.690660] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-28T01:45:03.690743] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-28T01:45:03.691440] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-28T01:45:03.691520] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-28T01:45:04.014077] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-28T01:45:04.077933] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:45:04.214442] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-28T01:45:04.808898] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-28T01:45:04.907919] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-28T01:45:04.929156] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-28T01:45:05.608931] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-28T01:45:06.408878] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-28T01:45:06.788537] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-28T01:45:07.208891] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-28T01:45:07.302378] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-28T01:45:07.367823] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-28T01:45:08.008911] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-28T01:45:08.776198] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-28T01:45:08.808889] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-28T01:45:09.053911] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-28T01:45:09.608950] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-28T01:45:10.355238] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-28T01:45:10.408925] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-28T01:45:10.833820] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-28T01:45:10.949127] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-28T01:45:11.208968] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-28T01:45:12.008909] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-28T01:45:12.808890] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-28T01:45:12.998528] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-28T01:45:13.608997] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-28T01:45:13.609821] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-28T01:45:13.611741] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-28T01:45:13.623828] [INFO ] [REMOTE ] ALX: Full fetch complete (6972 records). [2025-09-28T01:45:13.624349] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-28T01:45:14.018336] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-28T01:45:14.018465] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-28T01:45:14.018710] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-28T01:45:14.018791] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-28T01:45:14.019335] [DEBUG] [LOCAL ] ALX: Trimmed 6972 records to 6121 (keeping 200 days of data) [2025-09-28T01:45:14.059239] [DEBUG] [LOCAL ] ALX: Primary data saved (6121 records). [2025-09-28T01:45:14.059402] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-28T01:45:14.059527] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 22.9s. Estimated remaining: 4h 27m 58s. Rate: 8.5 symbols/min [2025-09-28T01:45:14.233006] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:45:14.291664] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-28T01:45:14.291918] [INFO ] [MAIN ] AMBP: Loaded 45863 existing records. [2025-09-28T01:45:14.414066] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-28T01:45:14.478583] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:45:14.478826] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-28T01:45:14.478906] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-28T01:45:14.479268] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-28T01:45:14.479350] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-28T01:45:14.847884] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-28T01:45:14.893904] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:45:15.208903] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-28T01:45:16.008904] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-28T01:45:16.052271] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-28T01:45:16.060959] [INFO ] [REMOTE ] ALV: Full fetch complete (61846 records). [2025-09-28T01:45:16.061165] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-28T01:45:16.487440] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-28T01:45:16.487574] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-28T01:45:16.488357] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-28T01:45:16.488446] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-28T01:45:16.491155] [DEBUG] [LOCAL ] ALV: Trimmed 61846 records to 43217 (keeping 200 days of data) [2025-09-28T01:45:16.772805] [DEBUG] [LOCAL ] ALV: Primary data saved (43217 records). [2025-09-28T01:45:16.773022] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-28T01:45:16.773201] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALV took 39.7s. Estimated remaining: 4h 26m 4s. Rate: 8.6 symbols/min [2025-09-28T01:45:16.814023] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-28T01:45:16.992620] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:45:16.993020] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-28T01:45:16.993136] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-28T01:45:16.993389] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-28T01:45:16.993496] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-28T01:45:16.993596] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-28T01:45:16.993825] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-28T01:45:17.281318] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-28T01:45:17.503269] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:45:17.614020] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-28T01:45:17.629787] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-28T01:45:17.838438] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:45:17.838816] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-28T01:45:17.838909] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:45:17.838984] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-09-28T01:45:17.839053] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:45:17.839127] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-28T01:45:17.839225] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-28T01:45:17.839295] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-28T01:45:17.839378] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-28T01:45:17.839495] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AMBQ took 1.1s. Estimated remaining: 4h 23m 31s. Rate: 8.6 symbols/min [2025-09-28T01:45:18.017950] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:45:18.071142] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-28T01:45:18.071336] [INFO ] [MAIN ] AMC: Loaded 54539 existing records. [2025-09-28T01:45:18.261193] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:45:18.261409] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-28T01:45:18.261507] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-28T01:45:18.261806] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-28T01:45:18.261885] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-28T01:45:18.411846] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-28T01:45:18.679558] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:45:18.681767] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-28T01:45:19.208945] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-28T01:45:20.008871] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-28T01:45:20.275277] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-28T01:45:20.808957] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-28T01:45:21.572555] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-28T01:45:21.608871] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-28T01:45:21.751223] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-28T01:45:22.408954] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-28T01:45:22.537508] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-28T01:45:22.733761] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-28T01:45:23.208905] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-28T01:45:24.008930] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-28T01:45:24.799550] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-28T01:45:24.811284] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-28T01:45:24.801409] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-28T01:45:24.823591] [INFO ] [REMOTE ] AM: Full fetch complete (75601 records). [2025-09-28T01:45:24.824708] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-28T01:45:25.265951] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-28T01:45:25.266334] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-28T01:45:25.267344] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-28T01:45:25.267443] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-28T01:45:25.269541] [DEBUG] [LOCAL ] AM: Trimmed 75601 records to 52887 (keeping 200 days of data) [2025-09-28T01:45:25.390292] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-28T01:45:25.612085] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-28T01:45:25.655823] [DEBUG] [LOCAL ] AM: Primary data saved (52887 records). [2025-09-28T01:45:25.655994] [INFO ] [MAIN ] AM: Full history saved. [2025-09-28T01:45:25.656143] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AM took 33.3s. Estimated remaining: 4h 23m 46s. Rate: 8.6 symbols/min [2025-09-28T01:45:25.834977] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:45:25.888365] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-28T01:45:25.888555] [INFO ] [MAIN ] AMCR: Loaded 54449 existing records. [2025-09-28T01:45:26.076364] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:45:26.076736] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-28T01:45:26.076821] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-28T01:45:26.077614] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-28T01:45:26.077753] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-28T01:45:26.421184] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-28T01:45:26.471380] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:45:26.505491] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-28T01:45:26.994309] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-28T01:45:27.208913] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-28T01:45:28.008905] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-28T01:45:28.796044] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-28T01:45:28.808846] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-28T01:45:28.865474] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-28T01:45:29.542414] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-28T01:45:29.608920] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-28T01:45:30.408920] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-28T01:45:31.209184] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-28T01:45:31.212856] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-28T01:45:31.287160] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-28T01:45:31.582748] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-28T01:45:31.589698] [INFO ] [REMOTE ] AMBC: Full fetch complete (51087 records). [2025-09-28T01:45:31.589942] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-28T01:45:31.997606] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-28T01:45:31.997764] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-28T01:45:31.998406] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-28T01:45:31.998508] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-28T01:45:31.999838] [DEBUG] [LOCAL ] AMBC: Trimmed 51087 records to 37453 (keeping 200 days of data) [2025-09-28T01:45:32.045306] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-28T01:45:32.218083] [DEBUG] [LOCAL ] AMBC: Primary data saved (37453 records). [2025-09-28T01:45:32.218282] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-28T01:45:32.218414] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBC took 28.9s. Estimated remaining: 4h 23m 29s. Rate: 8.6 symbols/min [2025-09-28T01:45:32.392673] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:45:32.445374] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-28T01:45:32.445575] [INFO ] [MAIN ] AME: Loaded 49252 existing records. [2025-09-28T01:45:32.640003] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:45:32.640321] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-28T01:45:32.640407] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-28T01:45:32.640788] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-28T01:45:32.640873] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-28T01:45:32.814063] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-28T01:45:33.070252] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:45:33.236513] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-28T01:45:33.608902] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-28T01:45:33.813998] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-28T01:45:34.408980] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-28T01:45:35.208905] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-28T01:45:35.468606] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-28T01:45:35.511868] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-28T01:45:36.008886] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-28T01:45:36.149844] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-28T01:45:36.814039] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-28T01:45:36.836806] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-28T01:45:37.608894] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-28T01:45:37.775796] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-28T01:45:38.409002] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-28T01:45:38.535530] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-28T01:45:39.169922] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-28T01:45:39.208899] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-28T01:45:40.010421] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-28T01:45:40.013438] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-28T01:45:40.808897] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-28T01:45:40.874406] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-28T01:45:41.608938] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-28T01:45:41.673978] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-28T01:45:42.408898] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-28T01:45:42.448977] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-28T01:45:43.208951] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-28T01:45:44.014517] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-28T01:45:44.036952] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-28T01:45:44.189908] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-28T01:45:44.264019] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-28T01:45:44.808908] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-28T01:45:45.608933] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-28T01:45:46.125770] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-28T01:45:46.408920] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-28T01:45:46.715825] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-28T01:45:47.208955] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-28T01:45:47.884443] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-28T01:45:47.958904] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-28T01:45:48.008917] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-28T01:45:48.748214] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-28T01:45:48.756864] [INFO ] [REMOTE ] AMBP: Full fetch complete (65848 records). [2025-09-28T01:45:48.757059] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-28T01:45:48.821421] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-28T01:45:49.185120] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-28T01:45:49.185257] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-28T01:45:49.185980] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-28T01:45:49.186069] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-28T01:45:49.187550] [DEBUG] [LOCAL ] AMBP: Trimmed 65848 records to 45863 (keeping 200 days of data) [2025-09-28T01:45:49.482682] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-28T01:45:49.502706] [DEBUG] [LOCAL ] AMBP: Primary data saved (45863 records). [2025-09-28T01:45:49.502930] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-28T01:45:49.504326] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBP took 35.4s. Estimated remaining: 4h 27m 27s. Rate: 8.5 symbols/min [2025-09-28T01:45:49.614426] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-28T01:45:49.693545] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:45:49.721725] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-28T01:45:49.721908] [INFO ] [MAIN ] AMG: Loaded 21046 existing records. [2025-09-28T01:45:49.908586] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:45:49.908870] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-28T01:45:49.908952] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-28T01:45:49.909278] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-28T01:45:49.909357] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-28T01:45:50.286830] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:45:50.408917] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-28T01:45:51.208937] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-28T01:45:51.279058] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-28T01:45:51.373074] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-09-28T01:45:52.008896] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-28T01:45:52.284910] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-28T01:45:52.344488] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-28T01:45:52.808937] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-28T01:45:53.608926] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-28T01:45:54.380200] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-28T01:45:54.408866] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-28T01:45:54.614422] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-28T01:45:55.208927] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-28T01:45:55.603604] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-28T01:45:56.008956] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-28T01:45:56.330483] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-28T01:45:56.752891] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-28T01:45:56.763605] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-28T01:45:56.763830] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-28T01:45:56.819923] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-28T01:45:57.203797] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-28T01:45:57.203933] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-28T01:45:57.204832] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-28T01:45:57.204921] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-28T01:45:57.206594] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 54539 (keeping 200 days of data) [2025-09-28T01:45:57.541875] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-28T01:45:57.575366] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-28T01:45:57.592076] [DEBUG] [LOCAL ] AMC: Primary data saved (54539 records). [2025-09-28T01:45:57.592238] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-28T01:45:57.592360] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMC took 39.8s. Estimated remaining: 4h 27m 45s. Rate: 8.5 symbols/min [2025-09-28T01:45:57.614046] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-28T01:45:57.771519] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:45:57.821277] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-28T01:45:57.821465] [INFO ] [MAIN ] AMH: Loaded 52467 existing records. [2025-09-28T01:45:58.000282] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:45:58.000558] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-28T01:45:58.000659] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-28T01:45:58.001042] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-28T01:45:58.001148] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-28T01:45:58.360749] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:45:58.408949] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-28T01:45:59.208882] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-28T01:45:59.580298] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-28T01:45:59.590958] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-28T01:45:59.591147] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-28T01:46:00.001478] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-28T01:46:00.001756] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-28T01:46:00.002635] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-28T01:46:00.002817] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-28T01:46:00.004583] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 54449 (keeping 200 days of data) [2025-09-28T01:46:00.058342] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-28T01:46:00.161667] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-28T01:46:00.380799] [DEBUG] [LOCAL ] AMCR: Primary data saved (54449 records). [2025-09-28T01:46:00.380994] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-28T01:46:00.381127] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMCR took 34.7s. Estimated remaining: 4h 25m 58s. Rate: 8.5 symbols/min [2025-09-28T01:46:00.596547] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:46:00.598226] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-28T01:46:00.642239] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-28T01:46:00.642418] [INFO ] [MAIN ] AMN: Loaded 42588 existing records. [2025-09-28T01:46:00.811997] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-28T01:46:00.836565] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:46:00.837803] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-28T01:46:00.837926] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-28T01:46:00.838366] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-28T01:46:00.838483] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-28T01:46:01.215063] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:46:01.608941] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-28T01:46:01.960278] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-28T01:46:01.970134] [INFO ] [REMOTE ] AME: Full fetch complete (69806 records). [2025-09-28T01:46:01.970327] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-28T01:46:02.398741] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-28T01:46:02.399084] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-28T01:46:02.399939] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-28T01:46:02.400038] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-28T01:46:02.405066] [DEBUG] [LOCAL ] AME: Trimmed 69806 records to 49252 (keeping 200 days of data) [2025-09-28T01:46:02.463384] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-28T01:46:02.775192] [DEBUG] [LOCAL ] AME: Primary data saved (49252 records). [2025-09-28T01:46:02.776391] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-28T01:46:02.776720] [INFO ] [MAIN ] AME: Full history saved. [2025-09-28T01:46:02.777022] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AME took 30.6s. Estimated remaining: 4h 24m 5s. Rate: 8.6 symbols/min [2025-09-28T01:46:02.977392] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:46:03.015259] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-28T01:46:03.015439] [INFO ] [MAIN ] AMP: Loaded 32959 existing records. [2025-09-28T01:46:03.211894] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-28T01:46:03.253111] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:46:03.254421] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-28T01:46:03.254574] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-28T01:46:03.255531] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-28T01:46:03.255845] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-28T01:46:03.517391] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-28T01:46:03.692739] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:46:03.708382] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-28T01:46:04.008912] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-28T01:46:04.808896] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-28T01:46:04.864898] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-28T01:46:05.456760] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-28T01:46:05.608934] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-28T01:46:06.269780] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-28T01:46:06.408926] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-28T01:46:07.074052] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-28T01:46:07.207029] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-28T01:46:07.212260] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-28T01:46:08.008921] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-28T01:46:08.794418] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-28T01:46:08.808868] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-28T01:46:09.608913] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-28T01:46:09.871912] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-28T01:46:10.327611] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-28T01:46:10.408930] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-28T01:46:11.098595] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-28T01:46:11.208919] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-28T01:46:12.008968] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-28T01:46:12.224576] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-28T01:46:12.751387] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-28T01:46:12.808928] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-28T01:46:13.010113] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-28T01:46:13.608979] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-28T01:46:13.979349] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-28T01:46:14.408972] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-28T01:46:15.024632] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-28T01:46:15.208923] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-28T01:46:16.008860] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-28T01:46:16.294087] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-28T01:46:16.812136] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-28T01:46:16.818131] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-28T01:46:17.530159] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-28T01:46:17.608895] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-28T01:46:18.234924] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-28T01:46:18.408914] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-28T01:46:19.191278] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-28T01:46:19.208866] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-28T01:46:20.008914] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-28T01:46:20.175348] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-28T01:46:20.206714] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-28T01:46:20.808906] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-28T01:46:21.101342] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-28T01:46:21.608919] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-28T01:46:21.930057] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-28T01:46:22.408913] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-28T01:46:23.110860] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-28T01:46:23.122346] [INFO ] [REMOTE ] AMN: Full fetch complete (60384 records). [2025-09-28T01:46:23.122600] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-28T01:46:23.214018] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-28T01:46:23.549977] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-28T01:46:23.550437] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-28T01:46:23.551380] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-28T01:46:23.551549] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-28T01:46:23.555872] [DEBUG] [LOCAL ] AMN: Trimmed 60384 records to 42588 (keeping 200 days of data) [2025-09-28T01:46:23.863167] [DEBUG] [LOCAL ] AMN: Primary data saved (42588 records). [2025-09-28T01:46:23.863350] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-28T01:46:23.863518] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMN took 23.5s. Estimated remaining: 4h 29m 19s. Rate: 8.4 symbols/min [2025-09-28T01:46:24.011961] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-28T01:46:24.050193] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:46:24.141864] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-28T01:46:24.145228] [INFO ] [MAIN ] AMPX: Loaded 52949 existing records. [2025-09-28T01:46:24.216691] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-28T01:46:24.353581] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:46:24.353835] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-28T01:46:24.353919] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-28T01:46:24.354416] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-28T01:46:24.354505] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-28T01:46:24.742616] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:46:24.764409] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-28T01:46:24.808893] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-28T01:46:25.098185] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-28T01:46:25.608925] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-28T01:46:26.084910] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-28T01:46:26.408917] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-28T01:46:27.093916] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-28T01:46:27.208912] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-28T01:46:28.008916] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-28T01:46:28.363120] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-28T01:46:28.808942] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-28T01:46:29.011930] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-28T01:46:29.026491] [INFO ] [REMOTE ] AMH: Full fetch complete (74785 records). [2025-09-28T01:46:29.026726] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-28T01:46:29.357532] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-28T01:46:29.415537] [INFO ] [REMOTE ] AMP: Full fetch complete (47634 records). [2025-09-28T01:46:29.458106] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-28T01:46:29.543155] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-28T01:46:29.582211] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-28T01:46:29.594474] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-28T01:46:29.614025] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-28T01:46:29.617255] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-28T01:46:29.666806] [DEBUG] [LOCAL ] AMH: Trimmed 74785 records to 52467 (keeping 200 days of data) [2025-09-28T01:46:30.029053] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-28T01:46:30.029776] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-28T01:46:30.030573] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-28T01:46:30.032486] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-28T01:46:30.037696] [DEBUG] [LOCAL ] AMP: Trimmed 47634 records to 32959 (keeping 200 days of data) [2025-09-28T01:46:30.488622] [DEBUG] [LOCAL ] AMH: Primary data saved (52467 records). [2025-09-28T01:46:30.490764] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-28T01:46:30.491154] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMH took 32.9s. Estimated remaining: 4h 29m 1s. Rate: 8.4 symbols/min [2025-09-28T01:46:30.590290] [DEBUG] [LOCAL ] AMP: Primary data saved (32959 records). [2025-09-28T01:46:30.612426] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-28T01:46:30.612734] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMP took 27.8s. Estimated remaining: 4h 26m 18s. Rate: 8.5 symbols/min [2025-09-28T01:46:30.816906] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:46:30.833728] [DEBUG] [LOCAL ] AMPY: No existing data file found in primary storage. [2025-09-28T01:46:30.844407] [WARN ] [MAIN ] AMPY: No existing data found, performing full refresh instead. [2025-09-28T01:46:30.866072] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-28T01:46:30.894492] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-28T01:46:30.895380] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:46:30.901095] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-09-28T01:46:30.909149] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-28T01:46:30.910248] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-28T01:46:30.937672] [INFO ] [REMOTE ] AMG: Full fetch complete (29862 records). [2025-09-28T01:46:31.013389] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-28T01:46:31.125210] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-28T01:46:31.214318] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-28T01:46:31.264979] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-28T01:46:31.276487] [INFO ] [MAIN ] AMR: Loaded 29441 existing records. [2025-09-28T01:46:31.996946] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:46:32.012943] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:46:32.030128] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-28T01:46:32.037439] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-28T01:46:32.037669] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-28T01:46:32.046640] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-28T01:46:32.046808] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-28T01:46:32.047120] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-28T01:46:32.047592] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-28T01:46:32.047042] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-28T01:46:32.047912] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-28T01:46:32.154490] [DEBUG] [LOCAL ] AMG: Trimmed 29862 records to 21046 (keeping 200 days of data) [2025-09-28T01:46:32.534592] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:46:32.536241] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-28T01:46:32.573247] [DEBUG] [LOCAL ] AMG: Primary data saved (21046 records). [2025-09-28T01:46:32.573431] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-28T01:46:32.573594] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMG took 43.1s. Estimated remaining: 4h 24m 19s. Rate: 8.6 symbols/min [2025-09-28T01:46:32.754123] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:46:32.810998] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-28T01:46:32.811182] [INFO ] [MAIN ] AMRC: Loaded 38981 existing records. [2025-09-28T01:46:33.009612] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:46:33.009885] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-28T01:46:33.009966] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-28T01:46:33.010408] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-28T01:46:33.010488] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-28T01:46:33.352719] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-28T01:46:33.450882] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-28T01:46:33.461290] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:46:33.465962] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-28T01:46:33.608876] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-28T01:46:33.694264] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-28T01:46:34.408893] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-28T01:46:34.794622] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-28T01:46:35.208927] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-28T01:46:35.538162] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-28T01:46:35.568992] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-28T01:46:36.008908] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-28T01:46:36.399101] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-28T01:46:36.808852] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-28T01:46:36.892778] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-28T01:46:37.608957] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-28T01:46:38.255265] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-28T01:46:38.408904] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-28T01:46:38.698196] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-28T01:46:39.208964] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-28T01:46:39.459781] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-28T01:46:40.008880] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-28T01:46:40.378384] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-28T01:46:40.808907] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-28T01:46:41.592604] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-28T01:46:41.608843] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-28T01:46:42.180676] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-28T01:46:42.408946] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-28T01:46:43.152104] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-28T01:46:43.208909] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-28T01:46:44.008869] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-28T01:46:44.425819] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-28T01:46:44.671537] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-28T01:46:44.808919] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-28T01:46:45.518362] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-28T01:46:45.608953] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-28T01:46:46.354334] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-28T01:46:46.408906] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-28T01:46:46.960878] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-28T01:46:47.208954] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-28T01:46:47.932325] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-28T01:46:48.008963] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-28T01:46:48.808919] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-28T01:46:49.017995] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-28T01:46:49.273638] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-28T01:46:49.608940] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-28T01:46:50.182402] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-28T01:46:50.408961] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-28T01:46:50.798748] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-28T01:46:51.208919] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-28T01:46:52.008917] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-28T01:46:52.162610] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-28T01:46:52.571279] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-28T01:46:52.808943] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-28T01:46:53.612859] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-28T01:46:53.616044] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-28T01:46:54.408937] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-28T01:46:55.042619] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-28T01:46:55.082501] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-28T01:46:55.208937] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-28T01:46:55.910357] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-28T01:46:56.008905] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-28T01:46:56.670909] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-28T01:46:56.808936] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-28T01:46:57.138238] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-28T01:46:57.145298] [INFO ] [REMOTE ] AMPY: Full fetch complete (50664 records). [2025-09-28T01:46:57.145477] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-28T01:46:57.550261] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-28T01:46:57.550397] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-28T01:46:57.551079] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-28T01:46:57.551182] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-28T01:46:57.552609] [DEBUG] [LOCAL ] AMPY: Trimmed 50664 records to 38164 (keeping 200 days of data) [2025-09-28T01:46:57.634480] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-28T01:46:57.779591] [DEBUG] [LOCAL ] AMPY: Primary data saved (38164 records). [2025-09-28T01:46:57.779909] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-28T01:46:57.780050] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPY took 27.3s. Estimated remaining: 4h 30m 49s. Rate: 8.4 symbols/min [2025-09-28T01:46:57.960625] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:46:57.960952] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-28T01:46:57.961038] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-28T01:46:57.961198] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-28T01:46:57.961290] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-28T01:46:57.961415] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-28T01:46:57.961513] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-28T01:46:58.352959] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:46:58.354508] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-28T01:46:58.408938] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-28T01:46:59.208906] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-28T01:46:59.744435] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-28T01:46:59.752942] [INFO ] [REMOTE ] AMRC: Full fetch complete (52817 records). [2025-09-28T01:46:59.753158] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-28T01:46:59.899855] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:46:59.956017] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-28T01:46:59.956339] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:47:00.011170] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-09-28T01:47:00.032629] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-28T01:47:00.076743] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:47:00.146939] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-28T01:47:00.171448] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-09-28T01:47:00.171630] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-28T01:47:00.207992] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-28T01:47:00.219461] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-28T01:47:00.219639] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-28T01:47:00.220501] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-28T01:47:00.220763] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-28T01:47:00.220845] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-28T01:47:00.222227] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMRZ took 2.4s. Estimated remaining: 4h 29m 0s. Rate: 8.4 symbols/min [2025-09-28T01:47:00.316694] [DEBUG] [LOCAL ] AMRC: Trimmed 52817 records to 38981 (keeping 200 days of data) [2025-09-28T01:47:00.487478] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:47:00.653386] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-28T01:47:00.654956] [INFO ] [MAIN ] AMT: Loaded 53212 existing records. [2025-09-28T01:47:00.811724] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-28T01:47:00.854728] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:47:00.857270] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-28T01:47:00.857674] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-28T01:47:00.859242] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-28T01:47:00.859352] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-28T01:47:00.978999] [DEBUG] [LOCAL ] AMRC: Primary data saved (38981 records). [2025-09-28T01:47:00.985351] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-28T01:47:01.007515] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMRC took 28.4s. Estimated remaining: 4h 26m 37s. Rate: 8.5 symbols/min [2025-09-28T01:47:01.398239] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:47:01.459224] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:47:01.476513] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-28T01:47:01.483087] [INFO ] [REMOTE ] AMR: Full fetch complete (39827 records). [2025-09-28T01:47:01.483266] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-28T01:47:01.610577] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-28T01:47:01.614627] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-28T01:47:01.616276] [INFO ] [MAIN ] AMTB: Loaded 20599 existing records. [2025-09-28T01:47:02.077580] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:47:02.093751] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-28T01:47:02.094229] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-28T01:47:02.111181] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-28T01:47:02.114504] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-28T01:47:02.179472] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-28T01:47:02.206849] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-28T01:47:02.214057] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-28T01:47:02.219309] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-28T01:47:02.259327] [DEBUG] [LOCAL ] AMR: Trimmed 39827 records to 29441 (keeping 200 days of data) [2025-09-28T01:47:02.606450] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:47:02.607837] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-28T01:47:02.697351] [DEBUG] [LOCAL ] AMR: Primary data saved (29441 records). [2025-09-28T01:47:02.697535] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-28T01:47:02.697697] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMR took 32.1s. Estimated remaining: 4h 24m 37s. Rate: 8.6 symbols/min [2025-09-28T01:47:02.875739] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:47:02.882223] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-28T01:47:02.882358] [INFO ] [MAIN ] AMTD: Loaded 3622 existing records. [2025-09-28T01:47:03.069399] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:47:03.069806] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-28T01:47:03.069931] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-28T01:47:03.070177] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-28T01:47:03.070258] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-28T01:47:03.486610] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:47:03.489380] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-28T01:47:03.500431] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-28T01:47:03.503474] [INFO ] [REMOTE ] AMPX: Full fetch complete (74611 records). [2025-09-28T01:47:03.503814] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-28T01:47:03.876487] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-28T01:47:03.877103] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-28T01:47:03.997588] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-28T01:47:03.997807] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-28T01:47:03.997970] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-28T01:47:04.000269] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-28T01:47:04.000968] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-28T01:47:04.002730] [DEBUG] [LOCAL ] AMPX: Trimmed 74611 records to 52949 (keeping 200 days of data) [2025-09-28T01:47:04.050066] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-28T01:47:04.324051] [DEBUG] [LOCAL ] AMPX: Primary data saved (52949 records). [2025-09-28T01:47:04.324276] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-28T01:47:04.324435] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMPX took 40.5s. Estimated remaining: 4h 22m 37s. Rate: 8.6 symbols/min [2025-09-28T01:47:04.566347] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:47:04.614920] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-28T01:47:04.615112] [INFO ] [MAIN ] AMTM: Loaded 51451 existing records. [2025-09-28T01:47:04.799560] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:47:04.799841] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-28T01:47:04.799926] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-28T01:47:04.800215] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-28T01:47:04.800306] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-28T01:47:04.814057] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-28T01:47:05.182141] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:47:05.244430] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-28T01:47:05.608915] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-28T01:47:06.408976] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-28T01:47:06.615755] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-28T01:47:06.916770] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-28T01:47:07.139980] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-28T01:47:07.208969] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-28T01:47:08.008920] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-28T01:47:08.259828] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-28T01:47:08.808933] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-28T01:47:09.608863] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-28T01:47:09.860154] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-28T01:47:10.007602] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-28T01:47:10.235078] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-28T01:47:10.408959] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-28T01:47:11.075058] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-28T01:47:11.208917] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-28T01:47:12.008940] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-28T01:47:12.808869] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-28T01:47:12.905612] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-28T01:47:13.356591] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-28T01:47:13.608893] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-28T01:47:13.937032] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-28T01:47:14.408907] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-28T01:47:15.208941] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-28T01:47:15.232491] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-28T01:47:15.374280] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-28T01:47:16.009029] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-28T01:47:16.808867] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-28T01:47:17.167426] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-28T01:47:17.173527] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-28T01:47:17.608910] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-28T01:47:18.408888] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-28T01:47:18.585521] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-28T01:47:18.716762] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-28T01:47:19.208897] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-28T01:47:20.008874] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-28T01:47:20.285000] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-28T01:47:20.808861] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-28T01:47:20.956578] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-28T01:47:21.000745] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-28T01:47:21.282141] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-28T01:47:21.608917] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-28T01:47:22.100693] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-28T01:47:22.408907] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-28T01:47:23.208899] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-28T01:47:24.008889] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-28T01:47:24.198127] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-28T01:47:24.648929] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-28T01:47:24.808872] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-28T01:47:24.873777] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-28T01:47:25.608901] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-28T01:47:26.408874] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-28T01:47:26.487993] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-28T01:47:27.004750] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-28T01:47:27.008433] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-28T01:47:27.208905] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-28T01:47:27.790221] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-28T01:47:28.008891] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-28T01:47:28.689684] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-28T01:47:28.691385] [INFO ] [REMOTE ] AMTD: Full fetch complete (5602 records). [2025-09-28T01:47:28.691483] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-28T01:47:28.814017] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-28T01:47:29.070192] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-28T01:47:29.070310] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-28T01:47:29.070492] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-28T01:47:29.070563] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-28T01:47:29.071023] [DEBUG] [LOCAL ] AMTD: Trimmed 5602 records to 3622 (keeping 200 days of data) [2025-09-28T01:47:29.091320] [DEBUG] [LOCAL ] AMTD: Primary data saved (3622 records). [2025-09-28T01:47:29.091427] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-28T01:47:29.091550] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTD took 26.4s. Estimated remaining: 4h 28m 39s. Rate: 8.4 symbols/min [2025-09-28T01:47:29.260457] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:47:29.271450] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-28T01:47:29.271623] [INFO ] [MAIN ] AMWL: Loaded 8830 existing records. [2025-09-28T01:47:29.457543] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:47:29.457786] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-28T01:47:29.457868] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-28T01:47:29.458110] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-28T01:47:29.458189] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-28T01:47:29.619816] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-28T01:47:29.834204] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:47:30.408872] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-28T01:47:30.753394] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-28T01:47:30.796414] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-28T01:47:30.800161] [INFO ] [REMOTE ] AMTB: Full fetch complete (30119 records). [2025-09-28T01:47:30.800276] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-28T01:47:31.190803] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-28T01:47:31.191060] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-28T01:47:31.191541] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-28T01:47:31.191626] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-28T01:47:31.192449] [DEBUG] [LOCAL ] AMTB: Trimmed 30119 records to 20599 (keeping 200 days of data) [2025-09-28T01:47:31.245457] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-28T01:47:31.322662] [DEBUG] [LOCAL ] AMTB: Primary data saved (20599 records). [2025-09-28T01:47:31.322832] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-28T01:47:31.323028] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTB took 30.3s. Estimated remaining: 4h 26m 52s. Rate: 8.5 symbols/min [2025-09-28T01:47:31.496731] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:47:31.549269] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-28T01:47:31.549455] [INFO ] [MAIN ] AMX: Loaded 49855 existing records. [2025-09-28T01:47:31.753464] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:47:31.753883] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-28T01:47:31.754000] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-28T01:47:31.754736] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-28T01:47:31.754819] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-28T01:47:31.953681] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-28T01:47:32.009756] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-28T01:47:32.296778] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:47:32.481559] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-28T01:47:32.808916] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-28T01:47:32.892225] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-28T01:47:33.608957] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-28T01:47:34.359732] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-28T01:47:34.408917] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-28T01:47:35.208910] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-28T01:47:35.260156] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-28T01:47:36.008873] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-28T01:47:36.126777] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-28T01:47:36.266945] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-28T01:47:36.277488] [INFO ] [REMOTE ] AMT: Full fetch complete (76009 records). [2025-09-28T01:47:36.277713] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-28T01:47:36.678141] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-28T01:47:36.678267] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-28T01:47:36.679082] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-28T01:47:36.679172] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-28T01:47:36.680803] [DEBUG] [LOCAL ] AMT: Trimmed 76009 records to 53212 (keeping 200 days of data) [2025-09-28T01:47:36.809075] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-28T01:47:37.019960] [DEBUG] [LOCAL ] AMT: Primary data saved (53212 records). [2025-09-28T01:47:37.020153] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-28T01:47:37.020278] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMT took 36.8s. Estimated remaining: 4h 26m 16s. Rate: 8.5 symbols/min [2025-09-28T01:47:37.204799] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:47:37.239574] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-28T01:47:37.239774] [INFO ] [MAIN ] AN: Loaded 32842 existing records. [2025-09-28T01:47:37.439500] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:47:37.439812] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-28T01:47:37.446392] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-28T01:47:37.447353] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-28T01:47:37.447727] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-28T01:47:37.447898] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-28T01:47:37.613237] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-28T01:47:37.831742] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:47:37.859575] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-28T01:47:38.408913] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-28T01:47:38.958497] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-28T01:47:39.209699] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-28T01:47:39.212717] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-28T01:47:39.223097] [INFO ] [REMOTE ] AMTM: Full fetch complete (73974 records). [2025-09-28T01:47:39.223280] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-28T01:47:39.621622] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-28T01:47:39.621778] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-28T01:47:39.622550] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-28T01:47:39.622634] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-28T01:47:39.624309] [DEBUG] [LOCAL ] AMTM: Trimmed 73974 records to 51451 (keeping 200 days of data) [2025-09-28T01:47:39.920465] [DEBUG] [LOCAL ] AMTM: Primary data saved (51451 records). [2025-09-28T01:47:39.920697] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-28T01:47:39.920827] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMTM took 35.6s. Estimated remaining: 4h 24m 45s. Rate: 8.5 symbols/min [2025-09-28T01:47:40.014079] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-28T01:47:40.100797] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:47:40.164898] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-28T01:47:40.165086] [INFO ] [MAIN ] ANET: Loaded 54546 existing records. [2025-09-28T01:47:40.357428] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:47:40.357853] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-28T01:47:40.358012] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-28T01:47:40.359263] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-28T01:47:40.359359] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-28T01:47:40.497200] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-28T01:47:40.751381] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:47:40.808853] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-28T01:47:41.194938] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-28T01:47:41.608940] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-28T01:47:42.408913] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-28T01:47:43.043046] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-28T01:47:43.095159] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-28T01:47:43.208973] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-28T01:47:43.974210] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-28T01:47:44.008862] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-28T01:47:44.636489] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-28T01:47:44.808946] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-28T01:47:45.368910] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-28T01:47:45.610752] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-28T01:47:45.619086] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-28T01:47:46.408913] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-28T01:47:47.104048] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-28T01:47:47.208914] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-28T01:47:47.743204] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-28T01:47:48.008915] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-28T01:47:48.808936] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-28T01:47:49.438021] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-28T01:47:49.576549] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-28T01:47:49.614082] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-28T01:47:49.634543] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-28T01:47:50.408912] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-28T01:47:50.419446] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-28T01:47:51.208913] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-28T01:47:52.008909] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-28T01:47:52.114011] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-28T01:47:52.808942] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-28T01:47:53.515550] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-28T01:47:53.573171] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-28T01:47:53.574292] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-28T01:47:53.608875] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-28T01:47:54.408934] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-28T01:47:55.208965] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-28T01:47:56.008915] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-28T01:47:56.152005] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-28T01:47:56.178139] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-28T01:47:56.475822] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-28T01:47:56.801138] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-28T01:47:56.804171] [INFO ] [REMOTE ] AMWL: Full fetch complete (14028 records). [2025-09-28T01:47:56.804297] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-28T01:47:56.816405] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-28T01:47:57.195792] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-28T01:47:57.195981] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-28T01:47:57.196404] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-28T01:47:57.196520] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-28T01:47:57.197389] [DEBUG] [LOCAL ] AMWL: Trimmed 14028 records to 8830 (keeping 200 days of data) [2025-09-28T01:47:57.259418] [DEBUG] [LOCAL ] AMWL: Primary data saved (8830 records). [2025-09-28T01:47:57.259664] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-28T01:47:57.259833] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMWL took 28.2s. Estimated remaining: 4h 28m 4s. Rate: 8.4 symbols/min [2025-09-28T01:47:57.440500] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:47:57.494677] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-28T01:47:57.494876] [INFO ] [MAIN ] ANF: Loaded 52967 existing records. [2025-09-28T01:47:57.614026] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-28T01:47:57.688212] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:47:57.688421] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-28T01:47:57.688515] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-28T01:47:57.688870] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-28T01:47:57.688953] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-28T01:47:58.061041] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:47:58.408915] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-28T01:47:59.197673] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-28T01:47:59.211863] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-28T01:47:59.355928] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-28T01:47:59.372012] [INFO ] [REMOTE ] AMX: Full fetch complete (70710 records). [2025-09-28T01:47:59.372357] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-28T01:47:59.897256] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-28T01:47:59.897417] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-28T01:47:59.898492] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-28T01:47:59.898593] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-28T01:47:59.900350] [DEBUG] [LOCAL ] AMX: Trimmed 70710 records to 49855 (keeping 200 days of data) [2025-09-28T01:48:00.011853] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-28T01:48:00.224269] [DEBUG] [LOCAL ] AMX: Primary data saved (49855 records). [2025-09-28T01:48:00.224453] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-28T01:48:00.225535] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMX took 28.9s. Estimated remaining: 4h 26m 35s. Rate: 8.5 symbols/min [2025-09-28T01:48:00.403512] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:48:00.403888] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-28T01:48:00.403978] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-28T01:48:00.404145] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-28T01:48:00.404232] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-28T01:48:00.404378] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-28T01:48:00.404549] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-28T01:48:00.540190] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-28T01:48:00.825266] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:48:00.825430] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-28T01:48:00.844267] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-28T01:48:01.608928] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-28T01:48:02.408873] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-28T01:48:02.583096] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-28T01:48:02.624463] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:48:02.624879] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-28T01:48:02.624970] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:48:02.625046] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-09-28T01:48:02.625120] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:48:02.625198] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-28T01:48:02.625302] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-28T01:48:02.625390] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-28T01:48:02.625506] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-28T01:48:02.625601] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. ANGX took 2.4s. Estimated remaining: 4h 24m 56s. Rate: 8.5 symbols/min [2025-09-28T01:48:02.818528] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:48:02.876258] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-28T01:48:02.901191] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-28T01:48:02.902093] [INFO ] [MAIN ] ANRO: Loaded 19387 existing records. [2025-09-28T01:48:03.110239] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:48:03.118856] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-28T01:48:03.120071] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-28T01:48:03.120142] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-28T01:48:03.127946] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-28T01:48:03.128068] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-28T01:48:03.213993] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-28T01:48:03.509107] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:48:04.008906] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-28T01:48:04.808915] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-28T01:48:05.141471] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-28T01:48:05.169413] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-28T01:48:05.608914] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-28T01:48:06.085148] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-28T01:48:06.408920] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-28T01:48:06.953471] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-28T01:48:06.959945] [INFO ] [REMOTE ] AN: Full fetch complete (47668 records). [2025-09-28T01:48:06.960092] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-28T01:48:07.216834] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-28T01:48:07.364262] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-28T01:48:07.364403] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-28T01:48:07.365074] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-28T01:48:07.365165] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-28T01:48:07.366526] [DEBUG] [LOCAL ] AN: Trimmed 47668 records to 32842 (keeping 200 days of data) [2025-09-28T01:48:07.563711] [DEBUG] [LOCAL ] AN: Primary data saved (32842 records). [2025-09-28T01:48:07.563911] [INFO ] [MAIN ] AN: Full history saved. [2025-09-28T01:48:07.564046] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. AN took 30.5s. Estimated remaining: 4h 24m 8s. Rate: 8.5 symbols/min [2025-09-28T01:48:07.740012] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:48:07.763408] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-28T01:48:07.763634] [INFO ] [MAIN ] ANVS: Loaded 23508 existing records. [2025-09-28T01:48:07.946361] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:48:07.946744] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-28T01:48:07.947038] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-28T01:48:07.947460] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-28T01:48:07.947541] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-28T01:48:08.012341] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-28T01:48:08.329567] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:48:08.364415] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-28T01:48:08.778813] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-28T01:48:08.808882] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-28T01:48:09.487027] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-28T01:48:09.608878] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-28T01:48:09.848842] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-28T01:48:10.408914] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-28T01:48:10.725566] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-28T01:48:11.208907] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-28T01:48:12.008878] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-28T01:48:12.401185] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-28T01:48:12.814511] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-28T01:48:12.832787] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-28T01:48:13.228497] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-28T01:48:13.608855] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-28T01:48:13.631457] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-28T01:48:14.408899] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-28T01:48:15.208870] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-28T01:48:15.283560] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-28T01:48:15.450607] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-28T01:48:16.008938] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-28T01:48:16.739353] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-28T01:48:16.808906] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-28T01:48:16.907454] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-28T01:48:17.608921] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-28T01:48:18.408961] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-28T01:48:18.772927] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-28T01:48:19.208874] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-28T01:48:19.580309] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-28T01:48:20.013984] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-28T01:48:20.031953] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-28T01:48:20.795241] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-28T01:48:20.808852] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-28T01:48:21.041017] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-28T01:48:21.608914] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-28T01:48:22.408915] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-28T01:48:22.555012] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-28T01:48:22.922754] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-28T01:48:22.933827] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-28T01:48:22.934100] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-28T01:48:23.218560] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-28T01:48:23.361368] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-28T01:48:23.361504] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-28T01:48:23.362414] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-28T01:48:23.362511] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-28T01:48:23.364227] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 54546 (keeping 200 days of data) [2025-09-28T01:48:23.709706] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-09-28T01:48:23.710143] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-28T01:48:23.710276] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANET took 43.8s. Estimated remaining: 4h 26m 56s. Rate: 8.4 symbols/min [2025-09-28T01:48:24.008875] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-28T01:48:24.092930] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-28T01:48:24.096297] [INFO ] [REMOTE ] ANRO: Full fetch complete (29998 records). [2025-09-28T01:48:24.096709] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-28T01:48:24.534717] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-28T01:48:24.554422] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-28T01:48:24.555070] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-28T01:48:24.555599] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-28T01:48:24.556116] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-28T01:48:24.557270] [DEBUG] [LOCAL ] ANRO: Trimmed 29998 records to 19387 (keeping 200 days of data) [2025-09-28T01:48:24.664726] [DEBUG] [LOCAL ] ANRO: Primary data saved (19387 records). [2025-09-28T01:48:24.664919] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-28T01:48:24.665047] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 22.0s. Estimated remaining: 4h 24m 52s. Rate: 8.5 symbols/min [2025-09-28T01:48:24.808871] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-28T01:48:24.866823] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-28T01:48:25.608894] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-28T01:48:26.564244] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-28T01:48:26.570539] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-28T01:48:26.709827] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-28T01:48:27.208914] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-28T01:48:27.888235] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-28T01:48:28.008932] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-28T01:48:28.675299] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-28T01:48:28.685569] [INFO ] [REMOTE ] ANF: Full fetch complete (75644 records). [2025-09-28T01:48:28.685783] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-28T01:48:29.143920] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-28T01:48:29.148225] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-28T01:48:29.154214] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-28T01:48:29.155249] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-28T01:48:29.155398] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-28T01:48:29.156359] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-28T01:48:29.167326] [DEBUG] [LOCAL ] ANF: Trimmed 75644 records to 52967 (keeping 200 days of data) [2025-09-28T01:48:29.506541] [DEBUG] [LOCAL ] ANF: Primary data saved (52967 records). [2025-09-28T01:48:29.506777] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-28T01:48:29.507032] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANF took 32.2s. Estimated remaining: 4h 24m 3s. Rate: 8.5 symbols/min [2025-09-28T01:48:29.963260] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-28T01:48:29.968471] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-28T01:48:30.839830] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-28T01:48:30.843877] [INFO ] [REMOTE ] ANVS: Full fetch complete (36553 records). [2025-09-28T01:48:30.844046] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-28T01:48:31.220820] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-28T01:48:31.220944] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-28T01:48:31.221399] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-28T01:48:31.221496] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-28T01:48:31.222487] [DEBUG] [LOCAL ] ANVS: Trimmed 36553 records to 23508 (keeping 200 days of data) [2025-09-28T01:48:31.375185] [DEBUG] [LOCAL ] ANVS: Primary data saved (23508 records). [2025-09-28T01:48:31.375411] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-28T01:48:31.375591] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANVS took 23.8s. Estimated remaining: 4h 22m 19s. Rate: 8.6 symbols/min [2025-09-28T01:48:32.137796] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:48:32.185080] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:48:32.181070] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:48:31.973836] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:48:32.185730] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-28T01:48:32.186426] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-28T01:48:32.186855] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-28T01:48:32.186962] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-28T01:48:32.187033] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-28T01:48:32.187091] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-28T01:48:32.320883] [DEBUG] [LOCAL ] AOMR: Loaded 16852 existing records from primary storage. [2025-09-28T01:48:32.364588] [INFO ] [MAIN ] AOMR: Loaded 16852 existing records. [2025-09-28T01:48:32.476106] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-28T01:48:32.584180] [INFO ] [MAIN ] AOD: Loaded 30414 existing records. [2025-09-28T01:48:32.705398] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-28T01:48:32.762523] [INFO ] [MAIN ] AON: Loaded 46248 existing records. [2025-09-28T01:48:33.027621] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:48:33.076142] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-28T01:48:33.091977] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-28T01:48:33.102791] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:48:33.170841] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-28T01:48:33.229980] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-28T01:48:33.199044] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:48:33.234486] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-28T01:48:33.249045] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-28T01:48:33.271796] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-28T01:48:33.333363] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-28T01:48:33.333536] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:48:33.338950] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-28T01:48:33.372682] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-28T01:48:33.376386] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-28T01:48:33.413307] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-28T01:48:33.413488] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-28T01:48:33.614474] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:48:33.655094] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-28T01:48:33.727018] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:48:33.817516] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-09-28T01:48:33.873686] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:48:33.963627] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-28T01:48:34.091902] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-28T01:48:34.193082] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-28T01:48:34.196366] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:48:34.240698] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-28T01:48:34.282718] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.9s. Estimated remaining: 4h 20m 56s. Rate: 8.6 symbols/min [2025-09-28T01:48:34.277086] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-28T01:48:34.473520] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:48:34.505885] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-28T01:48:34.500287] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:48:34.519204] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-28T01:48:34.615376] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:48:34.651773] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-28T01:48:34.651950] [INFO ] [MAIN ] AORT: Loaded 30087 existing records. [2025-09-28T01:48:34.840302] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:48:34.840600] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-28T01:48:34.840705] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-28T01:48:34.841191] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-28T01:48:34.841271] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-28T01:48:35.214704] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:48:35.215077] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-28T01:48:35.271393] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-28T01:48:35.274593] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-28T01:48:35.882724] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-28T01:48:35.889008] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-28T01:48:36.076376] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-28T01:48:36.079509] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-28T01:48:36.170362] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-28T01:48:36.283116] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-28T01:48:36.777918] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-28T01:48:36.808895] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-28T01:48:36.982005] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-28T01:48:37.608923] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-28T01:48:38.326392] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-28T01:48:38.410205] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-28T01:48:38.415810] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-28T01:48:39.208890] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-28T01:48:39.648814] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-28T01:48:39.893952] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-28T01:48:40.008917] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-28T01:48:40.808887] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-28T01:48:40.834677] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-28T01:48:41.608940] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-28T01:48:42.030826] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-28T01:48:42.408910] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-28T01:48:43.208877] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-28T01:48:43.318063] [DEBUG] [REMOTE ] AOMR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-28T01:48:43.321324] [WARN ] [REMOTE ] AOMR: No data returned for month 2025-06 [2025-09-28T01:48:43.322739] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-28T01:48:43.321758] [FATAL] [REMOTE ] AOMR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:48:43.331326] [FATAL] [MAIN ] AOMR: Failed to fetch primary data. [2025-09-28T01:48:43.331851] [WARN ] [MAIN ] AOMR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:48:43.332301] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-28T01:48:43.332427] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-09-28T01:48:43.332543] [INFO ] [LOCAL ] AOMR: Starting deletion of derivative data. [2025-09-28T01:48:43.332699] [DEBUG] [LOCAL ] AOMR: No derivative data file found to delete. [2025-09-28T01:48:43.332847] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOMR took 12.0s. Estimated remaining: 4h 21m 28s. Rate: 8.6 symbols/min [2025-09-28T01:48:43.511843] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:48:43.566265] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-28T01:48:43.566467] [INFO ] [MAIN ] AOS: Loaded 49769 existing records. [2025-09-28T01:48:43.787904] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:48:43.789759] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-28T01:48:43.789839] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-28T01:48:43.796397] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-28T01:48:43.797273] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-28T01:48:43.797367] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-28T01:48:44.015488] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-28T01:48:44.177231] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:48:44.808921] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-28T01:48:45.399230] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-28T01:48:45.608923] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-28T01:48:46.408912] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-28T01:48:46.583737] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-28T01:48:46.890701] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-28T01:48:47.208944] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-28T01:48:47.789154] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-28T01:48:48.008938] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-28T01:48:48.778536] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-28T01:48:48.808871] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-28T01:48:49.608963] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-28T01:48:49.694947] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-28T01:48:50.408912] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-28T01:48:50.697792] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-28T01:48:50.849223] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-28T01:48:51.208947] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-28T01:48:52.008928] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-28T01:48:52.077412] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-28T01:48:52.427622] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-28T01:48:52.808911] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-28T01:48:52.941597] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-28T01:48:53.608902] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-28T01:48:54.408916] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-28T01:48:54.443300] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-28T01:48:55.019514] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-28T01:48:55.208923] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-28T01:48:55.742067] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-28T01:48:56.008920] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-28T01:48:56.144606] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-28T01:48:56.808942] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-28T01:48:57.608878] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-28T01:48:57.651420] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-28T01:48:58.174803] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-28T01:48:58.408898] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-28T01:48:59.208887] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-28T01:48:59.427479] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-28T01:48:59.537976] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-28T01:49:00.008951] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-28T01:49:00.808922] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-28T01:49:01.375515] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-28T01:49:01.584740] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-28T01:49:01.608895] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-28T01:49:01.721939] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-28T01:49:01.728461] [INFO ] [REMOTE ] AOD: Full fetch complete (44060 records). [2025-09-28T01:49:01.728613] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-28T01:49:02.189960] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-28T01:49:02.190117] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-28T01:49:02.190742] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-28T01:49:02.190858] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-28T01:49:02.192097] [DEBUG] [LOCAL ] AOD: Trimmed 44060 records to 30414 (keeping 200 days of data) [2025-09-28T01:49:02.390550] [DEBUG] [LOCAL ] AOD: Primary data saved (30414 records). [2025-09-28T01:49:02.390747] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-28T01:49:02.390891] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AOD took 31.0s. Estimated remaining: 4h 25m 1s. Rate: 8.5 symbols/min [2025-09-28T01:49:02.414131] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-28T01:49:02.593222] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:49:02.593512] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-09-28T01:49:02.593588] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-09-28T01:49:02.593742] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-28T01:49:02.593819] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-28T01:49:02.593904] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-09-28T01:49:02.593976] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-28T01:49:02.963592] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:49:03.208904] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-28T01:49:03.352206] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-28T01:49:03.365492] [INFO ] [REMOTE ] AON: Full fetch complete (64932 records). [2025-09-28T01:49:03.365799] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-28T01:49:03.771945] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-28T01:49:03.772145] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-28T01:49:03.772932] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-28T01:49:03.773023] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-28T01:49:03.774532] [DEBUG] [LOCAL ] AON: Trimmed 64932 records to 46248 (keeping 200 days of data) [2025-09-28T01:49:03.876222] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-28T01:49:04.010431] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-28T01:49:04.088815] [DEBUG] [LOCAL ] AON: Primary data saved (46248 records). [2025-09-28T01:49:04.088995] [INFO ] [MAIN ] AON: Full history saved. [2025-09-28T01:49:04.089132] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AON took 32.7s. Estimated remaining: 4h 23m 17s. Rate: 8.5 symbols/min [2025-09-28T01:49:04.280822] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:49:04.320011] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-28T01:49:04.320217] [INFO ] [MAIN ] APAM: Loaded 36969 existing records. [2025-09-28T01:49:04.508567] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-28T01:49:04.553949] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:49:04.554564] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-28T01:49:04.555015] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-28T01:49:04.555428] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-28T01:49:04.555512] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-28T01:49:04.813986] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-28T01:49:04.938970] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:49:05.344954] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-28T01:49:05.608962] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-28T01:49:06.203779] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-28T01:49:06.408872] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-28T01:49:06.536788] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-28T01:49:07.208919] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-28T01:49:07.689680] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-28T01:49:07.696000] [INFO ] [REMOTE ] AORT: Full fetch complete (41799 records). [2025-09-28T01:49:07.696179] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-28T01:49:08.014040] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-28T01:49:08.090568] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-28T01:49:08.090712] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-28T01:49:08.091269] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-28T01:49:08.091376] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-28T01:49:08.092436] [DEBUG] [LOCAL ] AORT: Trimmed 41799 records to 30087 (keeping 200 days of data) [2025-09-28T01:49:08.282760] [DEBUG] [LOCAL ] AORT: Primary data saved (30087 records). [2025-09-28T01:49:08.282935] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-28T01:49:08.283082] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AORT took 34.0s. Estimated remaining: 4h 22m 19s. Rate: 8.6 symbols/min [2025-09-28T01:49:08.467727] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:49:08.467931] [DEBUG] [LOCAL ] APD: No existing data file found in primary storage. [2025-09-28T01:49:08.468006] [WARN ] [MAIN ] APD: No existing data found, performing full refresh instead. [2025-09-28T01:49:08.468139] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-28T01:49:08.468215] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-28T01:49:08.468300] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-28T01:49:08.468374] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-28T01:49:08.675624] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-28T01:49:08.813592] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-28T01:49:08.858764] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:49:09.008203] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-28T01:49:09.608951] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-28T01:49:10.243714] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-28T01:49:10.408934] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-28T01:49:11.208895] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-28T01:49:11.468411] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-28T01:49:11.792515] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-28T01:49:12.008934] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-28T01:49:12.100988] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-28T01:49:12.808924] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-28T01:49:13.400530] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-28T01:49:13.608901] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-28T01:49:14.260938] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-28T01:49:14.408906] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-28T01:49:14.684951] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-28T01:49:15.208909] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-28T01:49:15.218477] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-28T01:49:16.008941] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-28T01:49:16.808870] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-28T01:49:16.838157] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-28T01:49:16.892466] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-28T01:49:17.608899] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-28T01:49:18.203610] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-28T01:49:18.403700] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-28T01:49:18.408853] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-28T01:49:19.208911] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-28T01:49:20.008902] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-28T01:49:20.275692] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-28T01:49:20.555339] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-28T01:49:20.739775] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-28T01:49:20.808863] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-28T01:49:21.608945] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-28T01:49:22.247211] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-28T01:49:22.337990] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-28T01:49:22.340516] [INFO ] [REMOTE ] AP: Full fetch complete (8926 records). [2025-09-28T01:49:22.340701] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-28T01:49:22.414093] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-28T01:49:22.727412] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-28T01:49:22.727536] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-28T01:49:22.727856] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-28T01:49:22.727938] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-28T01:49:22.728405] [DEBUG] [LOCAL ] AP: Trimmed 8926 records to 7236 (keeping 200 days of data) [2025-09-28T01:49:22.768379] [DEBUG] [LOCAL ] AP: Primary data saved (7236 records). [2025-09-28T01:49:22.768523] [INFO ] [MAIN ] AP: Full history saved. [2025-09-28T01:49:22.768672] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 20.4s. Estimated remaining: 4h 24m 25s. Rate: 8.5 symbols/min [2025-09-28T01:49:22.944483] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:49:22.944755] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-09-28T01:49:22.944840] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-09-28T01:49:22.944963] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-28T01:49:22.945038] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-28T01:49:22.945125] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-28T01:49:22.945213] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-28T01:49:23.214066] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-28T01:49:23.326787] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:49:24.008916] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-28T01:49:24.362520] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-28T01:49:24.805630] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-28T01:49:24.814226] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-28T01:49:25.614251] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-28T01:49:25.626336] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-28T01:49:25.636147] [INFO ] [REMOTE ] AOS: Full fetch complete (70669 records). [2025-09-28T01:49:25.636368] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-28T01:49:26.035949] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-28T01:49:26.036087] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-28T01:49:26.036865] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-28T01:49:26.036967] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-28T01:49:26.038505] [DEBUG] [LOCAL ] AOS: Trimmed 70669 records to 49769 (keeping 200 days of data) [2025-09-28T01:49:26.295101] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-28T01:49:26.396482] [DEBUG] [LOCAL ] AOS: Primary data saved (49769 records). [2025-09-28T01:49:26.396751] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-28T01:49:26.396918] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AOS took 43.1s. Estimated remaining: 4h 23m 17s. Rate: 8.5 symbols/min [2025-09-28T01:49:26.418847] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-28T01:49:26.574004] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:49:26.634092] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-28T01:49:26.634282] [INFO ] [MAIN ] APH: Loaded 54471 existing records. [2025-09-28T01:49:26.822459] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:49:26.822803] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-28T01:49:26.822896] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-28T01:49:26.823368] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-28T01:49:26.823461] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-28T01:49:26.993046] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-28T01:49:27.213987] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-28T01:49:27.277851] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:49:28.008871] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-28T01:49:28.081666] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-28T01:49:28.577592] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-28T01:49:28.808930] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-28T01:49:29.608909] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-28T01:49:29.919695] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-28T01:49:30.408933] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-28T01:49:30.536286] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-28T01:49:31.143350] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-28T01:49:31.208919] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-28T01:49:32.008874] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-28T01:49:32.299504] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-28T01:49:32.808899] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-28T01:49:32.837996] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-28T01:49:33.608887] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-28T01:49:34.022016] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-28T01:49:34.316480] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-28T01:49:34.408895] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-28T01:49:35.215984] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-28T01:49:35.234901] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-28T01:49:36.008929] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-28T01:49:36.313252] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-28T01:49:36.808905] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-28T01:49:36.894489] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-28T01:49:37.490500] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-28T01:49:37.608913] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-28T01:49:38.210391] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-28T01:49:38.217136] [INFO ] [REMOTE ] APAM: Full fetch complete (51617 records). [2025-09-28T01:49:38.217291] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-28T01:49:38.414143] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-28T01:49:38.636614] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-28T01:49:38.636759] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-28T01:49:38.637449] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-28T01:49:38.637537] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-28T01:49:38.639353] [DEBUG] [LOCAL ] APAM: Trimmed 51617 records to 36969 (keeping 200 days of data) [2025-09-28T01:49:38.869399] [DEBUG] [LOCAL ] APAM: Primary data saved (36969 records). [2025-09-28T01:49:38.869585] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-28T01:49:38.869755] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 34.8s. Estimated remaining: 4h 24m 46s. Rate: 8.5 symbols/min [2025-09-28T01:49:39.046326] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:49:39.046551] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-09-28T01:49:39.046626] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-09-28T01:49:39.046758] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-28T01:49:39.046831] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-28T01:49:39.046946] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-09-28T01:49:39.047018] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-28T01:49:39.211618] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-28T01:49:39.458768] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:49:39.489121] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-28T01:49:40.008895] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-28T01:49:40.392088] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-28T01:49:40.808914] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-28T01:49:40.993350] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-28T01:49:41.608885] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-28T01:49:41.741410] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-28T01:49:42.408884] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-28T01:49:42.793303] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-28T01:49:43.208887] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-28T01:49:43.308672] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-28T01:49:43.991045] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-28T01:49:43.999827] [INFO ] [REMOTE ] APD: Full fetch complete (66640 records). [2025-09-28T01:49:44.000013] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-28T01:49:44.014040] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-28T01:49:44.409292] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-28T01:49:44.409430] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-28T01:49:44.410253] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-28T01:49:44.410348] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-28T01:49:44.411895] [DEBUG] [LOCAL ] APD: Trimmed 66640 records to 46087 (keeping 200 days of data) [2025-09-28T01:49:44.711567] [DEBUG] [LOCAL ] APD: Primary data saved (46087 records). [2025-09-28T01:49:44.712115] [INFO ] [MAIN ] APD: Full history saved. [2025-09-28T01:49:44.712330] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APD took 36.4s. Estimated remaining: 4h 24m 17s. Rate: 8.5 symbols/min [2025-09-28T01:49:44.817123] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-28T01:49:44.899229] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:49:44.965411] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-28T01:49:44.965671] [INFO ] [MAIN ] APO: Loaded 54162 existing records. [2025-09-28T01:49:45.156404] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:49:45.156866] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-28T01:49:45.157023] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-28T01:49:45.157496] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-28T01:49:45.157681] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-28T01:49:45.381783] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-28T01:49:45.588115] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:49:45.608847] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-28T01:49:45.784211] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-28T01:49:46.408885] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-28T01:49:46.653375] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-28T01:49:47.208872] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-28T01:49:47.623031] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-28T01:49:48.008915] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-28T01:49:48.228794] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-28T01:49:48.808890] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-28T01:49:48.875707] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-28T01:49:49.608889] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-28T01:49:49.881026] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-28T01:49:50.408891] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-28T01:49:50.944571] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-28T01:49:51.208893] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-28T01:49:51.288325] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-28T01:49:51.298344] [INFO ] [REMOTE ] APG: Full fetch complete (71652 records). [2025-09-28T01:49:51.298539] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-28T01:49:51.703935] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-28T01:49:51.704065] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-28T01:49:51.704874] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-28T01:49:51.704967] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-28T01:49:51.706511] [DEBUG] [LOCAL ] APG: Trimmed 71652 records to 50931 (keeping 200 days of data) [2025-09-28T01:49:52.008959] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-28T01:49:52.012194] [DEBUG] [LOCAL ] APG: Primary data saved (50931 records). [2025-09-28T01:49:52.013632] [INFO ] [MAIN ] APG: Full history saved. [2025-09-28T01:49:52.013961] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 29.2s. Estimated remaining: 4h 24m 14s. Rate: 8.5 symbols/min [2025-09-28T01:49:52.196447] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:49:52.196863] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-09-28T01:49:52.197006] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-09-28T01:49:52.197159] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-28T01:49:52.197293] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-28T01:49:52.197529] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-09-28T01:49:52.197628] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-28T01:49:52.523912] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-28T01:49:52.618008] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:49:52.808863] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-28T01:49:53.376529] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-28T01:49:53.608862] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-28T01:49:53.714684] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-28T01:49:54.382768] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-28T01:49:54.408928] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-28T01:49:54.606085] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-28T01:49:55.208931] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-28T01:49:56.008913] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-28T01:49:56.308154] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-28T01:49:56.319436] [INFO ] [REMOTE ] APH: Full fetch complete (77683 records). [2025-09-28T01:49:56.319623] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-28T01:49:56.730983] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-28T01:49:56.731109] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-28T01:49:56.731986] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-28T01:49:56.732078] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-28T01:49:56.733741] [DEBUG] [LOCAL ] APH: Trimmed 77683 records to 54471 (keeping 200 days of data) [2025-09-28T01:49:56.825670] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-28T01:49:57.092401] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-09-28T01:49:57.092590] [INFO ] [MAIN ] APH: Full history saved. [2025-09-28T01:49:57.092781] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 30.7s. Estimated remaining: 4h 23m 33s. Rate: 8.5 symbols/min [2025-09-28T01:49:57.282578] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:49:57.316035] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-28T01:49:57.372003] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-28T01:49:57.372193] [INFO ] [MAIN ] APTV: Loaded 52964 existing records. [2025-09-28T01:49:57.484599] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-28T01:49:57.576963] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:49:57.577238] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-28T01:49:57.577317] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-28T01:49:57.577674] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-28T01:49:57.577751] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-28T01:49:57.614174] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-28T01:49:57.958602] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:49:58.059794] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-28T01:49:58.408984] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-28T01:49:59.208911] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-28T01:49:59.595632] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-28T01:50:00.008900] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-28T01:50:00.212772] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-28T01:50:00.809030] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-28T01:50:01.381807] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-28T01:50:01.586172] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-28T01:50:01.608936] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-28T01:50:02.408921] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-28T01:50:02.977260] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-28T01:50:03.208930] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-28T01:50:03.832954] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-28T01:50:04.008920] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-28T01:50:04.505020] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-28T01:50:04.808905] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-28T01:50:05.056081] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-28T01:50:05.608878] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-28T01:50:06.086917] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-28T01:50:06.408939] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-28T01:50:06.782026] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-28T01:50:07.208959] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-28T01:50:07.625188] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-28T01:50:08.008890] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-28T01:50:08.317434] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-28T01:50:08.647305] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-28T01:50:08.738321] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-28T01:50:08.808927] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-28T01:50:09.584452] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-28T01:50:09.608856] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-28T01:50:10.088782] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-28T01:50:10.408943] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-28T01:50:11.118715] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-28T01:50:11.208950] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-28T01:50:12.008967] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-28T01:50:12.808885] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-28T01:50:12.983854] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-28T01:50:13.608909] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-28T01:50:13.786321] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-28T01:50:13.797082] [INFO ] [REMOTE ] APLE: Full fetch complete (74260 records). [2025-09-28T01:50:13.797352] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-28T01:50:14.212548] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-28T01:50:14.212714] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-28T01:50:14.213542] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-28T01:50:14.213632] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-28T01:50:14.215590] [DEBUG] [LOCAL ] APLE: Trimmed 74260 records to 52769 (keeping 200 days of data) [2025-09-28T01:50:14.412269] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-28T01:50:14.583981] [DEBUG] [LOCAL ] APLE: Primary data saved (52769 records). [2025-09-28T01:50:14.584265] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-28T01:50:14.584390] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APLE took 35.7s. Estimated remaining: 4h 26m 22s. Rate: 8.4 symbols/min [2025-09-28T01:50:14.765269] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:50:14.797953] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-28T01:50:14.811479] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-09-28T01:50:14.811825] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-28T01:50:15.109209] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-28T01:50:15.148801] [INFO ] [MAIN ] AQN: Loaded 52684 existing records. [2025-09-28T01:50:15.364349] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-28T01:50:15.434605] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-28T01:50:15.461487] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-28T01:50:15.479849] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-28T01:50:15.506229] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-28T01:50:15.505089] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:50:15.534457] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-28T01:50:15.537821] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-28T01:50:15.538585] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-28T01:50:15.542221] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-28T01:50:15.552882] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-28T01:50:15.554093] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-28T01:50:15.567200] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 54162 (keeping 200 days of data) [2025-09-28T01:50:16.053157] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:50:16.021575] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-28T01:50:16.072875] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-28T01:50:16.361220] [DEBUG] [LOCAL ] APO: Primary data saved (54162 records). [2025-09-28T01:50:16.361511] [INFO ] [MAIN ] APO: Full history saved. [2025-09-28T01:50:16.361704] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APO took 31.6s. Estimated remaining: 4h 24m 45s. Rate: 8.5 symbols/min [2025-09-28T01:50:16.549237] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:50:16.557000] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-28T01:50:16.557155] [INFO ] [MAIN ] AQNB: Loaded 4228 existing records. [2025-09-28T01:50:16.750963] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:50:16.751312] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-28T01:50:16.751399] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-28T01:50:16.751725] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-28T01:50:16.751804] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-28T01:50:16.814102] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-28T01:50:17.116511] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:50:17.608966] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-28T01:50:17.750587] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-28T01:50:18.348167] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-28T01:50:18.408879] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-28T01:50:18.600047] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-28T01:50:18.822302] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-28T01:50:19.208958] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-28T01:50:20.008937] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-28T01:50:20.808904] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-28T01:50:20.913549] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-28T01:50:21.263524] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-28T01:50:21.608977] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-28T01:50:21.736458] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-28T01:50:22.286559] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-28T01:50:22.409017] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-28T01:50:23.208950] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-28T01:50:23.901577] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-28T01:50:23.903841] [INFO ] [REMOTE ] APOS: Full fetch complete (10419 records). [2025-09-28T01:50:23.903964] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-28T01:50:24.013409] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-28T01:50:24.323457] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-28T01:50:24.323770] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-28T01:50:24.324679] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-28T01:50:24.324777] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-28T01:50:24.356389] [DEBUG] [LOCAL ] APOS: Trimmed 10419 records to 7568 (keeping 200 days of data) [2025-09-28T01:50:24.357881] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-28T01:50:24.421739] [DEBUG] [LOCAL ] APOS: Primary data saved (7568 records). [2025-09-28T01:50:24.422009] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-28T01:50:24.422188] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APOS took 32.4s. Estimated remaining: 4h 24m 54s. Rate: 8.4 symbols/min [2025-09-28T01:50:24.643031] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:50:24.706259] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-28T01:50:24.706542] [INFO ] [MAIN ] AR: Loaded 54364 existing records. [2025-09-28T01:50:24.809296] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-28T01:50:24.896033] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:50:24.896263] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-28T01:50:24.896345] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-28T01:50:24.896676] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-28T01:50:24.896755] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-28T01:50:25.307083] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:50:25.602751] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-28T01:50:25.608866] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-28T01:50:25.726441] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-28T01:50:26.408929] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-28T01:50:27.208934] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-28T01:50:27.597731] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-28T01:50:27.738055] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-28T01:50:28.008896] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-28T01:50:28.808897] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-28T01:50:28.966099] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-28T01:50:28.976570] [INFO ] [REMOTE ] APTV: Full fetch complete (76027 records). [2025-09-28T01:50:28.976791] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-28T01:50:29.402097] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-28T01:50:29.404403] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-28T01:50:29.407354] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-28T01:50:29.408234] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-28T01:50:29.410938] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-28T01:50:29.413469] [DEBUG] [LOCAL ] APTV: Trimmed 76027 records to 52964 (keeping 200 days of data) [2025-09-28T01:50:29.612309] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-28T01:50:29.727599] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-28T01:50:29.818787] [DEBUG] [LOCAL ] APTV: Primary data saved (52964 records). [2025-09-28T01:50:29.819044] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-28T01:50:29.819290] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. APTV took 32.7s. Estimated remaining: 4h 24m 19s. Rate: 8.5 symbols/min [2025-09-28T01:50:30.005534] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:50:30.068289] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-28T01:50:30.068503] [INFO ] [MAIN ] ARCO: Loaded 45249 existing records. [2025-09-28T01:50:30.257788] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:50:30.258009] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-28T01:50:30.258098] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-28T01:50:30.258431] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-28T01:50:30.258517] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-28T01:50:30.408961] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-28T01:50:30.627566] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:50:31.208905] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-28T01:50:31.628245] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-28T01:50:32.008905] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-28T01:50:32.243254] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-28T01:50:32.808917] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-28T01:50:32.890980] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-28T01:50:33.608889] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-28T01:50:33.880527] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-28T01:50:34.408888] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-28T01:50:34.665862] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-28T01:50:35.208942] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-28T01:50:35.564202] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-28T01:50:36.008896] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-28T01:50:36.099812] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-28T01:50:36.808903] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-28T01:50:37.305346] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-28T01:50:37.535278] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-28T01:50:37.608887] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-28T01:50:38.408895] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-28T01:50:38.535679] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-28T01:50:39.208967] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-28T01:50:39.438664] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-28T01:50:39.704033] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-28T01:50:40.008943] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-28T01:50:40.808908] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-28T01:50:40.909007] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-28T01:50:41.219047] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-28T01:50:41.586859] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-28T01:50:41.608862] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-28T01:50:42.408903] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-28T01:50:43.207085] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-28T01:50:43.216113] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-28T01:50:44.008892] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-28T01:50:44.043436] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-28T01:50:44.055778] [INFO ] [REMOTE ] AQN: Full fetch complete (75281 records). [2025-09-28T01:50:44.056025] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-28T01:50:44.469563] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-28T01:50:44.469741] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-28T01:50:44.470664] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-28T01:50:44.470754] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-28T01:50:44.472476] [DEBUG] [LOCAL ] AQN: Trimmed 75281 records to 52684 (keeping 200 days of data) [2025-09-28T01:50:44.621875] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-28T01:50:44.821174] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-28T01:50:44.845489] [DEBUG] [LOCAL ] AQN: Primary data saved (52684 records). [2025-09-28T01:50:44.845704] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-28T01:50:44.845834] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. AQN took 30.3s. Estimated remaining: 4h 26m 22s. Rate: 8.4 symbols/min [2025-09-28T01:50:45.047547] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:50:45.067696] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-28T01:50:45.067864] [INFO ] [MAIN ] ARDC: Loaded 14821 existing records. [2025-09-28T01:50:45.259526] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:50:45.260051] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-28T01:50:45.260177] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-28T01:50:45.260588] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-28T01:50:45.260700] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-28T01:50:45.617406] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-28T01:50:45.617499] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-28T01:50:45.660179] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:50:45.687595] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-28T01:50:46.408910] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-28T01:50:46.956529] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-28T01:50:47.208917] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-28T01:50:47.624776] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-28T01:50:47.675311] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-28T01:50:48.008889] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-28T01:50:48.808909] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-28T01:50:48.856428] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-28T01:50:49.608928] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-28T01:50:50.408909] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-28T01:50:50.772585] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-28T01:50:51.185168] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-28T01:50:51.208915] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-28T01:50:51.298838] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-28T01:50:52.008924] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-28T01:50:52.557805] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-28T01:50:52.559464] [INFO ] [REMOTE ] AQNB: Full fetch complete (5886 records). [2025-09-28T01:50:52.559585] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-28T01:50:52.814787] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-28T01:50:52.960048] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-28T01:50:52.960164] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-28T01:50:52.960392] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-28T01:50:52.960473] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-28T01:50:52.960976] [DEBUG] [LOCAL ] AQNB: Trimmed 5886 records to 4228 (keeping 200 days of data) [2025-09-28T01:50:52.996025] [DEBUG] [LOCAL ] AQNB: Primary data saved (4228 records). [2025-09-28T01:50:52.996181] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-28T01:50:52.996326] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQNB took 36.6s. Estimated remaining: 4h 26m 31s. Rate: 8.4 symbols/min [2025-09-28T01:50:53.172262] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:50:53.172603] [DEBUG] [LOCAL ] ARDT: No existing data file found in primary storage. [2025-09-28T01:50:53.172726] [WARN ] [MAIN ] ARDT: No existing data found, performing full refresh instead. [2025-09-28T01:50:53.173019] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-28T01:50:53.173119] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-28T01:50:53.182622] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-09-28T01:50:53.199305] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-28T01:50:53.260302] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-28T01:50:53.336041] [INFO ] [REMOTE ] AR: Full fetch complete (77532 records). [2025-09-28T01:50:53.356891] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-28T01:50:53.613162] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-28T01:50:53.955045] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:50:54.068187] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-28T01:50:54.068310] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-28T01:50:54.069097] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-28T01:50:54.069184] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-28T01:50:54.073152] [DEBUG] [LOCAL ] AR: Trimmed 77532 records to 54364 (keeping 200 days of data) [2025-09-28T01:50:54.408966] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-28T01:50:54.417886] [DEBUG] [LOCAL ] AR: Primary data saved (54364 records). [2025-09-28T01:50:54.418079] [INFO ] [MAIN ] AR: Full history saved. [2025-09-28T01:50:54.418273] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 30.0s. Estimated remaining: 4h 24m 51s. Rate: 8.4 symbols/min [2025-09-28T01:50:54.599505] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:50:54.628532] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-28T01:50:54.698380] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-28T01:50:54.698576] [INFO ] [MAIN ] ARE: Loaded 51319 existing records. [2025-09-28T01:50:54.841324] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-28T01:50:54.909235] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:50:54.909470] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-28T01:50:54.909549] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-28T01:50:54.910060] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-28T01:50:54.910141] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-28T01:50:55.214203] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-28T01:50:55.389071] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:50:55.650837] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-28T01:50:56.008944] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-28T01:50:56.226864] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-28T01:50:56.808908] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-28T01:50:57.608934] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-28T01:50:57.795783] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-28T01:50:58.248320] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-28T01:50:58.408876] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-28T01:50:58.736282] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-28T01:50:59.208875] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-28T01:50:59.651161] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-28T01:50:59.729568] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-28T01:51:00.008893] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-28T01:51:00.808914] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-28T01:51:01.608879] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-28T01:51:01.695354] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-28T01:51:01.704680] [INFO ] [REMOTE ] ARCO: Full fetch complete (65574 records). [2025-09-28T01:51:01.704894] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-28T01:51:01.822637] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-28T01:51:02.158246] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-28T01:51:02.158445] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-28T01:51:02.159674] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-28T01:51:02.159799] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-28T01:51:02.161749] [DEBUG] [LOCAL ] ARCO: Trimmed 65574 records to 45249 (keeping 200 days of data) [2025-09-28T01:51:02.409605] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-28T01:51:02.456289] [DEBUG] [LOCAL ] ARCO: Primary data saved (45249 records). [2025-09-28T01:51:02.456478] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-28T01:51:02.456622] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARCO took 32.6s. Estimated remaining: 4h 24m 59s. Rate: 8.4 symbols/min [2025-09-28T01:51:02.632195] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:51:02.690693] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-28T01:51:02.690961] [INFO ] [MAIN ] ARES: Loaded 50322 existing records. [2025-09-28T01:51:02.885204] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:51:02.885599] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-28T01:51:02.904192] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-28T01:51:02.905425] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-28T01:51:02.912621] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-28T01:51:02.912973] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-28T01:51:03.211749] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-28T01:51:03.293773] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:51:04.008927] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-28T01:51:04.181999] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-28T01:51:04.267956] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-28T01:51:04.808940] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-28T01:51:04.962668] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-28T01:51:05.608918] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-28T01:51:05.738965] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-28T01:51:06.408954] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-28T01:51:06.699483] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-28T01:51:07.208925] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-28T01:51:08.008875] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-28T01:51:08.168212] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-28T01:51:08.621423] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-28T01:51:08.808876] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-28T01:51:09.162364] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-28T01:51:09.608943] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-28T01:51:10.408912] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-28T01:51:10.463438] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-28T01:51:10.529755] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-28T01:51:10.533527] [INFO ] [REMOTE ] ARDC: Full fetch complete (20449 records). [2025-09-28T01:51:10.533715] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-28T01:51:10.919461] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-28T01:51:10.919611] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-28T01:51:10.920090] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-28T01:51:10.920175] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-28T01:51:10.920873] [DEBUG] [LOCAL ] ARDC: Trimmed 20449 records to 14821 (keeping 200 days of data) [2025-09-28T01:51:11.013833] [DEBUG] [LOCAL ] ARDC: Primary data saved (14821 records). [2025-09-28T01:51:11.014005] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-28T01:51:11.014133] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARDC took 26.2s. Estimated remaining: 4h 25m 15s. Rate: 8.4 symbols/min [2025-09-28T01:51:11.193443] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:51:11.208911] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-28T01:51:11.240191] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-28T01:51:11.240387] [INFO ] [MAIN ] ARI: Loaded 44009 existing records. [2025-09-28T01:51:11.425259] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:51:11.425532] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-28T01:51:11.425662] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-28T01:51:11.426109] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-28T01:51:11.426212] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-28T01:51:11.802813] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:51:12.008863] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-28T01:51:12.239084] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-28T01:51:12.808904] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-28T01:51:12.888856] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-28T01:51:13.502813] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-28T01:51:13.608919] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-28T01:51:14.408903] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-28T01:51:14.636690] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-28T01:51:14.720211] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-28T01:51:15.208900] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-28T01:51:16.008899] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-28T01:51:16.369734] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-28T01:51:16.808900] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-28T01:51:17.081408] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-28T01:51:17.120068] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-28T01:51:17.608937] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-28T01:51:18.408933] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-28T01:51:18.671923] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-28T01:51:18.750457] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-28T01:51:19.208918] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-28T01:51:20.008905] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-28T01:51:20.297895] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-28T01:51:20.329369] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-28T01:51:20.808959] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-28T01:51:21.234903] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-28T01:51:21.608919] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-28T01:51:22.408878] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-28T01:51:22.583224] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-28T01:51:23.208930] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-28T01:51:23.522045] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-28T01:51:23.552443] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-28T01:51:23.557967] [INFO ] [REMOTE ] ARDT: Full fetch complete (41352 records). [2025-09-28T01:51:23.558100] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-28T01:51:23.954548] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-28T01:51:23.954687] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-28T01:51:23.955216] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-28T01:51:23.955301] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-28T01:51:23.956310] [DEBUG] [LOCAL ] ARDT: Trimmed 41352 records to 28513 (keeping 200 days of data) [2025-09-28T01:51:24.019709] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-28T01:51:24.145869] [DEBUG] [LOCAL ] ARDT: Primary data saved (28513 records). [2025-09-28T01:51:24.146060] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-28T01:51:24.146205] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 31.1s. Estimated remaining: 4h 26m 42s. Rate: 8.4 symbols/min [2025-09-28T01:51:24.386322] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:51:24.386553] [DEBUG] [LOCAL ] ARIS: No existing data file found in primary storage. [2025-09-28T01:51:24.386625] [WARN ] [MAIN ] ARIS: No existing data found, performing full refresh instead. [2025-09-28T01:51:24.386761] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-28T01:51:24.386834] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-28T01:51:24.386938] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-28T01:51:24.387010] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-28T01:51:24.764566] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:51:24.808871] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-28T01:51:24.919372] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-28T01:51:25.617781] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-28T01:51:25.623461] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-28T01:51:26.408912] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-28T01:51:26.594933] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-28T01:51:26.675275] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-28T01:51:27.208934] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-28T01:51:28.008863] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-28T01:51:28.246085] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-28T01:51:28.808918] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-28T01:51:28.838952] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-28T01:51:29.265491] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-28T01:51:29.275034] [INFO ] [REMOTE ] ARE: Full fetch complete (72589 records). [2025-09-28T01:51:29.275236] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-28T01:51:29.620170] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-28T01:51:29.682814] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-28T01:51:29.682977] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-28T01:51:29.683879] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-28T01:51:29.683983] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-28T01:51:29.685752] [DEBUG] [LOCAL ] ARE: Trimmed 72589 records to 51319 (keeping 200 days of data) [2025-09-28T01:51:30.011055] [DEBUG] [LOCAL ] ARE: Primary data saved (51319 records). [2025-09-28T01:51:30.011285] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-28T01:51:30.011427] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARE took 35.6s. Estimated remaining: 4h 26m 15s. Rate: 8.4 symbols/min [2025-09-28T01:51:30.187922] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:51:30.233031] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-28T01:51:30.233314] [INFO ] [MAIN ] ARLO: Loaded 44493 existing records. [2025-09-28T01:51:30.421681] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:51:30.415386] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-28T01:51:30.422835] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-28T01:51:30.422926] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-28T01:51:30.423248] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-28T01:51:30.423329] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-28T01:51:30.810731] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:51:30.839860] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-28T01:51:31.208887] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-28T01:51:31.355547] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-28T01:51:31.510413] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-28T01:51:32.008913] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-28T01:51:32.565025] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-28T01:51:32.808952] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-28T01:51:33.603106] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-28T01:51:33.611920] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-28T01:51:34.012395] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-28T01:51:34.408913] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-28T01:51:35.185027] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-28T01:51:35.208860] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-28T01:51:35.857308] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-28T01:51:36.008901] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-28T01:51:36.537924] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-28T01:51:36.808933] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-28T01:51:37.608860] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-28T01:51:37.765329] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-28T01:51:37.775398] [INFO ] [REMOTE ] ARES: Full fetch complete (70678 records). [2025-09-28T01:51:37.775631] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-28T01:51:38.169483] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-28T01:51:38.169705] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-28T01:51:38.170462] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-28T01:51:38.170546] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-28T01:51:38.172133] [DEBUG] [LOCAL ] ARES: Trimmed 70678 records to 50322 (keeping 200 days of data) [2025-09-28T01:51:38.409999] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-28T01:51:38.444724] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-28T01:51:38.543440] [DEBUG] [LOCAL ] ARES: Primary data saved (50322 records). [2025-09-28T01:51:38.543635] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-28T01:51:38.543811] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 36.1s. Estimated remaining: 4h 26m 29s. Rate: 8.4 symbols/min [2025-09-28T01:51:38.723868] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:51:38.778566] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-28T01:51:38.778798] [INFO ] [MAIN ] ARMK: Loaded 51112 existing records. [2025-09-28T01:51:38.964302] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:51:38.964532] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-28T01:51:38.964619] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-28T01:51:38.964975] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-28T01:51:38.965053] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-28T01:51:39.220889] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-28T01:51:39.340368] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:51:39.368608] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-28T01:51:39.959705] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-28T01:51:40.008898] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-28T01:51:40.808882] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-28T01:51:40.889444] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-28T01:51:40.898434] [INFO ] [REMOTE ] ARI: Full fetch complete (62715 records). [2025-09-28T01:51:40.898624] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-28T01:51:41.300631] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-28T01:51:41.300897] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-28T01:51:41.301876] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-28T01:51:41.302038] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-28T01:51:41.314531] [DEBUG] [LOCAL ] ARI: Trimmed 62715 records to 44009 (keeping 200 days of data) [2025-09-28T01:51:41.336174] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-28T01:51:41.608950] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-28T01:51:41.612820] [DEBUG] [LOCAL ] ARI: Primary data saved (44009 records). [2025-09-28T01:51:41.613014] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-28T01:51:41.613144] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARI took 30.6s. Estimated remaining: 4h 25m 18s. Rate: 8.4 symbols/min [2025-09-28T01:51:41.787286] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:51:41.834210] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-28T01:51:41.834451] [INFO ] [MAIN ] AROC: Loaded 49733 existing records. [2025-09-28T01:51:42.026480] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:51:42.026784] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-28T01:51:42.026889] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-28T01:51:42.027204] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-28T01:51:42.027294] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-28T01:51:42.402045] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:51:42.414019] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-28T01:51:42.429945] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-28T01:51:43.211824] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-28T01:51:43.215076] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-28T01:51:44.014109] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-28T01:51:44.037897] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-28T01:51:44.808883] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-28T01:51:44.889590] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-28T01:51:45.539439] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-28T01:51:45.608905] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-28T01:51:46.408902] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-28T01:51:46.458832] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-28T01:51:47.208917] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-28T01:51:47.321311] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-28T01:51:47.975471] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-28T01:51:48.008982] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-28T01:51:48.478988] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-28T01:51:48.808962] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-28T01:51:49.608916] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-28T01:51:49.728917] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-28T01:51:50.270033] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-28T01:51:50.408917] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-28T01:51:51.021538] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-28T01:51:51.208921] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-28T01:51:52.008919] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-28T01:51:52.041486] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-28T01:51:52.287010] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-28T01:51:52.295822] [INFO ] [REMOTE ] ARIS: Full fetch complete (60075 records). [2025-09-28T01:51:52.295996] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-28T01:51:52.692574] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-28T01:51:52.692730] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-28T01:51:52.693407] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-28T01:51:52.693491] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-28T01:51:52.694898] [DEBUG] [LOCAL ] ARIS: Trimmed 60075 records to 42624 (keeping 200 days of data) [2025-09-28T01:51:52.810195] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-28T01:51:52.973090] [DEBUG] [LOCAL ] ARIS: Primary data saved (42624 records). [2025-09-28T01:51:52.973325] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-28T01:51:52.973475] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARIS took 28.8s. Estimated remaining: 4h 26m 16s. Rate: 8.4 symbols/min [2025-09-28T01:51:53.147595] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:51:53.212151] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-28T01:51:53.212375] [INFO ] [MAIN ] ARR: Loaded 52809 existing records. [2025-09-28T01:51:53.402259] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:51:53.402520] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-28T01:51:53.402606] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-28T01:51:53.403283] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-28T01:51:53.403372] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-28T01:51:53.614269] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-28T01:51:53.795025] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:51:53.831633] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-28T01:51:54.414945] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-28T01:51:54.425407] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-28T01:51:54.437534] [INFO ] [REMOTE ] ARLO: Full fetch complete (62486 records). [2025-09-28T01:51:54.438030] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-28T01:51:54.857361] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-28T01:51:54.857509] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-28T01:51:54.858330] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-28T01:51:54.858423] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-28T01:51:54.859900] [DEBUG] [LOCAL ] ARLO: Trimmed 62486 records to 44493 (keeping 200 days of data) [2025-09-28T01:51:55.135203] [DEBUG] [LOCAL ] ARLO: Primary data saved (44493 records). [2025-09-28T01:51:55.135405] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-28T01:51:55.135546] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 25.1s. Estimated remaining: 4h 24m 52s. Rate: 8.4 symbols/min [2025-09-28T01:51:55.210218] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-28T01:51:55.322181] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:51:55.360412] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-28T01:51:55.399242] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-28T01:51:55.399426] [INFO ] [MAIN ] ARW: Loaded 33660 existing records. [2025-09-28T01:51:55.593948] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:51:55.594192] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-28T01:51:55.594274] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-28T01:51:55.594785] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-28T01:51:55.594868] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-28T01:51:55.967840] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:51:56.008909] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-28T01:51:56.434608] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-28T01:51:56.808949] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-28T01:51:57.224100] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-28T01:51:57.423583] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-28T01:51:57.608926] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-28T01:51:58.408919] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-28T01:51:58.681696] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-28T01:51:59.021721] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-28T01:51:59.208915] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-28T01:52:00.008937] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-28T01:52:00.378694] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-28T01:52:00.640673] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-28T01:52:00.808908] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-28T01:52:01.608916] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-28T01:52:01.914436] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-28T01:52:02.409012] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-28T01:52:02.702015] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-28T01:52:03.118612] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-28T01:52:03.208912] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-28T01:52:04.008918] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-28T01:52:04.160164] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-28T01:52:04.809245] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-28T01:52:04.811098] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-28T01:52:05.608868] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-28T01:52:05.655937] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-28T01:52:06.408875] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-28T01:52:06.506728] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-28T01:52:06.703990] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-28T01:52:07.208906] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-28T01:52:07.825347] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-28T01:52:08.008907] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-28T01:52:08.808888] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-28T01:52:09.031914] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-28T01:52:09.608957] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-28T01:52:09.901803] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-28T01:52:10.408918] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-28T01:52:10.601250] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-28T01:52:11.208879] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-28T01:52:11.717422] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-28T01:52:12.008876] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-28T01:52:12.123944] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-28T01:52:12.134416] [INFO ] [REMOTE ] ARMK: Full fetch complete (72561 records). [2025-09-28T01:52:12.134639] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-28T01:52:12.548939] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-28T01:52:12.549261] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-28T01:52:12.550238] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-28T01:52:12.550421] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-28T01:52:12.552131] [DEBUG] [LOCAL ] ARMK: Trimmed 72561 records to 51112 (keeping 200 days of data) [2025-09-28T01:52:12.671708] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-28T01:52:12.813444] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-28T01:52:12.919561] [DEBUG] [LOCAL ] ARMK: Primary data saved (51112 records). [2025-09-28T01:52:12.919774] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-28T01:52:12.919904] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 34.4s. Estimated remaining: 4h 27m 26s. Rate: 8.3 symbols/min [2025-09-28T01:52:13.101849] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:52:13.102135] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-28T01:52:13.102213] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-28T01:52:13.102329] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-28T01:52:13.102403] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-28T01:52:13.102487] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-28T01:52:13.102557] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-28T01:52:13.477566] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:52:13.608918] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-28T01:52:14.117141] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-28T01:52:14.187201] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-28T01:52:14.198801] [INFO ] [REMOTE ] AROC: Full fetch complete (70711 records). [2025-09-28T01:52:14.199018] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-28T01:52:14.420275] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-28T01:52:14.640688] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-28T01:52:14.640848] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-28T01:52:14.641633] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-28T01:52:14.641749] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-28T01:52:14.643598] [DEBUG] [LOCAL ] AROC: Trimmed 70711 records to 49733 (keeping 200 days of data) [2025-09-28T01:52:14.967101] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-28T01:52:14.985147] [DEBUG] [LOCAL ] AROC: Primary data saved (49733 records). [2025-09-28T01:52:14.985336] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-28T01:52:14.985476] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. AROC took 33.4s. Estimated remaining: 4h 26m 1s. Rate: 8.4 symbols/min [2025-09-28T01:52:15.168714] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:52:15.223429] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-28T01:52:15.228053] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-28T01:52:15.228413] [INFO ] [MAIN ] AS: Loaded 53854 existing records. [2025-09-28T01:52:15.418684] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:52:15.418945] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-28T01:52:15.419025] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-28T01:52:15.419421] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-28T01:52:15.419498] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-28T01:52:15.794199] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:52:16.008887] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-28T01:52:16.242091] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:52:16.242443] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-28T01:52:16.242536] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:52:16.242614] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-09-28T01:52:16.242711] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:52:16.242788] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-28T01:52:16.242888] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-28T01:52:16.242960] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-28T01:52:16.243058] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-28T01:52:16.243148] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARX took 3.3s. Estimated remaining: 4h 24m 26s. Rate: 8.4 symbols/min [2025-09-28T01:52:16.429418] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:52:16.448106] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-28T01:52:16.448294] [INFO ] [MAIN ] ASA: Loaded 14109 existing records. [2025-09-28T01:52:16.629902] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-28T01:52:16.688343] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:52:16.689611] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-28T01:52:16.689831] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-28T01:52:16.690339] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-28T01:52:16.690428] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-28T01:52:16.810436] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-28T01:52:17.022608] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-28T01:52:17.170784] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:52:17.608945] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-28T01:52:18.386117] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-28T01:52:18.408858] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-28T01:52:18.638108] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-28T01:52:19.208931] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-28T01:52:19.232381] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-28T01:52:20.008936] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-28T01:52:20.573028] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-28T01:52:20.808942] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-28T01:52:21.608884] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-28T01:52:21.751713] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-28T01:52:22.258380] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-28T01:52:22.408931] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-28T01:52:22.425296] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-28T01:52:23.208933] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-28T01:52:24.011962] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-28T01:52:24.014092] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-28T01:52:24.289034] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-28T01:52:24.808919] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-28T01:52:25.405031] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-28T01:52:25.411971] [INFO ] [REMOTE ] ARW: Full fetch complete (47891 records). [2025-09-28T01:52:25.412123] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-28T01:52:25.610088] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-28T01:52:25.844736] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-28T01:52:25.842112] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-28T01:52:25.844909] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-28T01:52:25.845535] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-28T01:52:25.849048] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-28T01:52:25.850721] [DEBUG] [LOCAL ] ARW: Trimmed 47891 records to 33660 (keeping 200 days of data) [2025-09-28T01:52:26.054111] [DEBUG] [LOCAL ] ARW: Primary data saved (33660 records). [2025-09-28T01:52:26.054292] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-28T01:52:26.054449] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARW took 30.9s. Estimated remaining: 4h 24m 58s. Rate: 8.4 symbols/min [2025-09-28T01:52:26.224094] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:52:26.278266] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-28T01:52:26.278455] [INFO ] [MAIN ] ASAN: Loaded 53512 existing records. [2025-09-28T01:52:26.414019] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-28T01:52:26.480577] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:52:26.480933] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-28T01:52:26.481014] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-28T01:52:26.481293] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-28T01:52:26.481375] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-28T01:52:26.851487] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:52:27.208965] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-28T01:52:27.435583] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-28T01:52:27.719103] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-28T01:52:28.008946] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-28T01:52:28.808881] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-28T01:52:29.037223] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-28T01:52:29.608853] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-28T01:52:30.036395] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-28T01:52:30.409007] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-28T01:52:30.425732] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-28T01:52:30.645258] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-28T01:52:31.208912] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-28T01:52:32.008880] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-28T01:52:32.262917] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-28T01:52:32.808971] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-28T01:52:32.951273] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-28T01:52:33.126396] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-28T01:52:33.138525] [INFO ] [REMOTE ] ARR: Full fetch complete (75155 records). [2025-09-28T01:52:33.138806] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-28T01:52:33.580020] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-28T01:52:33.580213] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-28T01:52:33.582168] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-28T01:52:33.582328] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-28T01:52:33.595146] [DEBUG] [LOCAL ] ARR: Trimmed 75155 records to 52809 (keeping 200 days of data) [2025-09-28T01:52:33.609071] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-28T01:52:33.957450] [DEBUG] [LOCAL ] ARR: Primary data saved (52809 records). [2025-09-28T01:52:33.957688] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-28T01:52:33.959715] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ARR took 41.0s. Estimated remaining: 4h 25m 2s. Rate: 8.4 symbols/min [2025-09-28T01:52:34.136166] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:52:34.197772] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-28T01:52:34.198021] [INFO ] [MAIN ] ASB: Loaded 50299 existing records. [2025-09-28T01:52:34.394723] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:52:34.395112] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-28T01:52:34.395448] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-28T01:52:34.395844] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-28T01:52:34.395937] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-28T01:52:34.417144] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-28T01:52:34.787687] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:52:34.835633] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-28T01:52:34.845852] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-28T01:52:35.208977] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-28T01:52:36.008911] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-28T01:52:36.407590] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-28T01:52:36.477837] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-28T01:52:36.808916] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-28T01:52:37.138558] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-28T01:52:37.143329] [INFO ] [REMOTE ] ASA: Full fetch complete (18588 records). [2025-09-28T01:52:37.143434] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-28T01:52:37.532203] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-28T01:52:37.532321] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-28T01:52:37.532724] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-28T01:52:37.532811] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-28T01:52:37.533425] [DEBUG] [LOCAL ] ASA: Trimmed 18588 records to 14109 (keeping 200 days of data) [2025-09-28T01:52:37.609165] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-28T01:52:37.635287] [DEBUG] [LOCAL ] ASA: Primary data saved (14109 records). [2025-09-28T01:52:37.635482] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-28T01:52:37.635631] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ASA took 21.4s. Estimated remaining: 4h 24m 4s. Rate: 8.4 symbols/min [2025-09-28T01:52:37.821920] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:52:37.832569] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-28T01:52:37.832726] [INFO ] [MAIN ] ASBA: Loaded 3458 existing records. [2025-09-28T01:52:38.028330] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:52:38.028676] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-28T01:52:38.028761] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-28T01:52:38.029485] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-28T01:52:38.029566] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-28T01:52:38.399566] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:52:38.408848] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-28T01:52:38.733783] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-28T01:52:39.024215] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-28T01:52:39.214070] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-28T01:52:39.234461] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-28T01:52:39.629999] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-28T01:52:40.008910] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-28T01:52:40.457900] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-28T01:52:40.808977] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-28T01:52:41.608954] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-28T01:52:42.393294] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-28T01:52:42.408860] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-28T01:52:43.208874] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-28T01:52:43.493215] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-28T01:52:44.008889] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-28T01:52:44.363336] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-28T01:52:44.808945] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-28T01:52:44.960701] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-28T01:52:45.608938] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-28T01:52:45.947476] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-28T01:52:45.980429] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-28T01:52:46.414055] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-28T01:52:46.434931] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-28T01:52:47.208915] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-28T01:52:48.008904] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-28T01:52:48.252709] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-28T01:52:48.562494] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-28T01:52:48.808877] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-28T01:52:49.047624] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-28T01:52:49.374542] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-28T01:52:49.608933] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-28T01:52:50.151889] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-28T01:52:50.408906] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-28T01:52:51.208929] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-28T01:52:52.008882] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-28T01:52:52.173605] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-28T01:52:52.619520] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-28T01:52:52.808915] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-28T01:52:53.079034] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-28T01:52:53.394864] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-28T01:52:53.608949] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-28T01:52:54.408904] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-28T01:52:55.208896] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-28T01:52:55.645725] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-28T01:52:55.713713] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-28T01:52:55.714966] [INFO ] [REMOTE ] ASBA: Full fetch complete (5235 records). [2025-09-28T01:52:55.715086] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-28T01:52:56.014358] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-28T01:52:56.113439] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-28T01:52:56.113679] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-28T01:52:56.113991] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-28T01:52:56.114087] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-28T01:52:56.114595] [DEBUG] [LOCAL ] ASBA: Trimmed 5235 records to 3458 (keeping 200 days of data) [2025-09-28T01:52:56.138874] [DEBUG] [LOCAL ] ASBA: Primary data saved (3458 records). [2025-09-28T01:52:56.139039] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-28T01:52:56.139233] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ASBA took 18.5s. Estimated remaining: 4h 26m 41s. Rate: 8.3 symbols/min [2025-09-28T01:52:56.323600] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:52:56.324116] [DEBUG] [LOCAL ] ASC: No existing data file found in primary storage. [2025-09-28T01:52:56.324196] [WARN ] [MAIN ] ASC: No existing data found, performing full refresh instead. [2025-09-28T01:52:56.342063] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-28T01:52:56.352868] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-28T01:52:56.353863] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-09-28T01:52:56.356113] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-28T01:52:56.356368] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-28T01:52:56.446950] [INFO ] [REMOTE ] AS: Full fetch complete (76522 records). [2025-09-28T01:52:56.468354] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-28T01:52:56.822862] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-28T01:52:57.071705] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:52:57.191494] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-28T01:52:57.191689] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-28T01:52:57.192602] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-28T01:52:57.192726] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-28T01:52:57.194978] [DEBUG] [LOCAL ] AS: Trimmed 76522 records to 53854 (keeping 200 days of data) [2025-09-28T01:52:57.550502] [DEBUG] [LOCAL ] AS: Primary data saved (53854 records). [2025-09-28T01:52:57.550837] [INFO ] [MAIN ] AS: Full history saved. [2025-09-28T01:52:57.551051] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. AS took 42.6s. Estimated remaining: 4h 25m 11s. Rate: 8.4 symbols/min [2025-09-28T01:52:57.617257] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-28T01:52:57.741580] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:52:57.742822] [DEBUG] [LOCAL ] ASG: No existing data file found in primary storage. [2025-09-28T01:52:57.743006] [WARN ] [MAIN ] ASG: No existing data found, performing full refresh instead. [2025-09-28T01:52:57.743235] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-28T01:52:57.743312] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-28T01:52:57.743397] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-28T01:52:57.743471] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-28T01:52:58.144831] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:52:58.316630] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-28T01:52:58.408956] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-28T01:52:58.576730] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-28T01:52:59.196896] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-28T01:52:59.214055] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-28T01:52:59.227385] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-28T01:53:00.008940] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-28T01:53:00.808965] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-28T01:53:01.455991] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-28T01:53:01.608925] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-28T01:53:01.884373] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-28T01:53:01.946583] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-28T01:53:02.408912] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-28T01:53:02.881678] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-28T01:53:03.208911] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-28T01:53:03.780314] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-28T01:53:04.008903] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-28T01:53:04.808939] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-28T01:53:05.271885] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-28T01:53:05.284198] [INFO ] [REMOTE ] ASAN: Full fetch complete (76542 records). [2025-09-28T01:53:05.284479] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-28T01:53:05.610750] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-28T01:53:05.730611] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-28T01:53:05.730827] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-28T01:53:05.731996] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-28T01:53:05.745963] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-28T01:53:05.759948] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-28T01:53:05.773160] [DEBUG] [LOCAL ] ASAN: Trimmed 76542 records to 53512 (keeping 200 days of data) [2025-09-28T01:53:05.891835] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-28T01:53:06.125548] [DEBUG] [LOCAL ] ASAN: Primary data saved (53512 records). [2025-09-28T01:53:06.125802] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-28T01:53:06.125957] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASAN took 40.1s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-09-28T01:53:06.299848] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:53:06.323759] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-28T01:53:06.323936] [INFO ] [MAIN ] ASGI: Loaded 22711 existing records. [2025-09-28T01:53:06.414587] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-28T01:53:06.508920] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:53:06.509156] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-28T01:53:06.509237] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-28T01:53:06.509508] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-28T01:53:06.509586] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-28T01:53:06.871693] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:53:07.208884] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-28T01:53:07.283520] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-28T01:53:08.008944] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-28T01:53:08.037680] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-28T01:53:08.096525] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-28T01:53:08.808985] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-28T01:53:09.608914] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-28T01:53:09.761580] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-28T01:53:09.771759] [INFO ] [REMOTE ] ASB: Full fetch complete (71577 records). [2025-09-28T01:53:09.771958] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-28T01:53:10.177429] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-28T01:53:10.177578] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-28T01:53:10.178460] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-28T01:53:10.178603] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-28T01:53:10.180427] [DEBUG] [LOCAL ] ASB: Trimmed 71577 records to 50299 (keeping 200 days of data) [2025-09-28T01:53:10.299741] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-28T01:53:10.432865] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-28T01:53:10.541067] [DEBUG] [LOCAL ] ASB: Primary data saved (50299 records). [2025-09-28T01:53:10.541317] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-28T01:53:10.542135] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASB took 36.6s. Estimated remaining: 4h 24m 37s. Rate: 8.4 symbols/min [2025-09-28T01:53:10.721144] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:53:10.760357] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-28T01:53:10.781770] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-28T01:53:10.781964] [INFO ] [MAIN ] ASGN: Loaded 36554 existing records. [2025-09-28T01:53:10.962243] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:53:10.962495] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-28T01:53:10.962574] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-28T01:53:10.962863] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-28T01:53:10.962939] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-28T01:53:11.214068] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-28T01:53:11.404105] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:53:11.484892] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-28T01:53:12.008897] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-28T01:53:12.347988] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-28T01:53:12.808910] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-28T01:53:13.394991] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-28T01:53:13.608898] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-28T01:53:13.930108] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-28T01:53:14.408923] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-28T01:53:15.134522] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-28T01:53:15.208866] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-28T01:53:15.467227] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-28T01:53:16.008898] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-28T01:53:16.680885] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-28T01:53:16.808929] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-28T01:53:17.529620] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-28T01:53:17.608874] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-28T01:53:18.087084] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-28T01:53:18.408973] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-28T01:53:19.157831] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-28T01:53:19.208872] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-28T01:53:19.946519] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-28T01:53:20.008955] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-28T01:53:20.422952] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-28T01:53:20.752183] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-28T01:53:20.808873] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-28T01:53:21.529466] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-28T01:53:21.533760] [INFO ] [REMOTE ] ASG: Full fetch complete (31365 records). [2025-09-28T01:53:21.533894] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-28T01:53:21.614049] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-28T01:53:21.906895] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-28T01:53:21.907051] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-28T01:53:21.907725] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-28T01:53:21.907815] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-28T01:53:21.908863] [DEBUG] [LOCAL ] ASG: Trimmed 31365 records to 20695 (keeping 200 days of data) [2025-09-28T01:53:22.038443] [DEBUG] [LOCAL ] ASG: Primary data saved (20695 records). [2025-09-28T01:53:22.038693] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-28T01:53:22.038843] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASG took 24.5s. Estimated remaining: 4h 25m 31s. Rate: 8.3 symbols/min [2025-09-28T01:53:22.408893] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-28T01:53:22.664251] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-28T01:53:23.209002] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-28T01:53:23.798253] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-28T01:53:23.811827] [INFO ] [REMOTE ] ASC: Full fetch complete (56905 records). [2025-09-28T01:53:23.812202] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-28T01:53:24.039777] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-28T01:53:24.202592] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-28T01:53:24.202773] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-28T01:53:24.203555] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-28T01:53:24.203636] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-28T01:53:24.205342] [DEBUG] [LOCAL ] ASC: Trimmed 56905 records to 38153 (keeping 200 days of data) [2025-09-28T01:53:24.454417] [DEBUG] [LOCAL ] ASC: Primary data saved (38153 records). [2025-09-28T01:53:24.454710] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-28T01:53:24.454852] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASC took 28.3s. Estimated remaining: 4h 24m 17s. Rate: 8.4 symbols/min [2025-09-28T01:53:24.752479] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-28T01:53:24.808942] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-28T01:53:25.139422] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-28T01:53:25.608970] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-28T01:53:26.289397] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-28T01:53:26.408942] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-28T01:53:26.657825] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-28T01:53:27.208994] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-28T01:53:27.442865] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-28T01:53:27.974950] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-28T01:53:28.008854] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-28T01:53:28.808987] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-28T01:53:29.064019] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-28T01:53:29.608985] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-28T01:53:30.420331] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-28T01:53:30.429148] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-28T01:53:30.814958] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-28T01:53:31.208921] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-28T01:53:31.726778] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-28T01:53:31.939293] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-28T01:53:32.008874] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-28T01:53:32.809075] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-28T01:53:33.003196] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-28T01:53:33.010287] [INFO ] [REMOTE ] ASGI: Full fetch complete (33468 records). [2025-09-28T01:53:33.010502] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-28T01:53:33.383508] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-28T01:53:33.383681] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-28T01:53:33.384256] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-28T01:53:33.384344] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-28T01:53:33.385366] [DEBUG] [LOCAL ] ASGI: Trimmed 33468 records to 22711 (keeping 200 days of data) [2025-09-28T01:53:33.529780] [DEBUG] [LOCAL ] ASGI: Primary data saved (22711 records). [2025-09-28T01:53:33.530002] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-28T01:53:33.530149] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGI took 27.4s. Estimated remaining: 4h 24m 36s. Rate: 8.4 symbols/min [2025-09-28T01:53:34.102131] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-28T01:53:34.109933] [INFO ] [REMOTE ] ASGN: Full fetch complete (51932 records). [2025-09-28T01:53:34.110098] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-28T01:53:34.496959] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-28T01:53:34.497159] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-28T01:53:34.498359] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-28T01:53:34.498467] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-28T01:53:34.500428] [DEBUG] [LOCAL ] ASGN: Trimmed 51932 records to 36554 (keeping 200 days of data) [2025-09-28T01:53:34.741278] [DEBUG] [LOCAL ] ASGN: Primary data saved (36554 records). [2025-09-28T01:53:34.741551] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-28T01:53:34.742211] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 24.2s. Estimated remaining: 4h 23m 7s. Rate: 8.4 symbols/min [2025-09-28T01:53:35.332479] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:53:35.383318] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:53:35.504065] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:53:35.527746] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:53:35.549690] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-28T01:53:35.552287] [INFO ] [MAIN ] ASIX: Loaded 22834 existing records. [2025-09-28T01:53:35.614636] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-28T01:53:35.648882] [INFO ] [MAIN ] ASR: Loaded 9381 existing records. [2025-09-28T01:53:35.767832] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-28T01:53:35.818930] [INFO ] [MAIN ] ASH: Loaded 38339 existing records. [2025-09-28T01:53:35.957052] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:53:36.066552] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-28T01:53:36.061560] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-28T01:53:36.095408] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:53:36.106682] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-28T01:53:36.106562] [INFO ] [MAIN ] ASPN: Loaded 50293 existing records. [2025-09-28T01:53:36.147716] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-28T01:53:36.178973] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-28T01:53:36.194361] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-28T01:53:36.204848] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-28T01:53:36.282454] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:53:36.321400] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-28T01:53:36.315918] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-28T01:53:36.348691] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-28T01:53:36.375490] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-28T01:53:36.370205] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-28T01:53:36.399625] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-28T01:53:36.750721] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:53:36.857478] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-28T01:53:36.902328] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-28T01:53:36.952121] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-28T01:53:36.961010] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-28T01:53:37.599397] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:53:37.675557] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-28T01:53:37.754628] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:53:37.773259] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-28T01:53:37.939150] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:53:37.969081] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-28T01:53:37.999739] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:53:38.000162] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-28T01:53:38.620852] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-28T01:53:38.623274] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-28T01:53:38.828002] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-28T01:53:38.831760] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-28T01:53:39.367170] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-28T01:53:39.374500] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-28T01:53:39.479617] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-28T01:53:39.481980] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-28T01:53:39.712227] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-28T01:53:39.840682] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-28T01:53:39.972352] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-28T01:53:40.008851] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-28T01:53:40.590528] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-28T01:53:40.617041] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-28T01:53:40.808902] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-28T01:53:41.608944] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-28T01:53:42.261583] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-28T01:53:42.408905] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-28T01:53:43.208954] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-28T01:53:43.451600] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-28T01:53:43.832276] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-28T01:53:44.008921] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-28T01:53:44.040064] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-28T01:53:44.808888] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-28T01:53:44.916832] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-28T01:53:45.609002] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-28T01:53:46.408918] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-28T01:53:46.757533] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-28T01:53:47.208895] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-28T01:53:47.385606] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-28T01:53:47.420262] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-28T01:53:48.008940] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-28T01:53:48.714628] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-28T01:53:48.734910] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-28T01:53:48.808896] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-28T01:53:49.533639] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-28T01:53:49.608885] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-28T01:53:50.408904] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-28T01:53:50.936063] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-28T01:53:51.208972] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-28T01:53:51.882096] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-28T01:53:51.966029] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-28T01:53:52.008976] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-28T01:53:52.808925] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-28T01:53:53.608895] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-28T01:53:53.785134] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-28T01:53:53.850440] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-28T01:53:54.408914] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-28T01:53:54.600594] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-28T01:53:55.208898] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-28T01:53:55.848125] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-28T01:53:56.008872] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-28T01:53:56.025961] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-28T01:53:56.808917] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-28T01:53:57.217459] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-28T01:53:57.224689] [INFO ] [REMOTE ] ASH: Full fetch complete (54837 records). [2025-09-28T01:53:57.224852] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-28T01:53:57.614471] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-28T01:53:57.628766] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-28T01:53:57.630488] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-28T01:53:57.631334] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-28T01:53:57.631428] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-28T01:53:57.633072] [DEBUG] [LOCAL ] ASH: Trimmed 54837 records to 38339 (keeping 200 days of data) [2025-09-28T01:53:57.870192] [DEBUG] [LOCAL ] ASH: Primary data saved (38339 records). [2025-09-28T01:53:57.870400] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-28T01:53:57.870534] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASH took 23.1s. Estimated remaining: 4h 26m 39s. Rate: 8.3 symbols/min [2025-09-28T01:53:58.056663] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:53:58.107971] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-28T01:53:58.108180] [INFO ] [MAIN ] ASX: Loaded 53639 existing records. [2025-09-28T01:53:58.303718] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:53:58.304550] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-28T01:53:58.304928] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-28T01:53:58.305288] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-28T01:53:58.305368] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-28T01:53:58.415836] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-28T01:53:58.698206] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:53:58.730965] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-28T01:53:58.927687] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-28T01:53:59.208878] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-28T01:53:59.273372] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-28T01:54:00.008942] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-28T01:54:00.415730] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-28T01:54:00.808911] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-28T01:54:01.608910] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-28T01:54:01.949941] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-28T01:54:01.955007] [INFO ] [REMOTE ] ASIX: Full fetch complete (29913 records). [2025-09-28T01:54:01.955162] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-28T01:54:02.354517] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-28T01:54:02.394797] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-28T01:54:02.395453] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-28T01:54:02.396391] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-28T01:54:02.396521] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-28T01:54:02.397556] [DEBUG] [LOCAL ] ASIX: Trimmed 29913 records to 22834 (keeping 200 days of data) [2025-09-28T01:54:02.450775] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-28T01:54:02.552029] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-28T01:54:02.552467] [DEBUG] [LOCAL ] ASIX: Primary data saved (22834 records). [2025-09-28T01:54:02.555424] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-28T01:54:02.555551] [INFO ] [REMOTE ] ASR: Full fetch complete (12375 records). [2025-09-28T01:54:02.555771] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 27.8s. Estimated remaining: 4h 25m 57s. Rate: 8.3 symbols/min [2025-09-28T01:54:02.555915] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-28T01:54:02.903699] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:54:03.138620] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-28T01:54:03.138757] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-28T01:54:03.139059] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-28T01:54:03.139143] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-28T01:54:03.139833] [DEBUG] [LOCAL ] ASR: Trimmed 12375 records to 9381 (keeping 200 days of data) [2025-09-28T01:54:03.198183] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-28T01:54:03.199133] [INFO ] [MAIN ] ATEN: Loaded 40398 existing records. [2025-09-28T01:54:03.221904] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-28T01:54:03.409289] [DEBUG] [LOCAL ] ASR: Primary data saved (9381 records). [2025-09-28T01:54:03.407424] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:54:03.409491] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-28T01:54:03.409711] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-28T01:54:03.409905] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-28T01:54:03.409842] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASR took 28.7s. Estimated remaining: 4h 24m 23s. Rate: 8.4 symbols/min [2025-09-28T01:54:03.443465] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-28T01:54:03.468414] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-28T01:54:03.762361] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:54:03.985638] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:54:04.001762] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-28T01:54:04.002030] [INFO ] [MAIN ] ATGE: Loaded 32251 existing records. [2025-09-28T01:54:04.035025] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-28T01:54:04.246251] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:54:04.246839] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-28T01:54:04.246967] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-28T01:54:04.247621] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-28T01:54:04.263303] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-28T01:54:04.324356] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-28T01:54:04.647724] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:54:04.808877] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-28T01:54:05.250535] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-28T01:54:05.608883] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-28T01:54:05.716542] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-28T01:54:06.166695] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-28T01:54:06.408977] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-28T01:54:07.208890] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-28T01:54:07.449803] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-28T01:54:07.927422] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-28T01:54:08.008937] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-28T01:54:08.808935] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-28T01:54:09.075599] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-28T01:54:09.608885] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-28T01:54:09.790433] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-28T01:54:10.259922] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-28T01:54:10.408930] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-28T01:54:11.150053] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-28T01:54:11.208899] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-28T01:54:12.008905] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-28T01:54:12.308974] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-28T01:54:12.465084] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-28T01:54:12.808923] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-28T01:54:13.608955] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-28T01:54:13.848829] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-28T01:54:14.408877] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-28T01:54:14.451054] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-28T01:54:15.193282] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-28T01:54:15.208851] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-28T01:54:15.915926] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-28T01:54:16.008895] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-28T01:54:16.808876] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-28T01:54:17.088902] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-28T01:54:17.355599] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-28T01:54:17.366494] [INFO ] [REMOTE ] ASPN: Full fetch complete (72282 records). [2025-09-28T01:54:17.366756] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-28T01:54:17.614072] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-28T01:54:17.784033] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-28T01:54:17.784156] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-28T01:54:17.784941] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-28T01:54:17.785031] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-28T01:54:17.786595] [DEBUG] [LOCAL ] ASPN: Trimmed 72282 records to 50293 (keeping 200 days of data) [2025-09-28T01:54:18.075098] [DEBUG] [LOCAL ] ASPN: Primary data saved (50293 records). [2025-09-28T01:54:18.075275] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-28T01:54:18.075406] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 43.3s. Estimated remaining: 4h 25m 57s. Rate: 8.3 symbols/min [2025-09-28T01:54:18.259132] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:54:18.292472] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-28T01:54:18.292685] [INFO ] [MAIN ] ATHM: Loaded 33015 existing records. [2025-09-28T01:54:18.423799] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-28T01:54:18.519524] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:54:18.519778] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-28T01:54:18.519876] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-28T01:54:18.514371] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-28T01:54:18.527883] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-28T01:54:18.528158] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-28T01:54:18.906243] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:54:19.155602] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-28T01:54:19.208913] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-28T01:54:20.008921] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-28T01:54:20.234865] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-28T01:54:20.417544] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-28T01:54:20.808927] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-28T01:54:21.394797] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-28T01:54:21.608966] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-28T01:54:21.952562] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-28T01:54:22.408968] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-28T01:54:23.208880] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-28T01:54:23.344545] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-28T01:54:23.948026] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-28T01:54:24.008922] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-28T01:54:24.670187] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-28T01:54:24.808948] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-28T01:54:25.608882] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-28T01:54:25.982927] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-28T01:54:26.342195] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-28T01:54:26.408911] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-28T01:54:26.557905] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-28T01:54:27.208965] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-28T01:54:27.778222] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-28T01:54:27.786188] [INFO ] [REMOTE ] ATEN: Full fetch complete (57407 records). [2025-09-28T01:54:27.786384] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-28T01:54:28.018219] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-28T01:54:28.191438] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-28T01:54:28.191563] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-28T01:54:28.192253] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-28T01:54:28.192338] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-28T01:54:28.193790] [DEBUG] [LOCAL ] ATEN: Trimmed 57407 records to 40398 (keeping 200 days of data) [2025-09-28T01:54:28.447902] [DEBUG] [LOCAL ] ATEN: Primary data saved (40398 records). [2025-09-28T01:54:28.448076] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-28T01:54:28.448207] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ATEN took 25.9s. Estimated remaining: 4h 26m 32s. Rate: 8.3 symbols/min [2025-09-28T01:54:28.626436] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:54:28.637144] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-28T01:54:28.637317] [INFO ] [MAIN ] ATHS: Loaded 7145 existing records. [2025-09-28T01:54:28.810757] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-28T01:54:28.839151] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:54:28.840955] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-28T01:54:28.841330] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-28T01:54:28.850334] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-28T01:54:28.863597] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-28T01:54:28.904543] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-28T01:54:29.258946] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:54:29.608880] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-28T01:54:29.931483] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-28T01:54:29.983377] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-28T01:54:30.408946] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-28T01:54:30.710983] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-28T01:54:31.208945] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-28T01:54:32.003873] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-28T01:54:32.008841] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-28T01:54:32.249937] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-28T01:54:32.260610] [INFO ] [REMOTE ] ASX: Full fetch complete (76613 records). [2025-09-28T01:54:32.260823] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-28T01:54:32.457802] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-28T01:54:32.689314] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-28T01:54:32.689446] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-28T01:54:32.690278] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-28T01:54:32.690367] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-28T01:54:32.692227] [DEBUG] [LOCAL ] ASX: Trimmed 76613 records to 53639 (keeping 200 days of data) [2025-09-28T01:54:32.809346] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-28T01:54:33.024745] [DEBUG] [LOCAL ] ASX: Primary data saved (53639 records). [2025-09-28T01:54:33.024922] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-28T01:54:33.025047] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ASX took 35.2s. Estimated remaining: 4h 25m 49s. Rate: 8.3 symbols/min [2025-09-28T01:54:33.205432] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:54:33.258920] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-28T01:54:33.259116] [INFO ] [MAIN ] ATI: Loaded 52283 existing records. [2025-09-28T01:54:33.454991] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:54:33.455235] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-28T01:54:33.455315] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-28T01:54:33.455825] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-28T01:54:33.455906] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-28T01:54:33.614072] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-28T01:54:33.838264] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:54:34.309305] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-28T01:54:34.311122] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-28T01:54:34.408904] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-28T01:54:35.208949] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-28T01:54:36.008926] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-28T01:54:36.098132] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-28T01:54:36.808981] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-28T01:54:37.102092] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-28T01:54:37.238396] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-28T01:54:37.244292] [INFO ] [REMOTE ] ATGE: Full fetch complete (46245 records). [2025-09-28T01:54:37.244498] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-28T01:54:37.615947] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-28T01:54:37.644807] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-28T01:54:37.686223] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-28T01:54:37.686416] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-28T01:54:37.687288] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-28T01:54:37.687400] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-28T01:54:37.689327] [DEBUG] [LOCAL ] ATGE: Trimmed 46245 records to 32251 (keeping 200 days of data) [2025-09-28T01:54:37.897498] [DEBUG] [LOCAL ] ATGE: Primary data saved (32251 records). [2025-09-28T01:54:37.897750] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-28T01:54:37.897924] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATGE took 34.5s. Estimated remaining: 4h 25m 10s. Rate: 8.3 symbols/min [2025-09-28T01:54:38.073043] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:54:38.117725] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-28T01:54:38.117923] [INFO ] [MAIN ] ATKR: Loaded 36196 existing records. [2025-09-28T01:54:38.299453] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:54:38.299784] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-28T01:54:38.299869] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-28T01:54:38.300396] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-28T01:54:38.300482] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-28T01:54:38.414091] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-28T01:54:38.667406] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:54:39.145277] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-28T01:54:39.208861] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-28T01:54:39.294324] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-28T01:54:39.606113] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-28T01:54:40.008962] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-28T01:54:40.808950] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-28T01:54:41.608973] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-28T01:54:41.685843] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-28T01:54:42.349521] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-28T01:54:42.406077] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-28T01:54:42.408761] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-28T01:54:43.097275] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-28T01:54:43.208916] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-28T01:54:44.008965] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-28T01:54:44.632951] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-28T01:54:44.808944] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-28T01:54:45.555852] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-28T01:54:45.608915] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-28T01:54:45.869968] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-28T01:54:46.408964] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-28T01:54:47.025413] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-28T01:54:47.036181] [INFO ] [REMOTE ] ATHS: Full fetch complete (10052 records). [2025-09-28T01:54:47.049718] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-28T01:54:47.099357] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-28T01:54:47.213967] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-28T01:54:47.461838] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-28T01:54:47.462009] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-28T01:54:47.462586] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-28T01:54:47.462770] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-28T01:54:47.464969] [DEBUG] [LOCAL ] ATHS: Trimmed 10052 records to 7145 (keeping 200 days of data) [2025-09-28T01:54:47.517630] [DEBUG] [LOCAL ] ATHS: Primary data saved (7145 records). [2025-09-28T01:54:47.517833] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-28T01:54:47.518159] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHS took 19.1s. Estimated remaining: 4h 25m 35s. Rate: 8.3 symbols/min [2025-09-28T01:54:47.693398] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:54:47.755008] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-28T01:54:47.755196] [INFO ] [MAIN ] ATMU: Loaded 40274 existing records. [2025-09-28T01:54:47.936829] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:54:47.937087] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-28T01:54:47.937191] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-28T01:54:47.937538] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-28T01:54:47.937680] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-28T01:54:48.014050] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-28T01:54:48.331076] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:54:48.557683] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-28T01:54:48.808922] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-28T01:54:49.608904] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-28T01:54:49.858467] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-28T01:54:50.397537] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-28T01:54:50.409255] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-28T01:54:50.655119] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-28T01:54:51.208929] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-28T01:54:52.008923] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-28T01:54:52.293617] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-28T01:54:52.594141] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-28T01:54:52.808900] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-28T01:54:53.550705] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-28T01:54:53.608942] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-28T01:54:54.159082] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-28T01:54:54.408906] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-28T01:54:55.208917] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-28T01:54:55.399022] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-28T01:54:55.849246] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-28T01:54:56.008907] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-28T01:54:56.200188] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-28T01:54:56.808906] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-28T01:54:57.608904] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-28T01:54:57.845720] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-28T01:54:58.061868] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-28T01:54:58.408894] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-28T01:54:59.047286] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-28T01:54:59.208900] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-28T01:55:00.008898] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-28T01:55:00.139916] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-28T01:55:00.418422] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-28T01:55:00.808910] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-28T01:55:01.608943] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-28T01:55:01.824794] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-28T01:55:02.003813] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-28T01:55:02.408925] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-28T01:55:02.986357] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-28T01:55:03.157589] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-28T01:55:03.162879] [INFO ] [REMOTE ] ATHM: Full fetch complete (51599 records). [2025-09-28T01:55:03.163063] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-28T01:55:03.214063] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-28T01:55:03.624470] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-28T01:55:03.624599] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-28T01:55:03.625389] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-28T01:55:03.625474] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-28T01:55:03.626722] [DEBUG] [LOCAL ] ATHM: Trimmed 51599 records to 33015 (keeping 200 days of data) [2025-09-28T01:55:03.841364] [DEBUG] [LOCAL ] ATHM: Primary data saved (33015 records). [2025-09-28T01:55:03.841562] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-28T01:55:03.841715] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHM took 45.8s. Estimated remaining: 4h 27m 26s. Rate: 8.2 symbols/min [2025-09-28T01:55:04.015934] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:55:04.013982] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-28T01:55:04.066997] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-28T01:55:04.067212] [INFO ] [MAIN ] ATO: Loaded 42489 existing records. [2025-09-28T01:55:04.256977] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:55:04.257263] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-28T01:55:04.257346] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-28T01:55:04.257788] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-28T01:55:04.257868] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-28T01:55:04.669636] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:55:04.808887] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-28T01:55:04.928300] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-28T01:55:04.938943] [INFO ] [REMOTE ] ATI: Full fetch complete (73906 records). [2025-09-28T01:55:04.939147] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-28T01:55:05.366554] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-28T01:55:05.366794] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-28T01:55:05.368079] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-28T01:55:05.368207] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-28T01:55:05.372531] [DEBUG] [LOCAL ] ATI: Trimmed 73906 records to 52283 (keeping 200 days of data) [2025-09-28T01:55:05.500631] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-28T01:55:05.626013] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-28T01:55:05.740444] [DEBUG] [LOCAL ] ATI: Primary data saved (52283 records). [2025-09-28T01:55:05.740701] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-28T01:55:05.740858] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATI took 32.7s. Estimated remaining: 4h 26m 9s. Rate: 8.3 symbols/min [2025-09-28T01:55:05.921137] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:55:05.962474] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-28T01:55:05.962750] [INFO ] [MAIN ] ATR: Loaded 30839 existing records. [2025-09-28T01:55:06.170483] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:55:06.170827] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-28T01:55:06.170994] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-28T01:55:06.180051] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-28T01:55:06.194211] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-28T01:55:06.201341] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-28T01:55:06.415501] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-28T01:55:06.597267] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:55:06.932260] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-28T01:55:07.208949] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-28T01:55:07.849588] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-28T01:55:08.008905] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-28T01:55:08.611260] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-28T01:55:08.808971] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-28T01:55:09.486922] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-28T01:55:09.494422] [INFO ] [REMOTE ] ATKR: Full fetch complete (53681 records). [2025-09-28T01:55:09.494584] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-28T01:55:09.614009] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-28T01:55:09.906978] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-28T01:55:09.907124] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-28T01:55:09.907853] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-28T01:55:09.907954] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-28T01:55:09.909362] [DEBUG] [LOCAL ] ATKR: Trimmed 53681 records to 36196 (keeping 200 days of data) [2025-09-28T01:55:10.168863] [DEBUG] [LOCAL ] ATKR: Primary data saved (36196 records). [2025-09-28T01:55:10.169050] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-28T01:55:10.170158] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 32.3s. Estimated remaining: 4h 25m 25s. Rate: 8.3 symbols/min [2025-09-28T01:55:10.352997] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:55:10.380760] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-28T01:55:10.403202] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-28T01:55:10.403387] [INFO ] [MAIN ] ATS: Loaded 18145 existing records. [2025-09-28T01:55:10.414668] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-28T01:55:10.602042] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:55:10.602359] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-28T01:55:10.602477] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-28T01:55:10.602772] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-28T01:55:10.602852] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-28T01:55:10.989785] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:55:11.211912] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-28T01:55:11.215397] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-28T01:55:12.004835] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-28T01:55:12.012866] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-28T01:55:12.693794] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-28T01:55:12.808927] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-28T01:55:13.006710] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-28T01:55:13.608920] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-28T01:55:14.271283] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-28T01:55:14.408956] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-28T01:55:14.959624] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-28T01:55:15.208938] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-28T01:55:15.996766] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-28T01:55:16.008860] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-28T01:55:16.750858] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-28T01:55:16.759308] [INFO ] [REMOTE ] ATMU: Full fetch complete (56938 records). [2025-09-28T01:55:16.759450] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-28T01:55:16.814101] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-28T01:55:17.129110] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-28T01:55:17.193770] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-28T01:55:17.193907] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-28T01:55:17.194636] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-28T01:55:17.194761] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-28T01:55:17.196321] [DEBUG] [LOCAL ] ATMU: Trimmed 56938 records to 40274 (keeping 200 days of data) [2025-09-28T01:55:17.456566] [DEBUG] [LOCAL ] ATMU: Primary data saved (40274 records). [2025-09-28T01:55:17.456775] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-28T01:55:17.456963] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATMU took 29.9s. Estimated remaining: 4h 25m 19s. Rate: 8.3 symbols/min [2025-09-28T01:55:17.616586] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-28T01:55:17.643524] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:55:17.690308] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-28T01:55:17.690573] [INFO ] [MAIN ] ATUS: Loaded 49958 existing records. [2025-09-28T01:55:17.877521] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:55:17.877840] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-28T01:55:17.877921] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-28T01:55:17.878201] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-28T01:55:17.878277] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-28T01:55:18.255505] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:55:18.274740] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-28T01:55:18.408912] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-28T01:55:19.208914] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-28T01:55:19.326402] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-28T01:55:19.673335] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-28T01:55:20.008924] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-28T01:55:20.187514] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-28T01:55:20.808920] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-28T01:55:21.205601] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-28T01:55:21.609097] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-28T01:55:21.850938] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-28T01:55:22.408973] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-28T01:55:23.208915] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-28T01:55:23.247978] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-28T01:55:23.778744] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-28T01:55:24.008879] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-28T01:55:24.336414] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-28T01:55:24.808927] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-28T01:55:25.608932] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-28T01:55:25.724039] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-28T01:55:26.074107] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-28T01:55:26.408937] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-28T01:55:26.865027] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-28T01:55:27.208953] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-28T01:55:27.947118] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-28T01:55:28.008886] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-28T01:55:28.741491] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-28T01:55:28.808870] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-28T01:55:29.608913] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-28T01:55:29.760692] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-28T01:55:30.203327] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-28T01:55:30.408935] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-28T01:55:31.030698] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-28T01:55:31.208925] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-28T01:55:31.341355] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-28T01:55:32.008935] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-28T01:55:32.808865] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-28T01:55:32.845466] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-28T01:55:33.516288] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-28T01:55:33.608922] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-28T01:55:33.932474] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-28T01:55:34.408931] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-28T01:55:35.208878] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-28T01:55:35.298202] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-28T01:55:35.378837] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-28T01:55:36.008907] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-28T01:55:36.721060] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-28T01:55:36.735375] [INFO ] [REMOTE ] ATO: Full fetch complete (60452 records). [2025-09-28T01:55:36.735683] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-28T01:55:36.814218] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-28T01:55:37.445828] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-28T01:55:37.445986] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-28T01:55:37.447432] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-28T01:55:37.447585] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-28T01:55:37.449866] [DEBUG] [LOCAL ] ATO: Trimmed 60452 records to 42489 (keeping 200 days of data) [2025-09-28T01:55:37.575438] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-28T01:55:37.583328] [INFO ] [REMOTE ] ATS: Full fetch complete (25623 records). [2025-09-28T01:55:37.586459] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-28T01:55:37.617615] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-28T01:55:37.907509] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-28T01:55:38.217033] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-28T01:55:38.222665] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-28T01:55:38.227273] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-28T01:55:38.228745] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-28T01:55:38.242418] [DEBUG] [LOCAL ] ATS: Trimmed 25623 records to 18145 (keeping 200 days of data) [2025-09-28T01:55:38.352716] [DEBUG] [LOCAL ] ATO: Primary data saved (42489 records). [2025-09-28T01:55:38.353805] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-28T01:55:38.354527] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATO took 34.5s. Estimated remaining: 4h 28m 5s. Rate: 8.2 symbols/min [2025-09-28T01:55:38.408987] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-28T01:55:38.597997] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:55:38.601536] [DEBUG] [LOCAL ] AU: No existing data file found in primary storage. [2025-09-28T01:55:38.604662] [WARN ] [MAIN ] AU: No existing data found, performing full refresh instead. [2025-09-28T01:55:38.605098] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-28T01:55:38.605234] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-28T01:55:38.605959] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-09-28T01:55:38.606315] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-28T01:55:38.869860] [DEBUG] [LOCAL ] ATS: Primary data saved (18145 records). [2025-09-28T01:55:38.897378] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-28T01:55:38.906973] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATS took 28.7s. Estimated remaining: 4h 26m 32s. Rate: 8.2 symbols/min [2025-09-28T01:55:39.170737] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:55:39.213501] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-28T01:55:39.243696] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:55:39.265735] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-28T01:55:39.275308] [INFO ] [REMOTE ] ATR: Full fetch complete (43440 records). [2025-09-28T01:55:39.275536] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-28T01:55:39.563332] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-28T01:55:39.606491] [INFO ] [MAIN ] AUB: Loaded 47072 existing records. [2025-09-28T01:55:39.866964] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-28T01:55:39.877395] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-28T01:55:39.878314] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-28T01:55:39.918196] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-28T01:55:39.941148] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:55:39.941371] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-28T01:55:39.941611] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-28T01:55:39.942235] [DEBUG] [LOCAL ] ATR: Trimmed 43440 records to 30839 (keeping 200 days of data) [2025-09-28T01:55:39.942689] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-28T01:55:39.942772] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-28T01:55:40.464598] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:55:40.466074] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-28T01:55:40.467083] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-28T01:55:40.576166] [DEBUG] [LOCAL ] ATR: Primary data saved (30839 records). [2025-09-28T01:55:40.576392] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-28T01:55:40.576542] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATR took 34.8s. Estimated remaining: 4h 25m 15s. Rate: 8.3 symbols/min [2025-09-28T01:55:40.751335] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:55:40.758924] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-28T01:55:40.759109] [INFO ] [MAIN ] AUNA: Loaded 4966 existing records. [2025-09-28T01:55:40.824486] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-28T01:55:40.945364] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:55:40.945622] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-28T01:55:40.945740] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-28T01:55:40.946057] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-28T01:55:40.946155] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-28T01:55:41.327952] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:55:41.359582] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-28T01:55:41.608922] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-28T01:55:41.999962] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-28T01:55:42.130045] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-28T01:55:42.408934] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-28T01:55:42.635357] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-28T01:55:43.058923] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-28T01:55:43.208906] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-28T01:55:43.809780] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-28T01:55:44.008901] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-28T01:55:44.808913] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-28T01:55:45.608870] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-28T01:55:45.648982] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-28T01:55:46.328796] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-28T01:55:46.408917] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-28T01:55:47.208939] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-28T01:55:47.627971] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-28T01:55:48.009149] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-28T01:55:48.128006] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-28T01:55:48.138240] [INFO ] [REMOTE ] ATUS: Full fetch complete (70932 records). [2025-09-28T01:55:48.138461] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-28T01:55:48.556161] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-28T01:55:48.556427] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-28T01:55:48.557529] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-28T01:55:48.557735] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-28T01:55:48.624976] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-28T01:55:48.633284] [DEBUG] [LOCAL ] ATUS: Trimmed 70932 records to 49958 (keeping 200 days of data) [2025-09-28T01:55:48.828613] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-28T01:55:48.927126] [DEBUG] [LOCAL ] ATUS: Primary data saved (49958 records). [2025-09-28T01:55:48.927322] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-28T01:55:48.927452] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 31.5s. Estimated remaining: 4h 25m 21s. Rate: 8.3 symbols/min [2025-09-28T01:55:49.113408] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:55:49.152765] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-28T01:55:49.152950] [INFO ] [MAIN ] AVA: Loaded 40183 existing records. [2025-09-28T01:55:49.349045] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:55:49.349364] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-28T01:55:49.349449] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-28T01:55:49.349821] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-28T01:55:49.349905] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-28T01:55:49.612768] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-28T01:55:49.737566] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:55:49.818928] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-28T01:55:50.242897] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-28T01:55:50.408902] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-28T01:55:50.514356] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-28T01:55:50.749062] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-28T01:55:51.208949] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-28T01:55:51.647025] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-28T01:55:52.008941] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-28T01:55:52.742681] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-28T01:55:52.808871] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-28T01:55:53.608944] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-28T01:55:54.156887] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-28T01:55:54.408919] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-28T01:55:55.208889] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-28T01:55:55.440847] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-28T01:55:55.574573] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-28T01:55:56.008958] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-28T01:55:56.808912] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-28T01:55:56.950007] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-28T01:55:57.350457] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-28T01:55:57.408253] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-28T01:55:57.608917] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-28T01:55:58.409000] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-28T01:55:58.989162] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-28T01:55:59.162111] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-28T01:55:59.208973] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-28T01:55:59.958892] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-28T01:55:59.963030] [INFO ] [REMOTE ] AUNA: Full fetch complete (7633 records). [2025-09-28T01:55:59.963364] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-28T01:56:00.014282] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-28T01:56:00.368978] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-28T01:56:00.369103] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-28T01:56:00.369386] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-28T01:56:00.369468] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-28T01:56:00.370005] [DEBUG] [LOCAL ] AUNA: Trimmed 7633 records to 4966 (keeping 200 days of data) [2025-09-28T01:56:00.399729] [DEBUG] [LOCAL ] AUNA: Primary data saved (4966 records). [2025-09-28T01:56:00.399853] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-28T01:56:00.399981] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUNA took 19.8s. Estimated remaining: 4h 26m 6s. Rate: 8.2 symbols/min [2025-09-28T01:56:00.579026] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:56:00.590494] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-28T01:56:00.590724] [INFO ] [MAIN ] AVAL: Loaded 9040 existing records. [2025-09-28T01:56:00.775487] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:56:00.775758] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-28T01:56:00.775870] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-28T01:56:00.776128] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-28T01:56:00.776240] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-28T01:56:00.819183] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-28T01:56:01.156216] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:56:01.608877] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-28T01:56:01.648171] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-28T01:56:02.408980] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-28T01:56:02.459469] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-28T01:56:02.887501] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-28T01:56:03.208946] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-28T01:56:03.914280] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-28T01:56:04.008949] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-28T01:56:04.206581] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-28T01:56:04.808956] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-28T01:56:05.608913] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-28T01:56:05.649680] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-28T01:56:06.254312] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-28T01:56:06.408919] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-28T01:56:07.027850] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-28T01:56:07.208974] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-28T01:56:08.008971] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-28T01:56:08.131156] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-28T01:56:08.668983] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-28T01:56:08.808931] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-28T01:56:08.997928] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-28T01:56:09.608928] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-28T01:56:10.222184] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-28T01:56:10.408903] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-28T01:56:11.208949] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-28T01:56:11.326279] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-28T01:56:11.764862] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-28T01:56:12.008908] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-28T01:56:12.588358] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-28T01:56:12.777414] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-28T01:56:12.808885] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-28T01:56:13.561117] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-28T01:56:13.608892] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-28T01:56:14.392483] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-28T01:56:14.408857] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-28T01:56:14.921838] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-28T01:56:15.208926] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-28T01:56:16.008940] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-28T01:56:16.710013] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-28T01:56:16.808950] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-28T01:56:17.608901] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-28T01:56:18.076221] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-28T01:56:18.113079] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-28T01:56:18.305787] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-28T01:56:18.307878] [INFO ] [REMOTE ] AVAL: Full fetch complete (14645 records). [2025-09-28T01:56:18.308004] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-28T01:56:18.414018] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-28T01:56:18.723633] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-28T01:56:18.723804] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-28T01:56:18.724194] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-28T01:56:18.724282] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-28T01:56:18.724989] [DEBUG] [LOCAL ] AVAL: Trimmed 14645 records to 9040 (keeping 200 days of data) [2025-09-28T01:56:18.780421] [DEBUG] [LOCAL ] AVAL: Primary data saved (9040 records). [2025-09-28T01:56:18.780623] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-28T01:56:18.780793] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AVAL took 18.4s. Estimated remaining: 4h 28m 16s. Rate: 8.2 symbols/min [2025-09-28T01:56:18.963576] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:56:19.006598] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-28T01:56:19.006851] [INFO ] [MAIN ] AVB: Loaded 42457 existing records. [2025-09-28T01:56:19.214352] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-28T01:56:19.220404] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:56:19.221598] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-28T01:56:19.221734] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-28T01:56:19.222129] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-28T01:56:19.222210] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-28T01:56:19.605187] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:56:20.008962] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-28T01:56:20.588584] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-28T01:56:20.776011] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-28T01:56:20.784369] [INFO ] [REMOTE ] AVA: Full fetch complete (55713 records). [2025-09-28T01:56:20.784581] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-28T01:56:20.814048] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-28T01:56:21.191767] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-28T01:56:21.191886] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-28T01:56:21.192527] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-28T01:56:21.192625] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-28T01:56:21.193877] [DEBUG] [LOCAL ] AVA: Trimmed 55713 records to 40183 (keeping 200 days of data) [2025-09-28T01:56:21.443230] [DEBUG] [LOCAL ] AVA: Primary data saved (40183 records). [2025-09-28T01:56:21.443394] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-28T01:56:21.443544] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AVA took 32.5s. Estimated remaining: 4h 27m 11s. Rate: 8.2 symbols/min [2025-09-28T01:56:21.614174] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-28T01:56:21.637046] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:56:21.638513] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-28T01:56:21.638639] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-28T01:56:21.638892] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-28T01:56:21.638974] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-28T01:56:21.639196] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-28T01:56:21.639389] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-28T01:56:21.777529] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-28T01:56:21.813512] [INFO ] [REMOTE ] AUB: Full fetch complete (65529 records). [2025-09-28T01:56:21.838858] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-28T01:56:22.245632] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:56:22.414062] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-28T01:56:22.488340] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-28T01:56:22.488730] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-28T01:56:22.489549] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-28T01:56:22.489685] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-28T01:56:22.491358] [DEBUG] [LOCAL ] AUB: Trimmed 65529 records to 47072 (keeping 200 days of data) [2025-09-28T01:56:22.719822] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:56:22.721840] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-28T01:56:22.722190] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:56:22.722542] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-09-28T01:56:22.722972] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:56:22.723676] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-28T01:56:22.723811] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-28T01:56:22.724426] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-28T01:56:22.725063] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-28T01:56:22.725475] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVBC took 1.3s. Estimated remaining: 4h 25m 50s. Rate: 8.2 symbols/min [2025-09-28T01:56:22.922045] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:56:22.955235] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-28T01:56:22.956084] [INFO ] [MAIN ] AVD: Loaded 23030 existing records. [2025-09-28T01:56:23.216365] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:56:23.222580] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-28T01:56:23.224285] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-28T01:56:23.226307] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-28T01:56:23.239370] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-28T01:56:23.240080] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-28T01:56:23.273105] [INFO ] [REMOTE ] AU: Full fetch complete (76272 records). [2025-09-28T01:56:23.325718] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-28T01:56:23.356108] [DEBUG] [LOCAL ] AUB: Primary data saved (47072 records). [2025-09-28T01:56:23.380690] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-28T01:56:23.380892] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-28T01:56:23.471328] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AUB took 44.6s. Estimated remaining: 4h 24m 24s. Rate: 8.3 symbols/min [2025-09-28T01:56:23.482451] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-28T01:56:24.215768] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:56:24.247871] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:56:24.260447] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-28T01:56:24.370855] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-28T01:56:24.370975] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-28T01:56:24.371787] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-28T01:56:24.372404] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-28T01:56:24.379268] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-28T01:56:24.379829] [INFO ] [MAIN ] AVK: Loaded 18064 existing records. [2025-09-28T01:56:24.459417] [DEBUG] [LOCAL ] AU: Trimmed 76272 records to 53715 (keeping 200 days of data) [2025-09-28T01:56:24.661218] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:56:24.665077] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-28T01:56:24.665171] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-28T01:56:24.667729] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-28T01:56:24.667822] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-28T01:56:25.163937] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:56:25.166083] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-28T01:56:25.208983] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-28T01:56:25.323909] [DEBUG] [LOCAL ] AU: Primary data saved (53715 records). [2025-09-28T01:56:25.324110] [INFO ] [MAIN ] AU: Full history saved. [2025-09-28T01:56:25.324271] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AU took 47.0s. Estimated remaining: 4h 23m 12s. Rate: 8.3 symbols/min [2025-09-28T01:56:25.500978] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:56:25.536196] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-28T01:56:25.536381] [INFO ] [MAIN ] AVNS: Loaded 34132 existing records. [2025-09-28T01:56:25.609716] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-28T01:56:25.749702] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:56:25.751268] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-28T01:56:25.751473] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-28T01:56:25.757663] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-28T01:56:25.758048] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-28T01:56:25.758129] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-28T01:56:26.134554] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:56:26.383772] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-28T01:56:26.408911] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-28T01:56:27.186708] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-28T01:56:27.208859] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-28T01:56:27.314325] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-28T01:56:28.008927] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-28T01:56:28.808881] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-28T01:56:28.869917] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-28T01:56:29.369108] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-28T01:56:29.608971] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-28T01:56:29.722744] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-28T01:56:30.408936] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-28T01:56:30.816252] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-28T01:56:31.208894] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-28T01:56:31.251090] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-28T01:56:32.008878] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-28T01:56:32.210624] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-28T01:56:32.808917] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-28T01:56:33.608871] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-28T01:56:33.731933] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-28T01:56:34.027815] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-28T01:56:34.408889] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-28T01:56:34.609780] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-28T01:56:35.208941] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-28T01:56:35.933812] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-28T01:56:36.008920] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-28T01:56:36.450198] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-28T01:56:36.808914] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-28T01:56:37.595283] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-28T01:56:37.608868] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-28T01:56:37.999090] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-28T01:56:38.408950] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-28T01:56:38.450176] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-28T01:56:39.208931] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-28T01:56:39.911854] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-28T01:56:40.008879] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-28T01:56:40.315799] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-28T01:56:40.808919] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-28T01:56:41.130891] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-28T01:56:41.608871] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-28T01:56:41.739134] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-28T01:56:42.408924] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-28T01:56:42.924808] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-28T01:56:43.208915] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-28T01:56:44.008950] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-28T01:56:44.062310] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-28T01:56:44.290185] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-28T01:56:44.808909] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-28T01:56:45.272732] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-28T01:56:45.608913] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-28T01:56:46.184601] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-28T01:56:46.408901] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-28T01:56:47.049894] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-28T01:56:47.208988] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-28T01:56:47.559024] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-28T01:56:48.008913] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-28T01:56:48.535609] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-28T01:56:48.542609] [INFO ] [REMOTE ] AVNS: Full fetch complete (48077 records). [2025-09-28T01:56:48.542786] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-28T01:56:48.817285] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-28T01:56:48.941049] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-28T01:56:48.941172] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-28T01:56:48.941826] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-28T01:56:48.941911] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-28T01:56:48.943154] [DEBUG] [LOCAL ] AVNS: Trimmed 48077 records to 34132 (keeping 200 days of data) [2025-09-28T01:56:49.156234] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-28T01:56:49.167136] [DEBUG] [LOCAL ] AVNS: Primary data saved (34132 records). [2025-09-28T01:56:49.167434] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-28T01:56:49.167979] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVNS took 23.8s. Estimated remaining: 4h 26m 24s. Rate: 8.2 symbols/min [2025-09-28T01:56:49.342879] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:56:49.380564] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-28T01:56:49.380778] [INFO ] [MAIN ] AVNT: Loaded 39887 existing records. [2025-09-28T01:56:49.566682] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:56:49.566954] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-28T01:56:49.567052] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-28T01:56:49.567382] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-28T01:56:49.567470] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-28T01:56:49.617988] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-28T01:56:49.951417] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:56:50.408868] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-28T01:56:50.440135] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-28T01:56:50.449042] [INFO ] [REMOTE ] AVB: Full fetch complete (58415 records). [2025-09-28T01:56:50.449272] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-28T01:56:50.779412] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-28T01:56:50.865708] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-28T01:56:50.865826] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-28T01:56:50.866567] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-28T01:56:50.866682] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-28T01:56:50.868202] [DEBUG] [LOCAL ] AVB: Trimmed 58415 records to 42457 (keeping 200 days of data) [2025-09-28T01:56:51.133401] [DEBUG] [LOCAL ] AVB: Primary data saved (42457 records). [2025-09-28T01:56:51.133585] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-28T01:56:51.133745] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVB took 32.4s. Estimated remaining: 4h 25m 13s. Rate: 8.2 symbols/min [2025-09-28T01:56:51.213961] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-28T01:56:51.314008] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:56:51.365855] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-28T01:56:51.366076] [INFO ] [MAIN ] AVTR: Loaded 54345 existing records. [2025-09-28T01:56:51.549778] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:56:51.550072] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-28T01:56:51.550178] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-28T01:56:51.550504] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-28T01:56:51.550591] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-28T01:56:51.924316] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:56:51.945584] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-28T01:56:52.008879] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-28T01:56:52.489897] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-28T01:56:52.808923] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-28T01:56:53.608875] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-28T01:56:53.857628] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-28T01:56:53.883056] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-28T01:56:54.408910] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-28T01:56:54.752571] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-28T01:56:55.208936] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-28T01:56:55.419294] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-28T01:56:55.423756] [INFO ] [REMOTE ] AVD: Full fetch complete (33821 records). [2025-09-28T01:56:55.423908] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-28T01:56:55.811396] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-28T01:56:55.811514] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-28T01:56:55.812060] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-28T01:56:55.812146] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-28T01:56:55.813122] [DEBUG] [LOCAL ] AVD: Trimmed 33821 records to 23030 (keeping 200 days of data) [2025-09-28T01:56:55.941353] [DEBUG] [LOCAL ] AVD: Primary data saved (23030 records). [2025-09-28T01:56:55.941554] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-28T01:56:55.941705] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVD took 33.2s. Estimated remaining: 4h 24m 36s. Rate: 8.3 symbols/min [2025-09-28T01:56:56.014083] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-28T01:56:56.128161] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:56:56.128370] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-09-28T01:56:56.128442] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-09-28T01:56:56.128555] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-28T01:56:56.128626] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-28T01:56:56.128743] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-09-28T01:56:56.128819] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-28T01:56:56.513088] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:56:56.645421] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-28T01:56:56.808904] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-28T01:56:57.300122] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-28T01:56:57.608920] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-28T01:56:58.330781] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-28T01:56:58.408921] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-28T01:56:59.208879] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-28T01:56:59.287674] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-28T01:56:59.570528] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-28T01:56:59.574567] [INFO ] [REMOTE ] AVK: Full fetch complete (26501 records). [2025-09-28T01:56:59.574722] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-28T01:56:59.963915] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-28T01:56:59.964051] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-28T01:56:59.964486] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-28T01:56:59.964570] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-28T01:56:59.965626] [DEBUG] [LOCAL ] AVK: Trimmed 26501 records to 18064 (keeping 200 days of data) [2025-09-28T01:57:00.019855] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-28T01:57:00.086882] [DEBUG] [LOCAL ] AVK: Primary data saved (18064 records). [2025-09-28T01:57:00.087088] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-28T01:57:00.087220] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVK took 36.6s. Estimated remaining: 4h 23m 52s. Rate: 8.3 symbols/min [2025-09-28T01:57:00.263600] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:57:00.289525] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-28T01:57:00.289738] [INFO ] [MAIN ] AWF: Loaded 24608 existing records. [2025-09-28T01:57:00.485953] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:57:00.486186] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-28T01:57:00.486267] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-28T01:57:00.486693] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-28T01:57:00.486773] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-28T01:57:00.809821] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-28T01:57:00.881916] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:57:00.912376] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-28T01:57:01.408118] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-28T01:57:01.608918] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-28T01:57:02.408905] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-28T01:57:02.560714] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-28T01:57:02.817388] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-28T01:57:03.208950] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-28T01:57:04.008868] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-28T01:57:04.193051] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-28T01:57:04.457696] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-28T01:57:04.788921] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-28T01:57:04.808918] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-28T01:57:05.608871] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-28T01:57:06.227838] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-28T01:57:06.408893] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-28T01:57:06.763444] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-28T01:57:07.208923] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-28T01:57:07.936029] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-28T01:57:08.008920] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-28T01:57:08.301910] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-28T01:57:08.808920] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-28T01:57:09.608881] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-28T01:57:09.800209] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-28T01:57:10.337213] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-28T01:57:10.408912] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-28T01:57:10.936994] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-28T01:57:11.208930] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-28T01:57:12.008927] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-28T01:57:12.225048] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-28T01:57:12.762763] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-28T01:57:12.808895] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-28T01:57:13.560183] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-28T01:57:13.608910] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-28T01:57:14.198240] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-28T01:57:14.205507] [INFO ] [REMOTE ] AVNT: Full fetch complete (56217 records). [2025-09-28T01:57:14.205690] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-28T01:57:14.414004] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-28T01:57:14.628759] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-28T01:57:14.628980] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-28T01:57:14.630499] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-28T01:57:14.630667] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-28T01:57:14.640110] [DEBUG] [LOCAL ] AVNT: Trimmed 56217 records to 39887 (keeping 200 days of data) [2025-09-28T01:57:14.912676] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-28T01:57:14.952383] [DEBUG] [LOCAL ] AVNT: Primary data saved (39887 records). [2025-09-28T01:57:14.952600] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-28T01:57:14.952835] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVNT took 25.8s. Estimated remaining: 4h 25m 14s. Rate: 8.2 symbols/min [2025-09-28T01:57:15.130841] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:57:15.163959] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-28T01:57:15.164131] [INFO ] [MAIN ] AWI: Loaded 26185 existing records. [2025-09-28T01:57:15.219184] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-28T01:57:15.351951] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:57:15.352827] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-28T01:57:15.352909] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-28T01:57:15.353235] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-28T01:57:15.353326] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-28T01:57:15.723232] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:57:15.746686] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-28T01:57:16.008911] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-28T01:57:16.808944] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-28T01:57:17.058110] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-28T01:57:17.094285] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-28T01:57:17.608901] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-28T01:57:18.312269] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-28T01:57:18.389428] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-28T01:57:18.408862] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-28T01:57:19.208908] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-28T01:57:19.622965] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-28T01:57:20.008915] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-28T01:57:20.808899] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-28T01:57:21.005736] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-28T01:57:21.478552] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-28T01:57:21.549868] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-28T01:57:21.608867] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-28T01:57:22.408882] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-28T01:57:22.481857] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-28T01:57:23.208909] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-28T01:57:23.478110] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-28T01:57:24.008908] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-28T01:57:24.808939] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-28T01:57:25.070206] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-28T01:57:25.376500] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-28T01:57:25.608908] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-28T01:57:26.030357] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-28T01:57:26.408947] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-28T01:57:27.208896] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-28T01:57:27.350334] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-28T01:57:27.361935] [INFO ] [REMOTE ] AVTR: Full fetch complete (77442 records). [2025-09-28T01:57:27.362130] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-28T01:57:27.781487] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-28T01:57:27.797762] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-28T01:57:27.798822] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-28T01:57:27.799204] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-28T01:57:27.801437] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-28T01:57:27.814461] [DEBUG] [LOCAL ] AVTR: Trimmed 77442 records to 54345 (keeping 200 days of data) [2025-09-28T01:57:28.015278] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-28T01:57:28.165938] [DEBUG] [LOCAL ] AVTR: Primary data saved (54345 records). [2025-09-28T01:57:28.166156] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-28T01:57:28.166329] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVTR took 37.0s. Estimated remaining: 4h 26m 16s. Rate: 8.2 symbols/min [2025-09-28T01:57:28.345944] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:57:28.403505] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-28T01:57:28.403876] [INFO ] [MAIN ] AWK: Loaded 49489 existing records. [2025-09-28T01:57:28.590425] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:57:28.590921] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-28T01:57:28.591142] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-28T01:57:28.604514] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-28T01:57:28.613198] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-28T01:57:28.614828] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-28T01:57:28.814369] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-28T01:57:29.019347] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:57:29.035076] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-28T01:57:29.608913] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-28T01:57:30.334682] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-28T01:57:30.408889] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-28T01:57:31.208903] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-28T01:57:31.277756] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-28T01:57:31.556862] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-28T01:57:32.008906] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-28T01:57:32.419836] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-28T01:57:32.430487] [INFO ] [REMOTE ] AVY: Full fetch complete (56182 records). [2025-09-28T01:57:32.430699] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-28T01:57:32.819285] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-28T01:57:32.840930] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-28T01:57:32.841074] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-28T01:57:32.842874] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-28T01:57:32.843077] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-28T01:57:32.845391] [DEBUG] [LOCAL ] AVY: Trimmed 56182 records to 38102 (keeping 200 days of data) [2025-09-28T01:57:33.113781] [DEBUG] [LOCAL ] AVY: Primary data saved (38102 records). [2025-09-28T01:57:33.113957] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-28T01:57:33.114104] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVY took 37.2s. Estimated remaining: 4h 25m 41s. Rate: 8.2 symbols/min [2025-09-28T01:57:33.295882] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:57:33.318882] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-28T01:57:33.319144] [INFO ] [MAIN ] AWP: Loaded 21835 existing records. [2025-09-28T01:57:33.406442] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-28T01:57:33.524902] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:57:33.525144] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-28T01:57:33.525224] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-28T01:57:33.525488] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-28T01:57:33.525567] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-28T01:57:33.614688] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-28T01:57:33.889993] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:57:34.408863] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-28T01:57:34.597535] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-28T01:57:34.651268] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-28T01:57:35.208886] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-28T01:57:35.592306] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-28T01:57:36.008882] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-28T01:57:36.296619] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-28T01:57:36.301888] [INFO ] [REMOTE ] AWF: Full fetch complete (35960 records). [2025-09-28T01:57:36.302037] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-28T01:57:36.693286] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-28T01:57:36.693406] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-28T01:57:36.693950] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-28T01:57:36.694034] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-28T01:57:36.695580] [DEBUG] [LOCAL ] AWF: Trimmed 35960 records to 24608 (keeping 200 days of data) [2025-09-28T01:57:36.809114] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-28T01:57:36.866557] [DEBUG] [LOCAL ] AWF: Primary data saved (24608 records). [2025-09-28T01:57:36.866855] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-28T01:57:36.867085] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 36.8s. Estimated remaining: 4h 24m 53s. Rate: 8.2 symbols/min [2025-09-28T01:57:37.041345] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:57:37.041851] [DEBUG] [LOCAL ] AWR: No existing data file found in primary storage. [2025-09-28T01:57:37.042040] [WARN ] [MAIN ] AWR: No existing data found, performing full refresh instead. [2025-09-28T01:57:37.042186] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-28T01:57:37.042280] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-28T01:57:37.042393] [DEBUG] [LOCAL ] AWR: No primary data file found to delete. [2025-09-28T01:57:37.042487] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-28T01:57:37.184157] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-28T01:57:37.430127] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:57:37.608913] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-28T01:57:38.247841] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-28T01:57:38.408900] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-28T01:57:38.724712] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-28T01:57:39.208903] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-28T01:57:40.008904] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-28T01:57:40.279697] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-28T01:57:40.331333] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-28T01:57:40.337622] [INFO ] [REMOTE ] AWI: Full fetch complete (35420 records). [2025-09-28T01:57:40.337876] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-28T01:57:40.814202] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-28T01:57:40.849600] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-28T01:57:40.849761] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-28T01:57:40.850261] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-28T01:57:40.850343] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-28T01:57:40.851473] [DEBUG] [LOCAL ] AWI: Trimmed 35420 records to 26185 (keeping 200 days of data) [2025-09-28T01:57:41.033508] [DEBUG] [LOCAL ] AWI: Primary data saved (26185 records). [2025-09-28T01:57:41.033695] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-28T01:57:41.033823] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 26.1s. Estimated remaining: 4h 24m 10s. Rate: 8.3 symbols/min [2025-09-28T01:57:41.215008] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:57:41.230081] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-28T01:57:41.264048] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-28T01:57:41.264246] [INFO ] [MAIN ] AX: Loaded 28929 existing records. [2025-09-28T01:57:41.450216] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:57:41.450501] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-28T01:57:41.450603] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-28T01:57:41.451096] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-28T01:57:41.451196] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-28T01:57:41.610233] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-28T01:57:41.838884] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:57:42.408876] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-28T01:57:42.693703] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-28T01:57:42.791692] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-28T01:57:43.208954] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-28T01:57:43.535865] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-28T01:57:44.008914] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-28T01:57:44.808875] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-28T01:57:44.981182] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-28T01:57:45.099044] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-28T01:57:45.608925] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-28T01:57:45.894269] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-28T01:57:46.408923] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-28T01:57:46.736712] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-28T01:57:47.208932] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-28T01:57:47.338405] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-28T01:57:48.008925] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-28T01:57:48.575748] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-28T01:57:48.808931] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-28T01:57:48.981364] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-28T01:57:49.608966] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-28T01:57:50.408900] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-28T01:57:50.498701] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-28T01:57:50.958438] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-28T01:57:51.208869] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-28T01:57:51.507127] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-28T01:57:52.008922] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-28T01:57:52.287227] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-28T01:57:52.808862] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-28T01:57:53.226845] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-28T01:57:53.608915] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-28T01:57:54.408898] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-28T01:57:54.528973] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-28T01:57:54.622109] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-28T01:57:54.626503] [INFO ] [REMOTE ] AWP: Full fetch complete (32517 records). [2025-09-28T01:57:54.626632] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-28T01:57:55.020506] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-28T01:57:55.020677] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-28T01:57:55.021164] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-28T01:57:55.021263] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-28T01:57:55.022183] [DEBUG] [LOCAL ] AWP: Trimmed 32517 records to 21835 (keeping 200 days of data) [2025-09-28T01:57:55.151580] [DEBUG] [LOCAL ] AWP: Primary data saved (21835 records). [2025-09-28T01:57:55.151768] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-28T01:57:55.151901] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 22.0s. Estimated remaining: 4h 25m 20s. Rate: 8.2 symbols/min [2025-09-28T01:57:55.216455] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-28T01:57:55.332361] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:57:55.387550] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-28T01:57:55.387838] [INFO ] [MAIN ] AXL: Loaded 51239 existing records. [2025-09-28T01:57:55.584731] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:57:55.585253] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-28T01:57:55.585403] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-28T01:57:55.591220] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-28T01:57:55.598349] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-28T01:57:55.599435] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-28T01:57:55.980385] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:57:56.008937] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-28T01:57:56.675702] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-28T01:57:56.808926] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-28T01:57:57.598290] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-28T01:57:57.608843] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-28T01:57:58.268194] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-28T01:57:58.408922] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-28T01:57:59.138316] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-28T01:57:59.208869] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-28T01:57:59.511415] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-28T01:58:00.008923] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-28T01:58:00.808914] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-28T01:58:01.233455] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-28T01:58:01.608889] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-28T01:58:02.085017] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-28T01:58:02.250795] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-28T01:58:02.408930] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-28T01:58:03.208921] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-28T01:58:03.477480] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-28T01:58:03.588761] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-28T01:58:04.008876] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-28T01:58:04.343244] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-28T01:58:04.808925] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-28T01:58:05.608890] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-28T01:58:05.702601] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-28T01:58:06.408917] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-28T01:58:06.454385] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-28T01:58:06.464444] [INFO ] [REMOTE ] AWK: Full fetch complete (70499 records). [2025-09-28T01:58:06.464724] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-28T01:58:06.938362] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-28T01:58:06.938551] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-28T01:58:06.939740] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-28T01:58:06.952861] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-28T01:58:06.956523] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-28T01:58:06.964048] [DEBUG] [LOCAL ] AWK: Trimmed 70499 records to 49489 (keeping 200 days of data) [2025-09-28T01:58:07.209357] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-28T01:58:07.285593] [DEBUG] [LOCAL ] AWK: Primary data saved (49489 records). [2025-09-28T01:58:07.285799] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-28T01:58:07.285931] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWK took 39.1s. Estimated remaining: 4h 26m 8s. Rate: 8.2 symbols/min [2025-09-28T01:58:07.474566] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:58:07.534301] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-28T01:58:07.534510] [INFO ] [MAIN ] AXP: Loaded 53999 existing records. [2025-09-28T01:58:07.726912] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:58:07.744155] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-28T01:58:07.745470] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-28T01:58:07.745581] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-28T01:58:07.752859] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-28T01:58:07.752954] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-28T01:58:08.014032] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-28T01:58:08.123720] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:58:08.808894] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-28T01:58:08.985254] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-28T01:58:09.017700] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-28T01:58:09.608931] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-28T01:58:10.408860] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-28T01:58:10.883759] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-28T01:58:11.174500] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-28T01:58:11.208929] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-28T01:58:11.558744] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-28T01:58:12.008976] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-28T01:58:12.808938] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-28T01:58:12.952437] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-28T01:58:13.150244] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-28T01:58:13.156399] [INFO ] [REMOTE ] AX: Full fetch complete (42679 records). [2025-09-28T01:58:13.156572] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-28T01:58:13.552774] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-28T01:58:13.552913] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-28T01:58:13.553471] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-28T01:58:13.553590] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-28T01:58:13.554913] [DEBUG] [LOCAL ] AX: Trimmed 42679 records to 28929 (keeping 200 days of data) [2025-09-28T01:58:13.614316] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-28T01:58:13.735016] [DEBUG] [LOCAL ] AX: Primary data saved (28929 records). [2025-09-28T01:58:13.735220] [INFO ] [MAIN ] AX: Full history saved. [2025-09-28T01:58:13.735354] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AX took 32.7s. Estimated remaining: 4h 25m 50s. Rate: 8.2 symbols/min [2025-09-28T01:58:13.927492] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:58:13.934357] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-28T01:58:13.934548] [INFO ] [MAIN ] AXR: Loaded 3220 existing records. [2025-09-28T01:58:14.121932] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:58:14.122199] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-28T01:58:14.122280] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-28T01:58:14.122529] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-28T01:58:14.122607] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-28T01:58:14.418335] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-28T01:58:14.515682] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:58:15.023490] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-28T01:58:15.208874] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-28T01:58:15.532566] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-28T01:58:15.727988] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-28T01:58:15.733954] [INFO ] [REMOTE ] AWR: Full fetch complete (31891 records). [2025-09-28T01:58:15.734110] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-28T01:58:16.014114] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-28T01:58:16.120559] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-28T01:58:16.120911] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-28T01:58:16.121474] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-28T01:58:16.121559] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-28T01:58:16.122667] [DEBUG] [LOCAL ] AWR: Trimmed 31891 records to 22993 (keeping 200 days of data) [2025-09-28T01:58:16.272446] [DEBUG] [LOCAL ] AWR: Primary data saved (22993 records). [2025-09-28T01:58:16.272659] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-28T01:58:16.272786] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AWR took 39.4s. Estimated remaining: 4h 24m 50s. Rate: 8.2 symbols/min [2025-09-28T01:58:16.450910] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:58:16.501445] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-28T01:58:16.501687] [INFO ] [MAIN ] AXS: Loaded 38920 existing records. [2025-09-28T01:58:16.690096] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:58:16.690370] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-28T01:58:16.690453] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-28T01:58:16.691377] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-28T01:58:16.691462] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-28T01:58:16.814042] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-28T01:58:17.074759] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:58:17.255401] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-28T01:58:17.554172] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-28T01:58:17.608889] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-28T01:58:17.797162] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-28T01:58:17.807366] [INFO ] [REMOTE ] AXL: Full fetch complete (72551 records). [2025-09-28T01:58:17.807573] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-28T01:58:18.212104] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-28T01:58:18.212243] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-28T01:58:18.213148] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-28T01:58:18.213242] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-28T01:58:18.214900] [DEBUG] [LOCAL ] AXL: Trimmed 72551 records to 51239 (keeping 200 days of data) [2025-09-28T01:58:18.418171] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-28T01:58:18.522860] [DEBUG] [LOCAL ] AXL: Primary data saved (51239 records). [2025-09-28T01:58:18.523055] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-28T01:58:18.523209] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 23.4s. Estimated remaining: 4h 23m 46s. Rate: 8.2 symbols/min [2025-09-28T01:58:18.700300] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:58:18.752493] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-28T01:58:18.752739] [INFO ] [MAIN ] AXTA: Loaded 52835 existing records. [2025-09-28T01:58:18.932861] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:58:18.933088] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-28T01:58:18.933166] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-28T01:58:18.933460] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-28T01:58:18.933538] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-28T01:58:19.218979] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-28T01:58:19.316977] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:58:19.847289] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-28T01:58:19.867038] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-28T01:58:19.890309] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-28T01:58:20.008919] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-28T01:58:20.808976] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-28T01:58:21.225095] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-28T01:58:21.530590] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-28T01:58:21.608886] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-28T01:58:22.408924] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-28T01:58:23.208897] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-28T01:58:23.352894] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-28T01:58:24.008957] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-28T01:58:24.677916] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-28T01:58:24.790779] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-28T01:58:24.808865] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-28T01:58:25.495393] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-28T01:58:25.608885] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-28T01:58:26.194183] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-28T01:58:26.408949] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-28T01:58:26.975108] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-28T01:58:27.208900] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-28T01:58:27.638877] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-28T01:58:27.851560] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-28T01:58:28.008912] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-28T01:58:28.502009] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-28T01:58:28.808924] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-28T01:58:29.608921] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-28T01:58:30.206740] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-28T01:58:30.343822] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-28T01:58:30.408972] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-28T01:58:30.745319] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-28T01:58:31.208907] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-28T01:58:32.008941] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-28T01:58:32.482620] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-28T01:58:32.808937] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-28T01:58:33.199991] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-28T01:58:33.608927] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-28T01:58:33.881204] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-28T01:58:34.408953] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-28T01:58:35.208950] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-28T01:58:35.780920] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-28T01:58:35.828485] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-28T01:58:35.831939] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-28T01:58:35.833498] [INFO ] [REMOTE ] AXR: Full fetch complete (5009 records). [2025-09-28T01:58:35.845280] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-28T01:58:36.015409] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-28T01:58:36.247839] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-28T01:58:36.247959] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-28T01:58:36.248143] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-28T01:58:36.248221] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-28T01:58:36.248671] [DEBUG] [LOCAL ] AXR: Trimmed 5009 records to 3220 (keeping 200 days of data) [2025-09-28T01:58:36.268241] [DEBUG] [LOCAL ] AXR: Primary data saved (3220 records). [2025-09-28T01:58:36.268377] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-28T01:58:36.268507] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 22.5s. Estimated remaining: 4h 25m 35s. Rate: 8.2 symbols/min [2025-09-28T01:58:36.809093] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-28T01:58:37.563404] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-28T01:58:37.608856] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-28T01:58:38.408924] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-28T01:58:38.550190] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-28T01:58:39.045696] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-28T01:58:39.208952] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-28T01:58:40.008869] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-28T01:58:40.431327] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-28T01:58:40.808932] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-28T01:58:40.896520] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-28T01:58:40.904802] [INFO ] [REMOTE ] AXS: Full fetch complete (55561 records). [2025-09-28T01:58:40.904961] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-28T01:58:41.319365] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-28T01:58:41.319488] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-28T01:58:41.320225] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-28T01:58:41.320381] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-28T01:58:41.321741] [DEBUG] [LOCAL ] AXS: Trimmed 55561 records to 38920 (keeping 200 days of data) [2025-09-28T01:58:41.575587] [DEBUG] [LOCAL ] AXS: Primary data saved (38920 records). [2025-09-28T01:58:41.575842] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-28T01:58:41.576551] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXS took 25.3s. Estimated remaining: 4h 25m 5s. Rate: 8.2 symbols/min [2025-09-28T01:58:41.798764] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-28T01:58:41.813171] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-28T01:58:42.844943] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-28T01:58:42.855487] [INFO ] [REMOTE ] AXP: Full fetch complete (76898 records). [2025-09-28T01:58:42.855746] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-28T01:58:43.274718] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-28T01:58:43.274879] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-28T01:58:43.275852] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-28T01:58:43.275943] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-28T01:58:43.278245] [DEBUG] [LOCAL ] AXP: Trimmed 76898 records to 53999 (keeping 200 days of data) [2025-09-28T01:58:43.623785] [DEBUG] [LOCAL ] AXP: Primary data saved (53999 records). [2025-09-28T01:58:43.624028] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-28T01:58:43.624225] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXP took 36.3s. Estimated remaining: 4h 24m 0s. Rate: 8.2 symbols/min [2025-09-28T01:58:43.722912] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-28T01:58:43.733920] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-28T01:58:45.132485] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-28T01:58:45.143813] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-28T01:58:46.775485] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-28T01:58:46.787280] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-28T01:58:48.469417] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-28T01:58:48.482408] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-28T01:58:50.259154] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-28T01:58:50.270795] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-28T01:58:51.955099] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-28T01:58:51.965613] [INFO ] [REMOTE ] AXTA: Full fetch complete (74910 records). [2025-09-28T01:58:51.965865] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-28T01:58:52.373890] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-28T01:58:52.374032] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-28T01:58:52.374932] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-28T01:58:52.375036] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-28T01:58:52.376634] [DEBUG] [LOCAL ] AXTA: Trimmed 74910 records to 52835 (keeping 200 days of data) [2025-09-28T01:58:52.687100] [DEBUG] [LOCAL ] AXTA: Primary data saved (52835 records). [2025-09-28T01:58:52.687443] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-28T01:58:52.687630] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 34.2s. Estimated remaining: 4h 24m 12s. Rate: 8.2 symbols/min [2025-09-28T01:58:53.399773] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:58:53.386993] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:58:53.427147] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:58:53.393372] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:58:53.427544] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-28T01:58:53.428134] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-28T01:58:53.428492] [DEBUG] [LOCAL ] AYI: No existing data file found in primary storage. [2025-09-28T01:58:53.428766] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-28T01:58:53.428999] [WARN ] [MAIN ] AYI: No existing data found, performing full refresh instead. [2025-09-28T01:58:53.429067] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-28T01:58:53.429284] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-28T01:58:53.429416] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-28T01:58:53.429658] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-28T01:58:53.429579] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-28T01:58:53.436317] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-09-28T01:58:53.453391] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-28T01:58:53.615991] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-28T01:58:53.651826] [INFO ] [MAIN ] AZO: Loaded 11687 existing records. [2025-09-28T01:58:53.675887] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-28T01:58:53.778429] [INFO ] [MAIN ] AZZ: Loaded 22359 existing records. [2025-09-28T01:58:54.504999] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:58:54.595118] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:58:54.561957] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-28T01:58:54.623213] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-28T01:58:54.634120] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-28T01:58:54.669917] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:58:54.652684] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-28T01:58:54.706823] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-28T01:58:54.702638] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-28T01:58:54.732084] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-28T01:58:54.732179] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-28T01:58:54.741707] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:58:54.747595] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-28T01:58:54.765621] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-28T01:58:55.470805] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:58:55.496559] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-28T01:58:55.542148] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:58:55.542612] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-28T01:58:56.138776] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-28T01:58:56.144433] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-28T01:58:56.166449] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-28T01:58:56.174063] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-28T01:58:56.542071] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-28T01:58:56.545883] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-28T01:58:56.638430] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-28T01:58:56.643200] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-28T01:58:57.018244] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-28T01:58:57.024542] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-28T01:58:57.382208] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T01:58:57.382568] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-28T01:58:57.382689] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T01:58:57.382849] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-09-28T01:58:57.382931] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T01:58:57.383014] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-28T01:58:57.383112] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-28T01:58:57.383184] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-28T01:58:57.383440] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-28T01:58:57.383583] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. B took 4.7s. Estimated remaining: 4h 23m 37s. Rate: 8.2 symbols/min [2025-09-28T01:58:57.480398] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-28T01:58:57.527717] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-28T01:58:57.586316] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:58:57.640802] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-28T01:58:57.650021] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-28T01:58:57.667866] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-28T01:58:57.678340] [INFO ] [MAIN ] BA: Loaded 54571 existing records. [2025-09-28T01:58:57.691064] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-28T01:58:57.751726] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-28T01:58:57.889015] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:58:57.889233] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-28T01:58:57.889311] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-28T01:58:57.890373] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-28T01:58:57.890458] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-28T01:58:58.262634] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:58:58.263059] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-28T01:58:58.324023] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-28T01:58:58.326334] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-28T01:58:58.834210] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-28T01:58:58.840160] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-28T01:58:58.881623] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-28T01:58:58.886411] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-28T01:58:59.036223] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-28T01:58:59.208951] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-28T01:58:59.986533] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-28T01:59:00.008907] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-28T01:59:00.229241] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-28T01:59:00.364112] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-28T01:59:00.808904] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-28T01:59:01.243458] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.98 seconds). [2025-09-28T01:59:01.278610] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-28T01:59:01.608893] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-28T01:59:02.247392] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-28T01:59:02.263480] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-28T01:59:02.408905] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-28T01:59:03.208887] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-28T01:59:03.556874] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-28T01:59:03.954635] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-28T01:59:04.008883] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-28T01:59:04.808899] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-28T01:59:04.922221] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-28T01:59:05.608920] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-28T01:59:05.931051] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-28T01:59:06.408907] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-28T01:59:06.451474] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-28T01:59:07.208921] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-28T01:59:08.008907] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-28T01:59:08.357488] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-28T01:59:08.724984] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-28T01:59:08.727865] [INFO ] [REMOTE ] AZO: Full fetch complete (16385 records). [2025-09-28T01:59:08.727983] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-28T01:59:08.813103] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-28T01:59:09.140015] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-28T01:59:09.189359] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-28T01:59:09.189479] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-28T01:59:09.189887] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-28T01:59:09.190075] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-28T01:59:09.190772] [DEBUG] [LOCAL ] AZO: Trimmed 16385 records to 11687 (keeping 200 days of data) [2025-09-28T01:59:09.269763] [DEBUG] [LOCAL ] AZO: Primary data saved (11687 records). [2025-09-28T01:59:09.269960] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-28T01:59:09.270146] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZO took 16.6s. Estimated remaining: 4h 24m 19s. Rate: 8.2 symbols/min [2025-09-28T01:59:09.452312] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:59:09.512769] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-28T01:59:09.512974] [INFO ] [MAIN ] BABA: Loaded 54600 existing records. [2025-09-28T01:59:09.618823] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-28T01:59:09.709011] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:59:09.709347] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-28T01:59:09.709444] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-28T01:59:09.709896] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-28T01:59:09.709988] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-28T01:59:10.144340] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:59:10.207186] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-28T01:59:10.408902] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-28T01:59:11.208912] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-28T01:59:11.998251] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-28T01:59:12.009147] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-28T01:59:12.552525] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-28T01:59:12.808864] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-28T01:59:13.069518] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-28T01:59:13.268877] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-28T01:59:13.608890] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-28T01:59:13.919727] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-28T01:59:14.408960] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-28T01:59:15.208891] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-28T01:59:15.459295] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-28T01:59:16.008924] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-28T01:59:16.073158] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-28T01:59:16.370230] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-28T01:59:16.374460] [INFO ] [REMOTE ] AZZ: Full fetch complete (30859 records). [2025-09-28T01:59:16.374572] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-28T01:59:16.773566] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-28T01:59:16.773730] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-28T01:59:16.774260] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-28T01:59:16.774364] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-28T01:59:16.775380] [DEBUG] [LOCAL ] AZZ: Trimmed 30859 records to 22359 (keeping 200 days of data) [2025-09-28T01:59:16.830075] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-28T01:59:16.917232] [DEBUG] [LOCAL ] AZZ: Primary data saved (22359 records). [2025-09-28T01:59:16.917399] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-28T01:59:16.917523] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AZZ took 24.2s. Estimated remaining: 4h 24m 15s. Rate: 8.2 symbols/min [2025-09-28T01:59:17.102549] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:59:17.115391] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-28T01:59:17.120441] [INFO ] [REMOTE ] AYI: Full fetch complete (36665 records). [2025-09-28T01:59:17.120703] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-28T01:59:17.516909] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-28T01:59:17.531313] [INFO ] [MAIN ] BAC: Loaded 54588 existing records. [2025-09-28T01:59:17.621001] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-28T01:59:17.645281] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-28T01:59:17.659388] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-28T01:59:17.686159] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-28T01:59:17.686384] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-28T01:59:17.768051] [DEBUG] [LOCAL ] AYI: Trimmed 36665 records to 25446 (keeping 200 days of data) [2025-09-28T01:59:17.774561] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:59:17.775236] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-28T01:59:17.775634] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-28T01:59:17.777039] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-28T01:59:17.777147] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-28T01:59:18.278460] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:59:18.327351] [DEBUG] [LOCAL ] AYI: Primary data saved (25446 records). [2025-09-28T01:59:18.327539] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-28T01:59:18.327681] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AYI took 25.6s. Estimated remaining: 4h 23m 5s. Rate: 8.2 symbols/min [2025-09-28T01:59:18.414139] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-28T01:59:18.520414] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:59:18.576035] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-28T01:59:18.576222] [INFO ] [MAIN ] BAH: Loaded 52477 existing records. [2025-09-28T01:59:18.763066] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:59:18.763410] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-28T01:59:18.763504] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-28T01:59:18.763792] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-28T01:59:18.763872] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-28T01:59:19.143793] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:59:19.208882] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-28T01:59:19.467094] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-28T01:59:20.008930] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-28T01:59:20.344392] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-09-28T01:59:20.808874] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-28T01:59:20.970554] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-28T01:59:21.073517] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-28T01:59:21.608909] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-28T01:59:22.323688] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-28T01:59:22.408922] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-28T01:59:22.972515] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-28T01:59:23.208921] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-28T01:59:23.589592] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-28T01:59:24.008876] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-28T01:59:24.270266] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-28T01:59:24.808934] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-28T01:59:25.553286] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-28T01:59:25.608972] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-28T01:59:26.187749] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-28T01:59:26.358752] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-28T01:59:26.408907] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-28T01:59:27.208955] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-28T01:59:28.008923] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-28T01:59:28.204161] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-28T01:59:28.415192] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-28T01:59:28.808944] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-28T01:59:29.608880] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-28T01:59:29.881679] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-28T01:59:30.083712] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-28T01:59:30.408908] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-28T01:59:31.208892] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-28T01:59:31.500996] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-28T01:59:32.008899] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-28T01:59:32.043568] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-28T01:59:32.273360] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-28T01:59:32.808902] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-28T01:59:33.608913] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-28T01:59:33.901316] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-28T01:59:34.139004] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-28T01:59:34.408878] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-28T01:59:34.503942] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-28T01:59:35.208914] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-28T01:59:35.880781] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-28T01:59:35.891715] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-28T01:59:35.891892] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-28T01:59:36.014060] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-28T01:59:36.314834] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-28T01:59:36.314974] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-28T01:59:36.315849] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-28T01:59:36.315937] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-28T01:59:36.317599] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 54571 (keeping 200 days of data) [2025-09-28T01:59:36.661810] [DEBUG] [LOCAL ] BA: Primary data saved (54571 records). [2025-09-28T01:59:36.662018] [INFO ] [MAIN ] BA: Full history saved. [2025-09-28T01:59:36.662158] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 39.3s. Estimated remaining: 4h 24m 54s. Rate: 8.2 symbols/min [2025-09-28T01:59:36.843215] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:59:36.882195] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-28T01:59:36.882441] [INFO ] [MAIN ] BAK: Loaded 39413 existing records. [2025-09-28T01:59:37.071291] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:59:37.071971] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-28T01:59:37.072216] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-28T01:59:37.072899] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-28T01:59:37.073053] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-28T01:59:37.301821] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-09-28T01:59:37.400843] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-28T01:59:37.507553] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:59:37.539055] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-28T01:59:37.608884] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-28T01:59:37.879384] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-28T01:59:38.408909] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-28T01:59:39.209015] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-28T01:59:40.043498] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-28T01:59:40.055851] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-28T01:59:40.254050] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-28T01:59:40.302255] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-28T01:59:40.775733] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-28T01:59:40.808855] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-28T01:59:41.608923] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-28T01:59:42.325472] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-28T01:59:42.408915] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-28T01:59:42.935638] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-28T01:59:42.995517] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-28T01:59:43.208917] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-28T01:59:44.008911] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-28T01:59:44.806289] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-28T01:59:44.817321] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-28T01:59:45.252382] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-28T01:59:45.289681] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-28T01:59:45.299919] [INFO ] [REMOTE ] BAH: Full fetch complete (74824 records). [2025-09-28T01:59:45.300100] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-28T01:59:45.608926] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-28T01:59:45.714086] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-28T01:59:45.714222] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-28T01:59:45.715075] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-28T01:59:45.715164] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-28T01:59:45.716827] [DEBUG] [LOCAL ] BAH: Trimmed 74824 records to 52477 (keeping 200 days of data) [2025-09-28T01:59:46.052304] [DEBUG] [LOCAL ] BAH: Primary data saved (52477 records). [2025-09-28T01:59:46.052488] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-28T01:59:46.052619] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BAH took 27.7s. Estimated remaining: 4h 25m 9s. Rate: 8.2 symbols/min [2025-09-28T01:59:46.224743] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:59:46.280373] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-28T01:59:46.280577] [INFO ] [MAIN ] BALL: Loaded 52583 existing records. [2025-09-28T01:59:46.424542] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-28T01:59:46.470921] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:59:46.471159] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-28T01:59:46.471238] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-28T01:59:46.471785] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-28T01:59:46.471867] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-28T01:59:46.835520] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:59:47.208912] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-28T01:59:47.515516] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-28T01:59:47.882824] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-28T01:59:47.966880] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-28T01:59:47.977325] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-28T01:59:47.977529] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-28T01:59:48.014004] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-28T01:59:48.394475] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-28T01:59:48.394632] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-28T01:59:48.395512] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-28T01:59:48.395599] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-28T01:59:48.398258] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54588 (keeping 200 days of data) [2025-09-28T01:59:48.746038] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-09-28T01:59:48.746240] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-28T01:59:48.746371] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAC took 31.8s. Estimated remaining: 4h 24m 13s. Rate: 8.2 symbols/min [2025-09-28T01:59:48.814553] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-28T01:59:48.940307] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:59:48.941304] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-28T01:59:48.941789] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-28T01:59:48.941905] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-28T01:59:48.941990] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-28T01:59:48.942116] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-28T01:59:48.942200] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-28T01:59:49.350682] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-28T01:59:49.356856] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:59:49.608904] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-28T01:59:50.389476] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-28T01:59:50.408850] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-28T01:59:50.670633] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-28T01:59:50.746396] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-28T01:59:50.757412] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-28T01:59:50.757670] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-28T01:59:51.156233] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-28T01:59:51.156372] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-28T01:59:51.157277] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-28T01:59:51.157366] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-28T01:59:51.159130] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54600 (keeping 200 days of data) [2025-09-28T01:59:51.234252] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-28T01:59:51.548790] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-09-28T01:59:51.549199] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-28T01:59:51.550675] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BABA took 42.3s. Estimated remaining: 4h 23m 18s. Rate: 8.2 symbols/min [2025-09-28T01:59:51.740944] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T01:59:51.817808] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-28T01:59:51.818007] [INFO ] [MAIN ] BAM: Loaded 52779 existing records. [2025-09-28T01:59:52.033062] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-28T01:59:52.029790] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-28T01:59:52.047725] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T01:59:52.050177] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-28T01:59:52.050501] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-28T01:59:52.051321] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-28T01:59:52.051486] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-28T01:59:52.456128] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T01:59:52.475279] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-28T01:59:52.808920] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-28T01:59:53.608914] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-28T01:59:53.820474] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-28T01:59:54.328734] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-28T01:59:54.408936] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-28T01:59:55.073945] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-28T01:59:55.208919] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-28T01:59:55.724195] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-28T01:59:56.008955] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-28T01:59:56.722163] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-28T01:59:56.790426] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-28T01:59:56.808851] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-28T01:59:57.608904] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-28T01:59:58.409509] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-28T01:59:58.418269] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-28T01:59:58.429362] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-28T01:59:59.208918] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-28T02:00:00.008920] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-28T02:00:00.216373] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-28T02:00:00.808887] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-28T02:00:01.205621] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-28T02:00:01.281876] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-28T02:00:01.609006] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-28T02:00:02.408954] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-28T02:00:03.197105] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-28T02:00:03.208956] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-28T02:00:03.249336] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-28T02:00:03.980078] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-28T02:00:04.008946] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-28T02:00:04.808975] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-28T02:00:05.608891] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-28T02:00:05.660638] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-28T02:00:05.727908] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-28T02:00:06.408917] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-28T02:00:07.208931] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-28T02:00:07.524059] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-28T02:00:08.008966] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-28T02:00:08.823268] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (4.01 seconds). [2025-09-28T02:00:08.834768] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-28T02:00:09.491624] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (3.08 seconds). [2025-09-28T02:00:09.500053] [INFO ] [REMOTE ] BAK: Full fetch complete (56955 records). [2025-09-28T02:00:09.500314] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-28T02:00:09.981539] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-28T02:00:09.981955] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-28T02:00:09.982925] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-28T02:00:09.985109] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-09-28T02:00:09.985207] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-28T02:00:09.996710] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-28T02:00:10.000483] [DEBUG] [LOCAL ] BAK: Trimmed 56955 records to 39413 (keeping 200 days of data) [2025-09-28T02:00:10.243086] [DEBUG] [LOCAL ] BAK: Primary data saved (39413 records). [2025-09-28T02:00:10.243338] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-28T02:00:10.243510] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BAK took 33.6s. Estimated remaining: 4h 25m 9s. Rate: 8.2 symbols/min [2025-09-28T02:00:10.430712] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:00:10.440392] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-28T02:00:10.445610] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-28T02:00:10.505361] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-28T02:00:10.505556] [INFO ] [MAIN ] BANC: Loaded 52019 existing records. [2025-09-28T02:00:10.703995] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:00:10.704270] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-28T02:00:10.704352] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-28T02:00:10.704743] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-28T02:00:10.704844] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-28T02:00:11.093858] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:00:11.208885] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-28T02:00:11.504003] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-28T02:00:11.539540] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-28T02:00:11.656561] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-28T02:00:12.008928] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-28T02:00:12.548091] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-28T02:00:12.808889] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-28T02:00:13.010127] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-28T02:00:13.608917] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-28T02:00:14.408892] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-28T02:00:14.543401] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-28T02:00:15.208882] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-28T02:00:15.255481] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-28T02:00:15.258245] [INFO ] [REMOTE ] BALY: Full fetch complete (17169 records). [2025-09-28T02:00:15.258402] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-28T02:00:15.511475] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:00:15.512027] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:00:15.512152] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:00:15.512346] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-28T02:00:15.512597] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-28T02:00:15.512796] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-28T02:00:15.513088] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-28T02:00:15.513267] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BALY took 26.8s. Estimated remaining: 4h 24m 40s. Rate: 8.2 symbols/min [2025-09-28T02:00:15.726876] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-28T02:00:15.731136] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:00:15.776542] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-28T02:00:15.776763] [INFO ] [MAIN ] BAP: Loaded 26635 existing records. [2025-09-28T02:00:15.967907] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:00:15.968171] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-28T02:00:15.968279] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-28T02:00:15.969057] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-28T02:00:15.969156] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-28T02:00:16.014000] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-28T02:00:16.374262] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:00:16.808872] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-28T02:00:16.852944] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-28T02:00:16.863465] [INFO ] [REMOTE ] BALL: Full fetch complete (75382 records). [2025-09-28T02:00:16.863716] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-28T02:00:17.285784] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-28T02:00:17.285967] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-28T02:00:17.286897] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-28T02:00:17.287000] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-28T02:00:17.289938] [DEBUG] [LOCAL ] BALL: Trimmed 75382 records to 52583 (keeping 200 days of data) [2025-09-28T02:00:17.609192] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-28T02:00:17.638575] [DEBUG] [LOCAL ] BALL: Primary data saved (52583 records). [2025-09-28T02:00:17.638836] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-28T02:00:17.639008] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BALL took 31.6s. Estimated remaining: 4h 23m 39s. Rate: 8.2 symbols/min [2025-09-28T02:00:17.836222] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:00:17.864081] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-28T02:00:17.931473] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-28T02:00:17.931799] [INFO ] [MAIN ] BARK: Loaded 38893 existing records. [2025-09-28T02:00:18.146638] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:00:18.146969] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-28T02:00:18.147067] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-28T02:00:18.147436] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-28T02:00:18.147538] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-28T02:00:18.427156] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-28T02:00:18.617632] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-28T02:00:18.821554] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:00:18.945228] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-28T02:00:19.208959] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-28T02:00:20.008906] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-28T02:00:20.518617] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-28T02:00:20.808880] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-28T02:00:20.967854] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-28T02:00:21.060898] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-28T02:00:21.608929] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-28T02:00:22.408976] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-28T02:00:22.529346] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-28T02:00:22.581400] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-28T02:00:23.208974] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-28T02:00:23.894012] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-28T02:00:24.008927] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-28T02:00:24.604332] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-28T02:00:24.808906] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-28T02:00:25.498886] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-28T02:00:25.509624] [INFO ] [REMOTE ] BAM: Full fetch complete (74174 records). [2025-09-28T02:00:25.509899] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-28T02:00:25.618052] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-28T02:00:25.959570] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-28T02:00:25.959909] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-28T02:00:25.961183] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-28T02:00:25.961432] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-28T02:00:25.981071] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-28T02:00:25.987608] [DEBUG] [LOCAL ] BAM: Trimmed 74174 records to 52779 (keeping 200 days of data) [2025-09-28T02:00:26.334626] [DEBUG] [LOCAL ] BAM: Primary data saved (52779 records). [2025-09-28T02:00:26.334985] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-28T02:00:26.336227] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BAM took 34.8s. Estimated remaining: 4h 23m 46s. Rate: 8.2 symbols/min [2025-09-28T02:00:26.412677] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-28T02:00:26.533295] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:00:26.599090] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-28T02:00:26.599276] [INFO ] [MAIN ] BAX: Loaded 54273 existing records. [2025-09-28T02:00:26.788164] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:00:26.788408] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-28T02:00:26.788495] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-28T02:00:26.788841] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-28T02:00:26.788922] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-28T02:00:27.172095] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:00:27.208850] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-28T02:00:27.618443] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-28T02:00:27.751811] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-28T02:00:28.008926] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-28T02:00:28.770323] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-28T02:00:28.808931] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-28T02:00:29.608929] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-28T02:00:29.832202] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-28T02:00:30.408918] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-28T02:00:30.533020] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-28T02:00:31.146933] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-28T02:00:31.208905] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-28T02:00:32.008922] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-28T02:00:32.296011] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-28T02:00:32.692330] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-28T02:00:32.808930] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-28T02:00:33.608879] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-28T02:00:34.041464] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-28T02:00:34.408921] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-28T02:00:34.579590] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-28T02:00:35.003318] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-28T02:00:35.208907] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-28T02:00:35.675477] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-28T02:00:36.008902] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-28T02:00:36.072206] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-28T02:00:36.808936] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-28T02:00:37.608921] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-28T02:00:37.822624] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-28T02:00:37.833069] [INFO ] [REMOTE ] BANC: Full fetch complete (74184 records). [2025-09-28T02:00:37.833284] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-28T02:00:38.256889] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-28T02:00:38.257244] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-28T02:00:38.265538] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-28T02:00:38.278060] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-28T02:00:38.280351] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-28T02:00:38.288289] [DEBUG] [LOCAL ] BANC: Trimmed 74184 records to 52019 (keeping 200 days of data) [2025-09-28T02:00:38.410894] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-28T02:00:38.623322] [DEBUG] [LOCAL ] BANC: Primary data saved (52019 records). [2025-09-28T02:00:38.623496] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-28T02:00:38.623623] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BANC took 28.4s. Estimated remaining: 4h 24m 29s. Rate: 8.2 symbols/min [2025-09-28T02:00:38.801471] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:00:38.868680] [DEBUG] [LOCAL ] BB: Loaded 53701 existing records from primary storage. [2025-09-28T02:00:38.871187] [INFO ] [MAIN ] BB: Loaded 53701 existing records. [2025-09-28T02:00:38.930506] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-28T02:00:39.074236] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:00:39.074493] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-28T02:00:39.074590] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-28T02:00:39.074918] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-28T02:00:39.075009] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-28T02:00:39.214050] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-28T02:00:39.468338] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:00:40.008937] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-28T02:00:40.272861] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-28T02:00:40.808912] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-28T02:00:41.097075] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-28T02:00:41.608913] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-28T02:00:42.224765] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-28T02:00:42.408877] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-28T02:00:42.743016] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-28T02:00:43.208884] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-28T02:00:43.539037] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-28T02:00:44.008903] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-28T02:00:44.591453] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-28T02:00:44.808873] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-28T02:00:45.043358] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-28T02:00:45.588513] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-28T02:00:45.608859] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-28T02:00:46.408912] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-28T02:00:46.695002] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-28T02:00:46.883307] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-28T02:00:46.890513] [INFO ] [REMOTE ] BARK: Full fetch complete (56850 records). [2025-09-28T02:00:46.890721] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-28T02:00:47.213962] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-28T02:00:47.282556] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-28T02:00:47.282694] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-28T02:00:47.283494] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-28T02:00:47.283583] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-28T02:00:47.285155] [DEBUG] [LOCAL ] BARK: Trimmed 56850 records to 38893 (keeping 200 days of data) [2025-09-28T02:00:47.516626] [DEBUG] [LOCAL ] BARK: Primary data saved (38893 records). [2025-09-28T02:00:47.516902] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-28T02:00:47.517148] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BARK took 29.9s. Estimated remaining: 4h 24m 37s. Rate: 8.2 symbols/min [2025-09-28T02:00:47.695695] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:00:47.749178] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-28T02:00:47.749416] [INFO ] [MAIN ] BBAI: Loaded 54600 existing records. [2025-09-28T02:00:47.965203] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:00:47.965426] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-28T02:00:47.965507] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-28T02:00:47.966009] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-28T02:00:47.966094] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-28T02:00:48.010312] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-28T02:00:48.352611] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:00:48.386083] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-28T02:00:48.808949] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-28T02:00:49.340142] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-28T02:00:49.499374] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-28T02:00:49.608939] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-28T02:00:50.408948] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-28T02:00:50.516512] [DEBUG] [REMOTE ] BB: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-28T02:00:50.516951] [WARN ] [REMOTE ] BB: No data returned for month 2025-04 [2025-09-28T02:00:50.517053] [FATAL] [REMOTE ] BB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:00:50.517168] [FATAL] [MAIN ] BB: Failed to fetch primary data. [2025-09-28T02:00:50.517243] [WARN ] [MAIN ] BB: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:00:50.517323] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-28T02:00:50.517427] [DEBUG] [LOCAL ] BB: No primary data file found to delete. [2025-09-28T02:00:50.517511] [INFO ] [LOCAL ] BB: Starting deletion of derivative data. [2025-09-28T02:00:50.517597] [DEBUG] [LOCAL ] BB: No derivative data file found to delete. [2025-09-28T02:00:50.517737] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BB took 11.9s. Estimated remaining: 4h 23m 46s. Rate: 8.2 symbols/min [2025-09-28T02:00:50.703524] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:00:50.752319] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-28T02:00:50.752513] [INFO ] [MAIN ] BBAR: Loaded 41988 existing records. [2025-09-28T02:00:50.954849] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:00:50.969793] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-28T02:00:50.972382] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-28T02:00:50.974126] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-28T02:00:50.974228] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-28T02:00:50.980193] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-28T02:00:51.018757] [INFO ] [REMOTE ] BAP: Full fetch complete (37758 records). [2025-09-28T02:00:51.046039] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-28T02:00:51.210297] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-28T02:00:51.759490] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:00:51.845929] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-28T02:00:51.846207] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-28T02:00:51.846867] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-28T02:00:51.847136] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-28T02:00:51.848309] [DEBUG] [LOCAL ] BAP: Trimmed 37758 records to 26635 (keeping 200 days of data) [2025-09-28T02:00:51.979008] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (3.17 seconds). [2025-09-28T02:00:52.011891] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-28T02:00:52.072081] [DEBUG] [LOCAL ] BAP: Primary data saved (26635 records). [2025-09-28T02:00:52.072280] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-28T02:00:52.072413] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAP took 36.6s. Estimated remaining: 4h 22m 41s. Rate: 8.2 symbols/min [2025-09-28T02:00:52.265602] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:00:52.324754] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-28T02:00:52.324946] [INFO ] [MAIN ] BBD: Loaded 53959 existing records. [2025-09-28T02:00:52.513939] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:00:52.514206] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-28T02:00:52.514287] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-28T02:00:52.514564] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-28T02:00:52.514689] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-28T02:00:52.814006] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-28T02:00:52.895085] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:00:53.304271] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-28T02:00:53.616248] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-28T02:00:53.634440] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-28T02:00:54.408948] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-28T02:00:55.208957] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-28T02:00:55.506565] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-28T02:00:55.550105] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-28T02:00:55.644810] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-28T02:00:56.008936] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-28T02:00:56.808944] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-28T02:00:57.106153] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-28T02:00:57.609013] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-28T02:00:58.284672] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-28T02:00:58.408904] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-28T02:00:58.862205] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-09-28T02:00:59.208969] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-28T02:00:59.564616] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-28T02:01:00.008914] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-28T02:01:00.327808] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-28T02:01:00.342980] [INFO ] [REMOTE ] BAX: Full fetch complete (77441 records). [2025-09-28T02:01:00.343267] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-28T02:01:00.798599] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-28T02:01:00.798762] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-28T02:01:00.799723] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-28T02:01:00.799817] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-28T02:01:00.801533] [DEBUG] [LOCAL ] BAX: Trimmed 77441 records to 54273 (keeping 200 days of data) [2025-09-28T02:01:00.857228] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-28T02:01:01.155821] [DEBUG] [LOCAL ] BAX: Primary data saved (54273 records). [2025-09-28T02:01:01.156079] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-28T02:01:01.158011] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BAX took 34.8s. Estimated remaining: 4h 22m 51s. Rate: 8.2 symbols/min [2025-09-28T02:01:01.372431] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:01:01.430828] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-28T02:01:01.431027] [INFO ] [MAIN ] BBDC: Loaded 33756 existing records. [2025-09-28T02:01:01.646403] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:01:01.646663] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-28T02:01:01.646748] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-28T02:01:01.647050] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-28T02:01:01.647132] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-28T02:01:02.066208] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:01:02.067439] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-28T02:01:02.105606] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-09-28T02:01:02.146954] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-28T02:01:02.408887] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-28T02:01:02.729894] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-28T02:01:03.208914] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-28T02:01:03.629475] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-28T02:01:04.008917] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-28T02:01:04.808950] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-28T02:01:05.131241] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-28T02:01:05.233603] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-28T02:01:05.608920] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-28T02:01:05.662283] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-28T02:01:06.190576] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-28T02:01:06.408922] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-28T02:01:07.208883] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-28T02:01:07.272330] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-28T02:01:07.714345] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-28T02:01:08.008952] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-28T02:01:08.808967] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-28T02:01:09.580603] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-28T02:01:09.608938] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-28T02:01:09.932786] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-09-28T02:01:10.316225] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-28T02:01:10.408950] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-28T02:01:11.169166] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-28T02:01:11.208913] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-28T02:01:12.008894] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-28T02:01:12.319191] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-28T02:01:12.808958] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-28T02:01:13.322941] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-28T02:01:13.491322] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-28T02:01:13.608977] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-28T02:01:14.408865] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-28T02:01:14.784879] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-28T02:01:14.932973] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-28T02:01:15.208934] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-28T02:01:16.008926] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-28T02:01:16.053630] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-28T02:01:16.359695] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-28T02:01:16.808935] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-28T02:01:17.608894] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-28T02:01:17.935174] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-28T02:01:18.408927] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-28T02:01:18.485377] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-28T02:01:18.494903] [INFO ] [REMOTE ] BBAR: Full fetch complete (60747 records). [2025-09-28T02:01:18.495087] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-28T02:01:18.906452] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-28T02:01:18.906700] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-28T02:01:18.907777] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-28T02:01:18.907878] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-28T02:01:18.909394] [DEBUG] [LOCAL ] BBAR: Trimmed 60747 records to 41988 (keeping 200 days of data) [2025-09-28T02:01:19.023145] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-28T02:01:19.210300] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-28T02:01:19.214413] [DEBUG] [LOCAL ] BBAR: Primary data saved (41988 records). [2025-09-28T02:01:19.214510] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-28T02:01:19.214636] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 28.7s. Estimated remaining: 4h 24m 30s. Rate: 8.1 symbols/min [2025-09-28T02:01:19.399918] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:01:19.408209] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-28T02:01:19.408368] [INFO ] [MAIN ] BBDO: Loaded 5051 existing records. [2025-09-28T02:01:19.592735] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:01:19.592952] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-28T02:01:19.593030] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-28T02:01:19.593427] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-28T02:01:19.593507] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-28T02:01:19.982143] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:01:20.008936] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-28T02:01:20.347404] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-28T02:01:20.813037] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-28T02:01:20.814059] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-28T02:01:21.394753] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-09-28T02:01:21.609009] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-28T02:01:22.408912] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-28T02:01:22.769116] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-28T02:01:22.780275] [INFO ] [REMOTE ] BBD: Full fetch complete (77118 records). [2025-09-28T02:01:22.780487] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-28T02:01:23.196330] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-28T02:01:23.196520] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-28T02:01:23.197601] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-28T02:01:23.197751] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-28T02:01:23.199617] [DEBUG] [LOCAL ] BBD: Trimmed 77118 records to 53959 (keeping 200 days of data) [2025-09-28T02:01:23.253815] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-28T02:01:23.299674] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-28T02:01:23.582046] [DEBUG] [LOCAL ] BBD: Primary data saved (53959 records). [2025-09-28T02:01:23.582250] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-28T02:01:23.582387] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBD took 31.5s. Estimated remaining: 4h 23m 53s. Rate: 8.2 symbols/min [2025-09-28T02:01:23.771589] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:01:23.792958] [DEBUG] [LOCAL ] BBN: Loaded 18193 existing records from primary storage. [2025-09-28T02:01:23.793142] [INFO ] [MAIN ] BBN: Loaded 18193 existing records. [2025-09-28T02:01:24.005318] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:01:24.005861] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-28T02:01:24.006021] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-28T02:01:24.006353] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-28T02:01:24.006448] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-28T02:01:24.041355] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-28T02:01:24.426395] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:01:24.461973] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-09-28T02:01:24.598359] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-28T02:01:24.599349] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-28T02:01:24.808911] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-28T02:01:25.608912] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-28T02:01:26.173339] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-28T02:01:26.226888] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-28T02:01:26.408948] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-28T02:01:27.208936] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-28T02:01:27.969763] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-28T02:01:28.008947] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-28T02:01:28.808953] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-28T02:01:29.135246] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-28T02:01:29.148034] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-28T02:01:29.148363] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-28T02:01:29.499434] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-28T02:01:29.616026] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-28T02:01:29.779525] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-28T02:01:29.779699] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-28T02:01:29.780678] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-28T02:01:29.780799] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-28T02:01:29.783223] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-09-28T02:01:30.183838] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-09-28T02:01:30.184031] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-28T02:01:30.184204] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBAI took 42.7s. Estimated remaining: 4h 23m 38s. Rate: 8.2 symbols/min [2025-09-28T02:01:30.348038] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-28T02:01:30.410718] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-28T02:01:30.418633] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:01:30.438032] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-28T02:01:30.438155] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-28T02:01:30.438991] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-28T02:01:30.440029] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-28T02:01:30.439853] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-28T02:01:30.440307] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-28T02:01:30.448354] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-28T02:01:30.484632] [INFO ] [REMOTE ] BBDC: Full fetch complete (48839 records). [2025-09-28T02:01:30.512069] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-28T02:01:31.220479] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-28T02:01:31.275289] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:01:31.389582] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-28T02:01:31.389759] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-28T02:01:31.390489] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-28T02:01:31.390594] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-28T02:01:31.392251] [DEBUG] [LOCAL ] BBDC: Trimmed 48839 records to 33756 (keeping 200 days of data) [2025-09-28T02:01:31.603559] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-28T02:01:31.636169] [DEBUG] [LOCAL ] BBDC: Primary data saved (33756 records). [2025-09-28T02:01:31.636373] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-28T02:01:31.638168] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBDC took 30.5s. Estimated remaining: 4h 22m 33s. Rate: 8.2 symbols/min [2025-09-28T02:01:31.820446] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:01:31.830306] [DEBUG] [LOCAL ] BBU: Loaded 4478 existing records from primary storage. [2025-09-28T02:01:31.830475] [INFO ] [MAIN ] BBU: Loaded 4478 existing records. [2025-09-28T02:01:32.004296] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-28T02:01:32.012530] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-28T02:01:32.043018] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:01:32.047250] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-28T02:01:32.047848] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-28T02:01:32.048166] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-28T02:01:32.048245] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-28T02:01:32.344401] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:01:32.353323] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-28T02:01:32.373958] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:01:32.398715] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-09-28T02:01:32.434420] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:01:32.434349] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:01:32.434601] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-28T02:01:32.435019] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-28T02:01:32.435108] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-28T02:01:32.435247] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-28T02:01:32.435365] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBT took 2.3s. Estimated remaining: 4h 21m 23s. Rate: 8.2 symbols/min [2025-09-28T02:01:32.621370] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:01:32.637072] [DEBUG] [LOCAL ] BBUC: Loaded 13503 existing records from primary storage. [2025-09-28T02:01:32.637265] [INFO ] [MAIN ] BBUC: Loaded 13503 existing records. [2025-09-28T02:01:32.822483] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-28T02:01:32.829144] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:01:32.830282] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-28T02:01:32.830409] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-28T02:01:32.830727] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-28T02:01:32.830807] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-28T02:01:33.222826] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:01:33.514696] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-28T02:01:33.608921] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-28T02:01:34.196250] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-28T02:01:34.408904] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-28T02:01:35.126288] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-28T02:01:35.208905] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-28T02:01:36.008907] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-28T02:01:36.073551] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-28T02:01:36.808897] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-28T02:01:36.996142] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-28T02:01:37.231112] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-28T02:01:37.608927] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-28T02:01:38.240710] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-28T02:01:38.242207] [INFO ] [REMOTE ] BBDO: Full fetch complete (7688 records). [2025-09-28T02:01:38.242337] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-28T02:01:38.414023] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-28T02:01:38.667876] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-28T02:01:38.668003] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-28T02:01:38.668240] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-28T02:01:38.668321] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-28T02:01:38.668912] [DEBUG] [LOCAL ] BBDO: Trimmed 7688 records to 5051 (keeping 200 days of data) [2025-09-28T02:01:38.701861] [DEBUG] [LOCAL ] BBDO: Primary data saved (5051 records). [2025-09-28T02:01:38.702064] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-28T02:01:38.702200] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBDO took 19.5s. Estimated remaining: 4h 21m 6s. Rate: 8.2 symbols/min [2025-09-28T02:01:38.884043] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:01:38.945151] [DEBUG] [LOCAL ] BBVA: Loaded 50167 existing records from primary storage. [2025-09-28T02:01:38.945373] [INFO ] [MAIN ] BBVA: Loaded 50167 existing records. [2025-09-28T02:01:39.148484] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-28T02:01:39.148746] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-28T02:01:39.148828] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-28T02:01:39.149177] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-28T02:01:39.149264] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-28T02:01:39.218976] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-28T02:01:39.456080] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-28T02:01:39.555158] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:01:40.008916] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-28T02:01:40.463159] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-28T02:01:40.808912] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-28T02:01:41.608908] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-28T02:01:41.681004] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-28T02:01:41.865599] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-28T02:01:42.408920] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-28T02:01:42.558472] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-28T02:01:43.208884] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-28T02:01:43.429460] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-28T02:01:44.008969] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-28T02:01:44.184368] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-28T02:01:44.613766] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-28T02:01:44.808944] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-28T02:01:45.390520] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-28T02:01:45.608921] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-28T02:01:46.174469] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-28T02:01:46.408911] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-28T02:01:47.208898] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-28T02:01:47.487382] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-28T02:01:47.786873] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-28T02:01:48.008939] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-28T02:01:48.808939] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-28T02:01:49.608902] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-28T02:01:49.818561] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-28T02:01:49.865369] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-28T02:01:50.168114] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-28T02:01:50.408940] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-28T02:01:51.208956] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-28T02:01:52.008958] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-28T02:01:52.128244] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-28T02:01:52.287037] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-28T02:01:52.537040] [WARN ] [STATE ] Received SIGINT signal. Initiating graceful shutdown... [2025-09-28T02:01:52.542769] [WARN ] [REMOTE ] BBUC: Shutdown requested, stopping month iteration [2025-09-28T02:01:52.542998] [WARN ] [MAIN ] BBUC: Shutdown requested, aborting refresh [2025-09-28T02:01:52.543502] [WARN ] [STATE ] Operation was interrupted, setting state to COMPLETED_ERROR [2025-09-28T02:01:52.543811] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-09-28T02:01:52.544062] [INFO ] [STATE ] Last completion updated: 2025-09-28T02:01:52.543892 [2025-09-28T02:01:52.544278] [WARN ] [MAIN ] Main thread: Shutdown detected, cancelling 3 pending tasks [2025-09-28T02:01:52.544419] [WARN ] [MAIN ] Shutting down thread pool executor... [2025-09-28T02:01:52.808935] [WARN ] [REMOTE ] BBN: Shutdown requested, aborting fetch for 2025-08 [2025-09-28T02:01:52.809288] [WARN ] [REMOTE ] BBN: Shutdown requested, stopping month iteration [2025-09-28T02:01:52.809417] [WARN ] [MAIN ] BBN: Shutdown requested, aborting refresh [2025-09-28T02:01:53.608961] [WARN ] [REMOTE ] BBVA: Shutdown requested, aborting fetch for 2025-03 [2025-09-28T02:01:53.609274] [WARN ] [REMOTE ] BBVA: Shutdown requested, stopping month iteration [2025-09-28T02:01:53.609443] [WARN ] [MAIN ] BBVA: Shutdown requested, aborting refresh [2025-09-28T02:01:54.408958] [WARN ] [REMOTE ] BBU: Shutdown requested, aborting fetch for 2025-06 [2025-09-28T02:01:54.409264] [WARN ] [REMOTE ] BBU: Shutdown requested, stopping month iteration [2025-09-28T02:01:54.409429] [WARN ] [MAIN ] BBU: Shutdown requested, aborting refresh [2025-09-28T02:01:54.409910] [WARN ] [MAIN ] Update INTERRUPTED after 27m 22s. Processed 227/2371 symbols before shutdown. [2025-09-28T02:01:55.142886] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_ERROR: TDM All Symbols Update Failed' [2025-09-28T02:01:55.143498] [WARN ] [STATE ] State set to: RUNNING [2025-09-28T02:01:55.143581] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-09-28T02:01:55.143700] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T02:01:55.143858] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T02:01:55.143933] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T02:01:56.084170] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T02:01:56.084366] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T02:01:56.084686] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T02:01:56.085343] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T02:01:56.085428] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T02:01:56.085501] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T02:01:56.085605] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-28T02:01:56.085720] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T02:01:56.085793] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T02:01:56.086258] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T02:01:56.086333] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T02:01:56.086554] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T02:01:56.086632] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T02:01:56.086732] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T02:01:56.086838] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T02:01:56.114926] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T02:01:56.115406] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T02:01:56.115486] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T02:01:56.115560] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T02:01:56.115632] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T02:01:56.115759] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-28T02:01:56.115834] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-28T02:01:56.115916] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-28T02:01:56.116020] [INFO ] [LOCAL ] Deleted 0 derivative data files. [2025-09-28T02:01:56.116427] [FATAL] [MAIN ] Exception during derivative generation: No module named 'BlacklistTracker' [2025-09-28T02:01:56.116709] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-09-28T02:01:56.116929] [INFO ] [STATE ] Last completion updated: 2025-09-28T02:01:56.116815 [2025-09-28T02:01:56.117243] [INFO ] [STATE ] TDM shutdown complete. [2025-09-28T02:02:27.370317] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-28T02:02:27.370512] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T02:02:27.370688] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T02:02:27.370764] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T02:02:28.897871] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T02:02:28.898056] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T02:02:28.898287] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T02:02:28.899008] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T02:02:28.899086] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T02:02:28.899157] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T02:02:28.899256] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T02:02:28.899381] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T02:02:28.899794] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T02:02:28.899867] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T02:02:28.900061] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T02:02:28.900133] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T02:02:28.900204] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T02:02:28.900276] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T02:02:28.927088] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T02:02:28.927233] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T02:02:28.927311] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T02:02:28.927384] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T02:02:28.927454] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T02:02:28.927699] [WARN ] [STATE ] State set to: RUNNING [2025-09-28T02:02:28.927779] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-09-28T02:02:28.927871] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T02:02:28.928014] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T02:02:28.928097] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T02:02:30.325393] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T02:02:30.325586] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T02:02:30.325871] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T02:02:30.326379] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T02:02:30.326460] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T02:02:30.326537] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T02:02:30.326697] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-28T02:02:30.326799] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T02:02:30.326903] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T02:02:30.327293] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T02:02:30.327366] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T02:02:30.327561] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T02:02:30.327636] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T02:02:30.327753] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T02:02:30.327826] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T02:02:30.354105] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T02:02:30.354259] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T02:02:30.354330] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T02:02:30.354401] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T02:02:30.354468] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T02:02:30.354559] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T02:02:30.354957] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T02:02:30.355028] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T02:02:30.355106] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-28T02:02:30.355194] [INFO ] [MAIN ] Running in parallel mode [2025-09-28T02:02:30.355352] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-28T02:02:30.992275] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:31.138785] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:31.175335] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:31.177833] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-28T02:02:31.203204] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:31.203772] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-28T02:02:31.203877] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-28T02:02:31.183904] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-28T02:02:31.205266] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-28T02:02:31.205477] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-28T02:02:31.205620] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-28T02:02:31.205768] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-28T02:02:31.205823] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-28T02:02:31.206044] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-28T02:02:31.206162] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-28T02:02:31.218395] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-28T02:02:31.785087] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-28T02:02:31.843429] [INFO ] [MAIN ] AA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:31.844552] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-28T02:02:31.924978] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AA took 1.6s. Estimated remaining: 1h 2m 0s. Rate: 38.2 symbols/min [2025-09-28T02:02:31.930488] [INFO ] [MAIN ] A: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:31.994453] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. A took 1.6s. Estimated remaining: 32m 22s. Rate: 73.2 symbols/min [2025-09-28T02:02:32.451493] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:02:32.519407] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-28T02:02:32.539528] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:02:32.607853] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-28T02:02:32.607431] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:32.633393] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:32.672283] [DEBUG] [LOCAL ] AAT: Loaded 31069 existing records from primary storage. [2025-09-28T02:02:32.672720] [INFO ] [MAIN ] AAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:32.672831] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAT took 0.7s. Estimated remaining: 30m 29s. Rate: 77.7 symbols/min [2025-09-28T02:02:32.788814] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:02:32.838394] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-28T02:02:32.893693] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-28T02:02:32.895311] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:02:32.895820] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-09-28T02:02:32.895973] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:02:32.895079] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:32.911028] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-28T02:02:32.911435] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-28T02:02:32.927874] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-28T02:02:32.928068] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-28T02:02:32.924932] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-28T02:02:32.928323] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-28T02:02:32.928503] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAMI took 2.5s. Estimated remaining: 25m 23s. Rate: 93.3 symbols/min [2025-09-28T02:02:32.928858] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-28T02:02:32.943281] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-28T02:02:32.949130] [INFO ] [MAIN ] AAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:32.949341] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-28T02:02:32.972453] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAP took 1.0s. Estimated remaining: 20m 38s. Rate: 114.6 symbols/min [2025-09-28T02:02:32.981885] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-28T02:02:33.064461] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-28T02:02:33.064709] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-28T02:02:33.237158] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-28T02:02:33.354341] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-28T02:02:33.402423] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:33.516673] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:33.682344] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-28T02:02:33.704226] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-28T02:02:33.780538] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-28T02:02:33.784635] [INFO ] [MAIN ] AB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:33.808130] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:02:33.808528] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AB took 0.9s. Estimated remaining: 22m 41s. Rate: 104.3 symbols/min [2025-09-28T02:02:33.814476] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-28T02:02:34.025866] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-28T02:02:34.047946] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:34.050042] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-28T02:02:34.053782] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-28T02:02:34.054408] [INFO ] [MAIN ] ABBV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:34.055329] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. ABBV took 1.0s. Estimated remaining: 20m 50s. Rate: 113.5 symbols/min [2025-09-28T02:02:34.082440] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:02:34.155458] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-28T02:02:34.172280] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:02:34.176794] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-09-28T02:02:34.177381] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:02:34.219016] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-28T02:02:34.270997] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-28T02:02:34.271251] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-28T02:02:34.270141] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:34.280359] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-28T02:02:34.281368] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-28T02:02:34.280702] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AAUC took 1.6s. Estimated remaining: 19m 19s. Rate: 122.3 symbols/min [2025-09-28T02:02:34.287854] [INFO ] [MAIN ] ABCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:34.330018] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 0.5s. Estimated remaining: 17m 23s. Rate: 135.9 symbols/min [2025-09-28T02:02:34.324582] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-28T02:02:34.421819] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-28T02:02:34.703893] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:34.709038] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:34.714792] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-28T02:02:34.734510] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-28T02:02:34.737716] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-28T02:02:34.738680] [INFO ] [MAIN ] ABEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:34.739237] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABEV took 0.7s. Estimated remaining: 17m 15s. Rate: 136.9 symbols/min [2025-09-28T02:02:34.876997] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-28T02:02:34.893767] [INFO ] [MAIN ] ABG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:34.920195] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABG took 0.6s. Estimated remaining: 16m 19s. Rate: 144.6 symbols/min [2025-09-28T02:02:35.030311] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:34.962266] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-28T02:02:35.063482] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-28T02:02:35.062807] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-28T02:02:35.075378] [INFO ] [MAIN ] ABM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:35.086471] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABM took 0.8s. Estimated remaining: 15m 30s. Rate: 152.2 symbols/min [2025-09-28T02:02:35.338516] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:35.410300] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:35.414831] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-28T02:02:35.416840] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-28T02:02:35.440870] [DEBUG] [LOCAL ] ABR: Loaded 52817 existing records from primary storage. [2025-09-28T02:02:35.445491] [INFO ] [MAIN ] ABR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:35.446426] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABR took 0.7s. Estimated remaining: 15m 23s. Rate: 153.2 symbols/min [2025-09-28T02:02:35.595631] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-28T02:02:35.596269] [INFO ] [MAIN ] ACA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:35.597559] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 0.5s. Estimated remaining: 14m 43s. Rate: 160.2 symbols/min [2025-09-28T02:02:35.720677] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:35.721069] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-28T02:02:35.777967] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-28T02:02:35.803138] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-28T02:02:35.808926] [INFO ] [MAIN ] ABT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:35.840340] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABT took 0.9s. Estimated remaining: 14m 22s. Rate: 164.1 symbols/min [2025-09-28T02:02:35.983743] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:36.056209] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-28T02:02:36.069314] [INFO ] [REMOTE ] AAM: Full fetch complete (966 records). [2025-09-28T02:02:36.083689] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-28T02:02:36.096432] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:02:36.096933] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:02:36.107886] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:02:36.120241] [DEBUG] [LOCAL ] ACCO: Loaded 38214 existing records from primary storage. [2025-09-28T02:02:36.150005] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-28T02:02:36.167302] [INFO ] [MAIN ] ACCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:36.167929] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-28T02:02:36.191689] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-28T02:02:36.178006] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ACCO took 0.7s. Estimated remaining: 14m 17s. Rate: 164.9 symbols/min [2025-09-28T02:02:36.195179] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:36.230531] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-28T02:02:36.231806] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-28T02:02:36.244678] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. AAM took 5.9s. Estimated remaining: 13m 36s. Rate: 173.2 symbols/min [2025-09-28T02:02:36.256225] [INFO ] [MAIN ] ACEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:36.297635] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 0.7s. Estimated remaining: 12m 57s. Rate: 181.7 symbols/min [2025-09-28T02:02:36.724956] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:36.762528] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:36.868391] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:36.875110] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-28T02:02:36.876349] [INFO ] [MAIN ] ACHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:36.876899] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACHR took 1.0s. Estimated remaining: 13m 27s. Rate: 174.8 symbols/min [2025-09-28T02:02:37.179491] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-28T02:02:37.153376] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-28T02:02:37.198717] [INFO ] [MAIN ] ACM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:37.203823] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACM took 1.0s. Estimated remaining: 13m 25s. Rate: 175.2 symbols/min [2025-09-28T02:02:37.202683] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:37.203964] [INFO ] [MAIN ] ACI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:37.210322] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACI took 1.0s. Estimated remaining: 12m 47s. Rate: 183.8 symbols/min [2025-09-28T02:02:37.430684] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-28T02:02:37.493155] [INFO ] [MAIN ] ACN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:37.504000] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 1.1s. Estimated remaining: 12m 43s. Rate: 184.6 symbols/min [2025-09-28T02:02:37.751298] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:37.781267] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:37.855937] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-28T02:02:37.857719] [INFO ] [MAIN ] ACP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:37.862330] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACP took 1.0s. Estimated remaining: 12m 46s. Rate: 183.8 symbols/min [2025-09-28T02:02:37.862148] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-28T02:02:37.948188] [INFO ] [MAIN ] ACR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:38.005345] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACR took 0.8s. Estimated remaining: 12m 28s. Rate: 188.2 symbols/min [2025-09-28T02:02:38.059138] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:38.261058] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:38.300539] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-28T02:02:38.300340] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-28T02:02:38.316928] [INFO ] [MAIN ] ACV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:38.317099] [INFO ] [MAIN ] ACRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:38.317487] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. ACV took 0.8s. Estimated remaining: 12m 27s. Rate: 188.4 symbols/min [2025-09-28T02:02:38.362742] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACRE took 1.1s. Estimated remaining: 12m 2s. Rate: 194.8 symbols/min [2025-09-28T02:02:38.437854] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:38.471142] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-28T02:02:38.533215] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-28T02:02:38.617124] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-28T02:02:38.645562] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-28T02:02:38.716638] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-28T02:02:38.747251] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-28T02:02:38.775918] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:38.777424] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-28T02:02:38.846250] [INFO ] [MAIN ] ACVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:38.840137] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:38.857427] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACVA took 1.0s. Estimated remaining: 12m 18s. Rate: 190.5 symbols/min [2025-09-28T02:02:39.284165] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:39.319864] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-28T02:02:39.366177] [INFO ] [MAIN ] ADCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:39.388464] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ADCT took 1.0s. Estimated remaining: 12m 36s. Rate: 186.0 symbols/min [2025-09-28T02:02:39.402708] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-28T02:02:39.449722] [INFO ] [MAIN ] ADC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:39.517742] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADC took 1.2s. Estimated remaining: 12m 20s. Rate: 189.9 symbols/min [2025-09-28T02:02:39.658459] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:02:39.683798] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-28T02:02:39.848689] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-28T02:02:39.878490] [INFO ] [MAIN ] ADM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:39.880244] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:39.886359] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADM took 1.0s. Estimated remaining: 12m 24s. Rate: 188.9 symbols/min [2025-09-28T02:02:39.995510] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:02:40.001801] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:40.012848] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-28T02:02:40.027287] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:02:40.044095] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-09-28T02:02:40.067503] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:02:40.087424] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-28T02:02:40.093530] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-28T02:02:40.104155] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-28T02:02:40.141177] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-28T02:02:40.165056] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. AD took 2.1s. Estimated remaining: 12m 20s. Rate: 189.6 symbols/min [2025-09-28T02:02:40.170161] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:40.371703] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-28T02:02:40.465398] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-28T02:02:40.470299] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:40.471451] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-28T02:02:40.465605] [INFO ] [MAIN ] ADNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:40.472400] [INFO ] [MAIN ] ADX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:40.473865] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 1.1s. Estimated remaining: 12m 20s. Rate: 189.8 symbols/min [2025-09-28T02:02:40.472725] [INFO ] [MAIN ] ADT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:40.480473] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADX took 0.6s. Estimated remaining: 11m 57s. Rate: 195.6 symbols/min [2025-09-28T02:02:40.530600] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADT took 0.9s. Estimated remaining: 11m 39s. Rate: 200.5 symbols/min [2025-09-28T02:02:41.025592] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:41.024690] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:41.087789] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-28T02:02:41.092763] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:41.093777] [INFO ] [MAIN ] AEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:41.094880] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEE took 0.9s. Estimated remaining: 11m 57s. Rate: 195.5 symbols/min [2025-09-28T02:02:41.149287] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-28T02:02:41.173224] [INFO ] [MAIN ] AEFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:41.215466] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEFC took 0.7s. Estimated remaining: 11m 44s. Rate: 198.9 symbols/min [2025-09-28T02:02:41.427623] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:41.491178] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-28T02:02:41.519377] [INFO ] [MAIN ] AEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:41.583106] [DEBUG] [LOCAL ] AEM: Loaded 54243 existing records from primary storage. [2025-09-28T02:02:41.584365] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:41.584716] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 1.1s. Estimated remaining: 11m 48s. Rate: 197.7 symbols/min [2025-09-28T02:02:41.585737] [INFO ] [MAIN ] AEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:41.586824] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 1.0s. Estimated remaining: 11m 30s. Rate: 203.0 symbols/min [2025-09-28T02:02:41.641261] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-28T02:02:41.641810] [INFO ] [MAIN ] AEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:41.642304] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AEO took 0.5s. Estimated remaining: 11m 15s. Rate: 207.3 symbols/min [2025-09-28T02:02:41.688857] [DEBUG] [LOCAL ] AER: Loaded 49271 existing records from primary storage. [2025-09-28T02:02:41.689244] [INFO ] [MAIN ] AER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:41.689621] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AER took 0.4s. Estimated remaining: 11m 1s. Rate: 211.7 symbols/min [2025-09-28T02:02:42.391721] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:42.421380] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:42.468130] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:42.530379] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:42.531788] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-28T02:02:42.531861] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-28T02:02:42.531977] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-28T02:02:42.532041] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-28T02:02:42.532092] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-28T02:02:42.532130] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-28T02:02:42.637429] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-28T02:02:42.653692] [INFO ] [MAIN ] AFB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:42.664792] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AFB took 0.9s. Estimated remaining: 11m 40s. Rate: 199.8 symbols/min [2025-09-28T02:02:43.025411] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-28T02:02:43.044265] [INFO ] [MAIN ] AES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:43.051352] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AES took 1.4s. Estimated remaining: 11m 44s. Rate: 198.5 symbols/min [2025-09-28T02:02:43.139031] [DEBUG] [LOCAL ] AESI: Loaded 50213 existing records from primary storage. [2025-09-28T02:02:43.169727] [INFO ] [MAIN ] AESI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:43.221463] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:02:43.228004] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:43.233748] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-28T02:02:43.216401] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AESI took 1.5s. Estimated remaining: 11m 36s. Rate: 200.6 symbols/min [2025-09-28T02:02:43.523730] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:43.517479] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:02:43.587581] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-28T02:02:43.615131] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:43.629045] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-28T02:02:43.628826] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:02:43.630050] [INFO ] [MAIN ] AFGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:43.630497] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFGB took 0.5s. Estimated remaining: 11m 42s. Rate: 198.9 symbols/min [2025-09-28T02:02:43.629773] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-09-28T02:02:43.637348] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-28T02:02:43.682093] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:02:43.666874] [INFO ] [MAIN ] AFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:43.697992] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-28T02:02:43.700793] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AFG took 1.0s. Estimated remaining: 11m 30s. Rate: 202.3 symbols/min [2025-09-28T02:02:43.740561] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-28T02:02:43.740882] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-28T02:02:43.711631] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-28T02:02:43.746411] [INFO ] [MAIN ] AFGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:43.752019] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGC took 0.5s. Estimated remaining: 11m 17s. Rate: 206.0 symbols/min [2025-09-28T02:02:43.829581] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-28T02:02:43.916087] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AEXA took 2.2s. Estimated remaining: 11m 11s. Rate: 208.0 symbols/min [2025-09-28T02:02:44.184400] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:44.377410] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:44.430294] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-28T02:02:44.429989] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:44.464155] [INFO ] [MAIN ] AFGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:44.494846] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGD took 0.9s. Estimated remaining: 11m 24s. Rate: 203.7 symbols/min [2025-09-28T02:02:44.494492] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:44.563840] [DEBUG] [LOCAL ] AFGE: Loaded 2512 existing records from primary storage. [2025-09-28T02:02:44.606664] [INFO ] [MAIN ] AFGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:44.624533] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 0.9s. Estimated remaining: 11m 16s. Rate: 206.0 symbols/min [2025-09-28T02:02:44.766614] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:44.907717] [DEBUG] [LOCAL ] AFL: Loaded 53915 existing records from primary storage. [2025-09-28T02:02:44.976298] [INFO ] [MAIN ] AFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:44.975590] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:44.977160] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 1.2s. Estimated remaining: 11m 19s. Rate: 205.2 symbols/min [2025-09-28T02:02:44.983540] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-28T02:02:45.013022] [INFO ] [MAIN ] AG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:45.024516] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AG took 1.1s. Estimated remaining: 11m 7s. Rate: 208.6 symbols/min [2025-09-28T02:02:45.348000] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:45.310560] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-28T02:02:45.355080] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-28T02:02:45.361297] [INFO ] [MAIN ] AGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:45.361392] [INFO ] [MAIN ] AGCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:45.386958] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGD took 0.7s. Estimated remaining: 11m 10s. Rate: 207.6 symbols/min [2025-09-28T02:02:45.414627] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:45.420072] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 0.9s. Estimated remaining: 10m 59s. Rate: 211.1 symbols/min [2025-09-28T02:02:45.842766] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:45.838146] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:45.882513] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-28T02:02:45.885889] [INFO ] [MAIN ] AGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:45.886499] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGI took 0.9s. Estimated remaining: 11m 6s. Rate: 208.6 symbols/min [2025-09-28T02:02:45.887917] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-28T02:02:45.905779] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-28T02:02:45.906110] [INFO ] [MAIN ] AGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:45.906235] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGM took 0.5s. Estimated remaining: 10m 55s. Rate: 212.2 symbols/min [2025-09-28T02:02:45.905424] [INFO ] [MAIN ] AGL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:45.917559] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGL took 0.9s. Estimated remaining: 10m 43s. Rate: 215.9 symbols/min [2025-09-28T02:02:46.287211] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-28T02:02:46.336761] [INFO ] [MAIN ] AGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:46.363141] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:46.373606] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 0.9s. Estimated remaining: 10m 50s. Rate: 213.5 symbols/min [2025-09-28T02:02:46.529163] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:46.508397] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:46.708111] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:46.708899] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-28T02:02:46.736867] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-28T02:02:46.737290] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-28T02:02:46.737381] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-28T02:02:46.737451] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-28T02:02:46.737552] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-28T02:02:46.770358] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-28T02:02:46.797614] [INFO ] [MAIN ] AGRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:46.841434] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AGRO took 1.0s. Estimated remaining: 10m 57s. Rate: 211.1 symbols/min [2025-09-28T02:02:46.907561] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-28T02:02:46.922903] [DEBUG] [LOCAL ] AHH: Loaded 41885 existing records from primary storage. [2025-09-28T02:02:46.984615] [INFO ] [MAIN ] AGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:47.064709] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGX took 1.2s. Estimated remaining: 10m 55s. Rate: 211.9 symbols/min [2025-09-28T02:02:46.994114] [INFO ] [MAIN ] AHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:47.110633] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AHH took 1.2s. Estimated remaining: 10m 45s. Rate: 214.9 symbols/min [2025-09-28T02:02:47.429831] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:47.709341] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:47.723327] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:02:47.754104] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-28T02:02:47.758897] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:47.770531] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-28T02:02:47.783458] [INFO ] [MAIN ] AHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:47.783586] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHT took 0.7s. Estimated remaining: 10m 60s. Rate: 210.0 symbols/min [2025-09-28T02:02:47.932880] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:02:47.936010] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-28T02:02:47.935034] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-28T02:02:47.962889] [INFO ] [MAIN ] AHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:47.962628] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:02:47.996732] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHR took 1.1s. Estimated remaining: 10m 57s. Rate: 210.9 symbols/min [2025-09-28T02:02:48.020920] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-09-28T02:02:48.078835] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:02:48.055399] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:48.090330] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-28T02:02:48.114715] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-28T02:02:48.157789] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-28T02:02:48.170960] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-28T02:02:48.180253] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AHL took 1.7s. Estimated remaining: 10m 53s. Rate: 212.1 symbols/min [2025-09-28T02:02:48.182048] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-28T02:02:48.274824] [INFO ] [MAIN ] AI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:48.299400] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AI took 1.0s. Estimated remaining: 10m 47s. Rate: 214.0 symbols/min [2025-09-28T02:02:48.339260] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:48.439499] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-28T02:02:48.497290] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-28T02:02:48.524469] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-28T02:02:48.543724] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-28T02:02:48.565672] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-28T02:02:48.606758] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-28T02:02:48.660431] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-28T02:02:48.625419] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:48.715477] [INFO ] [MAIN ] AIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:48.758717] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:48.767213] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIG took 1.0s. Estimated remaining: 10m 53s. Rate: 211.8 symbols/min [2025-09-28T02:02:49.108837] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-28T02:02:49.109805] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-28T02:02:49.192951] [INFO ] [MAIN ] AIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:49.207744] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIO took 0.9s. Estimated remaining: 10m 58s. Rate: 210.1 symbols/min [2025-09-28T02:02:49.207934] [INFO ] [MAIN ] AIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:49.293945] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIN took 1.1s. Estimated remaining: 10m 51s. Rate: 212.3 symbols/min [2025-09-28T02:02:49.337957] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:49.411235] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:02:49.497440] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-28T02:02:49.720816] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:49.754994] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:02:49.787543] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-28T02:02:49.778977] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:49.791275] [DEBUG] [LOCAL ] AIR: Loaded 28152 existing records from primary storage. [2025-09-28T02:02:49.789670] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:02:49.792239] [INFO ] [MAIN ] AIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:49.792464] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIR took 1.0s. Estimated remaining: 10m 58s. Rate: 209.9 symbols/min [2025-09-28T02:02:49.804314] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-09-28T02:02:49.810103] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:02:49.827045] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-28T02:02:49.844119] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-28T02:02:49.844240] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-28T02:02:49.876860] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-28T02:02:49.896391] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AII took 1.9s. Estimated remaining: 10m 52s. Rate: 211.9 symbols/min [2025-09-28T02:02:50.022879] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-28T02:02:50.046273] [INFO ] [MAIN ] AIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:50.083336] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIT took 0.8s. Estimated remaining: 10m 48s. Rate: 212.9 symbols/min [2025-09-28T02:02:50.213787] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:50.306370] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-28T02:02:50.328600] [INFO ] [MAIN ] AIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:50.366485] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:50.367080] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 1.0s. Estimated remaining: 10m 48s. Rate: 212.9 symbols/min [2025-09-28T02:02:50.546423] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-28T02:02:50.552104] [INFO ] [MAIN ] AIZN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:50.589558] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZN took 0.7s. Estimated remaining: 10m 46s. Rate: 213.5 symbols/min [2025-09-28T02:02:50.615482] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:50.787611] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-28T02:02:50.818423] [INFO ] [MAIN ] AIZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:50.818261] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:50.824809] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-28T02:02:50.824496] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZ took 1.0s. Estimated remaining: 10m 44s. Rate: 214.0 symbols/min [2025-09-28T02:02:50.835253] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-28T02:02:50.846155] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-28T02:02:50.867193] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-28T02:02:50.961500] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-28T02:02:50.981843] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-28T02:02:50.945330] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:51.213468] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:51.264749] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-28T02:02:51.291464] [INFO ] [MAIN ] AJG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:51.292943] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AJG took 1.2s. Estimated remaining: 10m 50s. Rate: 212.1 symbols/min [2025-09-28T02:02:51.543206] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-28T02:02:51.684480] [INFO ] [MAIN ] AKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:51.710175] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AKR took 1.1s. Estimated remaining: 10m 54s. Rate: 210.7 symbols/min [2025-09-28T02:02:51.711596] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:51.799775] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-28T02:02:51.900985] [INFO ] [MAIN ] AL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:51.900854] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:02:51.923182] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 1.1s. Estimated remaining: 10m 51s. Rate: 211.4 symbols/min [2025-09-28T02:02:51.935389] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-28T02:02:52.144700] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:52.223046] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:52.244195] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-28T02:02:52.244895] [INFO ] [MAIN ] ALB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:52.245780] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. ALB took 1.0s. Estimated remaining: 10m 52s. Rate: 211.1 symbols/min [2025-09-28T02:02:52.282734] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-28T02:02:52.283173] [INFO ] [MAIN ] ALE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:52.296519] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALE took 0.4s. Estimated remaining: 10m 45s. Rate: 213.3 symbols/min [2025-09-28T02:02:52.300245] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-28T02:02:52.301881] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-28T02:02:52.323344] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-28T02:02:52.323755] [INFO ] [MAIN ] ALC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:52.324200] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALC took 0.6s. Estimated remaining: 10m 37s. Rate: 215.8 symbols/min [2025-09-28T02:02:52.787305] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-28T02:02:52.788853] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-28T02:02:53.081151] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-28T02:02:53.082487] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-28T02:02:53.313508] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-28T02:02:53.315256] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-28T02:02:53.457812] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.14 seconds). [2025-09-28T02:02:53.459475] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-28T02:02:53.837581] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-28T02:02:53.839303] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-28T02:02:54.137562] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-28T02:02:54.138888] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-28T02:02:54.364173] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-28T02:02:54.365268] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-28T02:02:54.595269] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-28T02:02:54.596547] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-28T02:02:54.806711] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-28T02:02:54.807602] [INFO ] [REMOTE ] AKA: Full fetch complete (2428 records). [2025-09-28T02:02:54.807754] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-28T02:02:55.010599] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:02:55.010923] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:02:55.011006] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:02:55.011103] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-28T02:02:55.011208] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-28T02:02:55.011298] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-28T02:02:55.011385] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-28T02:02:55.011485] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. AKA took 4.6s. Estimated remaining: 11m 46s. Rate: 194.7 symbols/min [2025-09-28T02:02:55.761708] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:55.797369] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:55.801392] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:55.835965] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:55.866294] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-28T02:02:55.867041] [INFO ] [MAIN ] ALG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:55.867252] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALG took 0.8s. Estimated remaining: 12m 1s. Rate: 190.5 symbols/min [2025-09-28T02:02:56.137291] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:56.151330] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-28T02:02:56.154052] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-28T02:02:56.154436] [INFO ] [MAIN ] ALEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:56.155077] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 1.1s. Estimated remaining: 12m 0s. Rate: 190.7 symbols/min [2025-09-28T02:02:56.156141] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-28T02:02:56.155248] [INFO ] [MAIN ] ALK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:56.162041] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALK took 1.1s. Estimated remaining: 11m 51s. Rate: 193.0 symbols/min [2025-09-28T02:02:56.200936] [INFO ] [MAIN ] ALIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:56.227367] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALIT took 1.2s. Estimated remaining: 11m 44s. Rate: 194.8 symbols/min [2025-09-28T02:02:56.677675] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:56.701195] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:56.762960] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-28T02:02:56.801719] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:56.802489] [INFO ] [MAIN ] ALL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:56.803718] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALL took 0.9s. Estimated remaining: 11m 51s. Rate: 192.8 symbols/min [2025-09-28T02:02:57.091020] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:57.097115] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-28T02:02:57.113170] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-28T02:02:57.115241] [INFO ] [MAIN ] ALSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:57.116381] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALSN took 0.8s. Estimated remaining: 11m 51s. Rate: 192.8 symbols/min [2025-09-28T02:02:57.115719] [INFO ] [MAIN ] ALLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:57.117312] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-28T02:02:57.123526] [INFO ] [MAIN ] ALLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:57.134992] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLE took 1.0s. Estimated remaining: 11m 43s. Rate: 194.9 symbols/min [2025-09-28T02:02:57.156429] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALLY took 1.0s. Estimated remaining: 11m 35s. Rate: 197.0 symbols/min [2025-09-28T02:02:57.462780] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-28T02:02:57.544380] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:57.568150] [INFO ] [MAIN ] ALTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:57.600099] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 0.8s. Estimated remaining: 11m 39s. Rate: 196.0 symbols/min [2025-09-28T02:02:57.704432] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:57.778144] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:57.790184] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-28T02:02:57.818482] [INFO ] [MAIN ] ALUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:57.852964] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 0.7s. Estimated remaining: 11m 37s. Rate: 196.4 symbols/min [2025-09-28T02:02:57.896153] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-28T02:02:57.977191] [INFO ] [MAIN ] ALX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:57.990532] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:58.004210] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 0.8s. Estimated remaining: 11m 33s. Rate: 197.5 symbols/min [2025-09-28T02:02:58.223394] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-28T02:02:58.267230] [INFO ] [MAIN ] ALV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:58.289094] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:58.289907] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALV took 1.1s. Estimated remaining: 11m 32s. Rate: 197.6 symbols/min [2025-09-28T02:02:58.457351] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:58.578324] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-28T02:02:58.594964] [INFO ] [MAIN ] AM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:58.623889] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AM took 1.0s. Estimated remaining: 11m 32s. Rate: 197.4 symbols/min [2025-09-28T02:02:58.629140] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-28T02:02:58.630249] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:58.663287] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-28T02:02:58.636103] [INFO ] [MAIN ] AMBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:58.675962] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBC took 0.8s. Estimated remaining: 11m 26s. Rate: 199.1 symbols/min [2025-09-28T02:02:58.668786] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-28T02:02:58.734721] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-28T02:02:58.794630] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-28T02:02:58.823012] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-28T02:02:58.823234] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-28T02:02:59.048092] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:59.122861] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-28T02:02:59.184844] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:59.190502] [INFO ] [MAIN ] AMBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:59.222703] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBP took 1.2s. Estimated remaining: 11m 32s. Rate: 197.5 symbols/min [2025-09-28T02:02:59.697967] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:02:59.717331] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-28T02:02:59.716859] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:02:59.720672] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-28T02:02:59.723762] [INFO ] [MAIN ] AMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:59.739951] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMC took 1.1s. Estimated remaining: 11m 36s. Rate: 196.0 symbols/min [2025-09-28T02:02:59.765032] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-28T02:02:59.813102] [INFO ] [MAIN ] AMCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:02:59.844834] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMCR took 1.1s. Estimated remaining: 11m 31s. Rate: 197.4 symbols/min [2025-09-28T02:02:59.896607] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:02:59.928828] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-28T02:02:59.974088] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:03:00.025868] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-09-28T02:03:00.052116] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:00.067947] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:03:00.090413] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-28T02:03:00.101949] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-28T02:03:00.112663] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-28T02:03:00.143970] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-28T02:03:00.173514] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:00.169431] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMBQ took 1.9s. Estimated remaining: 11m 32s. Rate: 197.2 symbols/min [2025-09-28T02:03:00.212942] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-28T02:03:00.252889] [INFO ] [MAIN ] AME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:00.294138] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AME took 1.0s. Estimated remaining: 11m 27s. Rate: 198.4 symbols/min [2025-09-28T02:03:00.310725] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-28T02:03:00.383999] [INFO ] [MAIN ] AMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:00.506752] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMG took 0.8s. Estimated remaining: 11m 25s. Rate: 199.0 symbols/min [2025-09-28T02:03:00.516430] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:00.678428] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:00.769124] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-28T02:03:00.791838] [INFO ] [MAIN ] AMH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:00.814095] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMH took 0.9s. Estimated remaining: 11m 25s. Rate: 199.0 symbols/min [2025-09-28T02:03:00.882293] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:01.007597] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-28T02:03:01.022586] [INFO ] [MAIN ] AMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:01.028798] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMN took 0.8s. Estimated remaining: 11m 22s. Rate: 199.5 symbols/min [2025-09-28T02:03:01.040984] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-28T02:03:01.089509] [INFO ] [MAIN ] AMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:01.133928] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMP took 0.8s. Estimated remaining: 11m 18s. Rate: 200.8 symbols/min [2025-09-28T02:03:01.190104] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:01.462513] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:01.481074] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-28T02:03:01.575441] [INFO ] [MAIN ] AMPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:01.585225] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:01.586148] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 1.1s. Estimated remaining: 11m 21s. Rate: 199.8 symbols/min [2025-09-28T02:03:01.655898] [DEBUG] [LOCAL ] AMPY: Loaded 38164 existing records from primary storage. [2025-09-28T02:03:01.704995] [INFO ] [MAIN ] AMPY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:01.745850] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPY took 0.9s. Estimated remaining: 11m 17s. Rate: 200.7 symbols/min [2025-09-28T02:03:01.774845] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-28T02:03:01.843592] [INFO ] [MAIN ] AMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:01.914575] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:01.913371] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMR took 0.9s. Estimated remaining: 11m 14s. Rate: 201.5 symbols/min [2025-09-28T02:03:01.925254] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-28T02:03:02.054088] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-28T02:03:02.070301] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-28T02:03:02.075687] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-28T02:03:02.081060] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-28T02:03:02.096743] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-28T02:03:02.102980] [INFO ] [MAIN ] AMRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:02.107847] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMRC took 0.9s. Estimated remaining: 11m 12s. Rate: 202.2 symbols/min [2025-09-28T02:03:02.113584] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-28T02:03:02.430325] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:02.472549] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:02.640680] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:02.807165] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-28T02:03:02.790693] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-28T02:03:02.825360] [INFO ] [MAIN ] AMTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:02.826824] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMTD took 0.7s. Estimated remaining: 11m 20s. Rate: 199.6 symbols/min [2025-09-28T02:03:02.825674] [INFO ] [MAIN ] AMTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:02.848960] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTB took 0.9s. Estimated remaining: 11m 14s. Rate: 201.3 symbols/min [2025-09-28T02:03:03.003622] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:03.062732] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-28T02:03:03.107843] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-28T02:03:03.144735] [INFO ] [MAIN ] AMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:03.165978] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMT took 1.4s. Estimated remaining: 11m 14s. Rate: 201.2 symbols/min [2025-09-28T02:03:03.301591] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:03.356371] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:03:03.418839] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-28T02:03:03.441684] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:03.441977] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:03:03.442900] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-09-28T02:03:03.443034] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:03:03.451688] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-28T02:03:03.490807] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-28T02:03:03.506235] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-28T02:03:03.533971] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-28T02:03:03.528502] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:03.534495] [INFO ] [MAIN ] AMWL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:03.534711] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMWL took 0.6s. Estimated remaining: 11m 16s. Rate: 200.7 symbols/min [2025-09-28T02:03:03.529789] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-28T02:03:03.535322] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMRZ took 1.9s. Estimated remaining: 11m 9s. Rate: 202.5 symbols/min [2025-09-28T02:03:03.875395] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-28T02:03:03.913350] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:03.925803] [INFO ] [MAIN ] AMTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:03.964881] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMTM took 1.1s. Estimated remaining: 11m 12s. Rate: 201.7 symbols/min [2025-09-28T02:03:04.007698] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-28T02:03:04.035480] [INFO ] [MAIN ] AMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:04.020250] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:04.058531] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMX took 0.9s. Estimated remaining: 11m 7s. Rate: 202.9 symbols/min [2025-09-28T02:03:04.323401] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:04.342448] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-28T02:03:04.374953] [INFO ] [MAIN ] AN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:04.419615] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:04.420276] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AN took 0.9s. Estimated remaining: 11m 8s. Rate: 202.6 symbols/min [2025-09-28T02:03:04.420608] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-28T02:03:04.432801] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-28T02:03:04.433092] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-28T02:03:04.454475] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-28T02:03:04.466076] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-28T02:03:04.502715] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-28T02:03:04.552890] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-28T02:03:04.611749] [INFO ] [MAIN ] ANET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:04.668721] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANET took 1.1s. Estimated remaining: 11m 7s. Rate: 202.8 symbols/min [2025-09-28T02:03:04.920727] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-28T02:03:04.874395] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:04.958155] [INFO ] [MAIN ] ANF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:04.981746] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANF took 1.0s. Estimated remaining: 11m 7s. Rate: 202.7 symbols/min [2025-09-28T02:03:05.154199] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:05.165093] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-28T02:03:05.208366] [INFO ] [MAIN ] ANRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:05.225007] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 0.8s. Estimated remaining: 11m 6s. Rate: 203.0 symbols/min [2025-09-28T02:03:05.297395] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:05.303958] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-28T02:03:05.316448] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-28T02:03:05.316870] [INFO ] [MAIN ] ANVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:05.316980] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANVS took 0.6s. Estimated remaining: 11m 2s. Rate: 204.2 symbols/min [2025-09-28T02:03:05.616603] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:03:05.617015] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-28T02:03:05.617110] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:03:05.617189] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-09-28T02:03:05.617267] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:03:05.617347] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-28T02:03:05.617443] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-28T02:03:05.617521] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-28T02:03:05.617622] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-28T02:03:05.617745] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANGX took 1.5s. Estimated remaining: 11m 1s. Rate: 204.2 symbols/min [2025-09-28T02:03:06.200460] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:06.257128] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:06.250948] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-28T02:03:06.331299] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-28T02:03:06.331195] [DEBUG] [LOCAL ] AOMR: No existing data file found in primary storage. [2025-09-28T02:03:06.362504] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:06.381170] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:06.362876] [WARN ] [MAIN ] AOMR: No existing data found, performing full refresh instead. [2025-09-28T02:03:06.363015] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-28T02:03:06.382060] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-28T02:03:06.383733] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-28T02:03:06.385526] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-09-28T02:03:06.385928] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-28T02:03:06.383823] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-28T02:03:06.415982] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-28T02:03:06.422417] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-28T02:03:06.741279] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-28T02:03:06.803748] [INFO ] [MAIN ] AOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:06.868112] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOD took 1.2s. Estimated remaining: 11m 19s. Rate: 198.8 symbols/min [2025-09-28T02:03:06.951473] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-28T02:03:07.105318] [INFO ] [MAIN ] AON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:07.215832] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AON took 1.6s. Estimated remaining: 11m 20s. Rate: 198.6 symbols/min [2025-09-28T02:03:07.393338] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:07.464125] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-28T02:03:07.554567] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:07.587006] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-28T02:03:07.581825] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:07.670393] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:07.699687] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-28T02:03:07.700154] [INFO ] [MAIN ] AORT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:07.700268] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AORT took 0.7s. Estimated remaining: 11m 23s. Rate: 197.6 symbols/min [2025-09-28T02:03:07.774394] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:03:07.808054] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-28T02:03:07.812446] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:03:07.834994] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-09-28T02:03:07.867825] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:03:07.917665] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:07.919557] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-28T02:03:07.920184] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-28T02:03:07.920269] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-28T02:03:07.920376] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-28T02:03:07.920462] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOMD took 2.3s. Estimated remaining: 11m 21s. Rate: 198.1 symbols/min [2025-09-28T02:03:07.927444] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-28T02:03:07.960546] [INFO ] [MAIN ] AOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:07.996270] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AOS took 0.8s. Estimated remaining: 11m 16s. Rate: 199.3 symbols/min [2025-09-28T02:03:08.053436] [DEBUG] [LOCAL ] AP: Loaded 7236 existing records from primary storage. [2025-09-28T02:03:08.111129] [INFO ] [MAIN ] AP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:08.163512] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 0.5s. Estimated remaining: 11m 14s. Rate: 200.0 symbols/min [2025-09-28T02:03:08.253597] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:08.254561] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-28T02:03:08.365790] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-28T02:03:08.418701] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:08.555342] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:08.593261] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-28T02:03:08.593745] [INFO ] [MAIN ] APAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:08.594104] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. APAM took 0.7s. Estimated remaining: 11m 16s. Rate: 199.3 symbols/min [2025-09-28T02:03:08.695755] [DEBUG] [LOCAL ] APD: Loaded 46087 existing records from primary storage. [2025-09-28T02:03:08.707087] [INFO ] [MAIN ] APD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:08.724291] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APD took 0.7s. Estimated remaining: 11m 12s. Rate: 200.2 symbols/min [2025-09-28T02:03:08.983017] [DEBUG] [LOCAL ] APG: Loaded 50931 existing records from primary storage. [2025-09-28T02:03:08.983776] [INFO ] [MAIN ] APG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:08.984163] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APG took 0.7s. Estimated remaining: 11m 11s. Rate: 200.4 symbols/min [2025-09-28T02:03:08.976130] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:09.077326] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-28T02:03:09.168819] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-28T02:03:09.165890] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:09.284183] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:09.340318] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-28T02:03:09.340946] [INFO ] [MAIN ] APH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:09.341481] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APH took 0.7s. Estimated remaining: 11m 12s. Rate: 200.1 symbols/min [2025-09-28T02:03:09.507965] [DEBUG] [LOCAL ] APLE: Loaded 52769 existing records from primary storage. [2025-09-28T02:03:09.513140] [INFO ] [MAIN ] APLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:09.519954] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APLE took 0.8s. Estimated remaining: 11m 10s. Rate: 200.7 symbols/min [2025-09-28T02:03:09.628850] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:09.713459] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-28T02:03:09.741863] [INFO ] [MAIN ] APO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:09.746837] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APO took 0.8s. Estimated remaining: 11m 8s. Rate: 201.1 symbols/min [2025-09-28T02:03:09.880012] [DEBUG] [LOCAL ] APOS: Loaded 7568 existing records from primary storage. [2025-09-28T02:03:09.972771] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:09.979572] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-28T02:03:09.971063] [INFO ] [MAIN ] APOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:10.034727] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APOS took 0.7s. Estimated remaining: 11m 8s. Rate: 201.1 symbols/min [2025-09-28T02:03:10.099865] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:10.063183] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-28T02:03:10.317837] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:10.326284] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-28T02:03:10.341257] [INFO ] [MAIN ] AQNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:10.341465] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. AQNB took 0.3s. Estimated remaining: 11m 8s. Rate: 201.1 symbols/min [2025-09-28T02:03:10.431302] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-28T02:03:10.457589] [INFO ] [MAIN ] APTV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:10.494300] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. APTV took 1.0s. Estimated remaining: 11m 5s. Rate: 201.8 symbols/min [2025-09-28T02:03:10.495430] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-28T02:03:10.512121] [INFO ] [MAIN ] AQN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:10.512405] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. AQN took 0.8s. Estimated remaining: 10m 60s. Rate: 203.2 symbols/min [2025-09-28T02:03:10.740080] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:10.974351] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:11.006212] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:11.007377] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-28T02:03:11.016629] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-28T02:03:11.035266] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-28T02:03:11.035621] [INFO ] [MAIN ] ARDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:11.035746] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. ARDC took 0.5s. Estimated remaining: 11m 3s. Rate: 202.1 symbols/min [2025-09-28T02:03:11.269114] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-28T02:03:11.292291] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:11.293480] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-28T02:03:11.293832] [INFO ] [MAIN ] AR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:11.295691] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 1.0s. Estimated remaining: 11m 2s. Rate: 202.2 symbols/min [2025-09-28T02:03:11.295985] [INFO ] [MAIN ] ARCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:11.297488] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARCO took 0.8s. Estimated remaining: 10m 57s. Rate: 203.7 symbols/min [2025-09-28T02:03:11.645732] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-28T02:03:11.722117] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:11.728562] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-28T02:03:11.730194] [DEBUG] [LOCAL ] ARDT: Loaded 28513 existing records from primary storage. [2025-09-28T02:03:11.734125] [INFO ] [MAIN ] ARDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:11.734394] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARDT took 0.7s. Estimated remaining: 10m 59s. Rate: 203.0 symbols/min [2025-09-28T02:03:11.731720] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:11.963905] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:11.993256] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-28T02:03:11.994082] [INFO ] [MAIN ] ARE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:11.994717] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARE took 0.7s. Estimated remaining: 10m 59s. Rate: 203.2 symbols/min [2025-09-28T02:03:12.107639] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-28T02:03:12.139603] [INFO ] [MAIN ] ARES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:12.140287] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARES took 0.8s. Estimated remaining: 10m 56s. Rate: 203.9 symbols/min [2025-09-28T02:03:12.306390] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-28T02:03:12.339332] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:12.360633] [INFO ] [MAIN ] ARI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:12.361030] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARI took 0.6s. Estimated remaining: 10m 54s. Rate: 204.3 symbols/min [2025-09-28T02:03:12.547462] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:12.628710] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-28T02:03:12.674982] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:12.675997] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-28T02:03:12.694879] [DEBUG] [LOCAL ] ARIS: Loaded 42624 existing records from primary storage. [2025-09-28T02:03:12.695305] [INFO ] [MAIN ] ARIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:12.695737] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARIS took 0.7s. Estimated remaining: 10m 55s. Rate: 204.1 symbols/min [2025-09-28T02:03:12.862861] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-28T02:03:12.913263] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:12.927584] [INFO ] [MAIN ] ARLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:12.928488] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARLO took 0.8s. Estimated remaining: 10m 54s. Rate: 204.4 symbols/min [2025-09-28T02:03:13.057042] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-28T02:03:13.080104] [INFO ] [MAIN ] ARMK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:13.134626] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:13.134890] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARMK took 0.8s. Estimated remaining: 10m 52s. Rate: 204.8 symbols/min [2025-09-28T02:03:13.295447] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-28T02:03:13.335223] [INFO ] [MAIN ] AROC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:13.339522] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. AROC took 0.6s. Estimated remaining: 10m 50s. Rate: 205.2 symbols/min [2025-09-28T02:03:13.361591] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:13.580100] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:13.604187] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-28T02:03:13.604631] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-28T02:03:13.612576] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-28T02:03:13.614500] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-28T02:03:13.617072] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-28T02:03:13.616865] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-28T02:03:13.631140] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-28T02:03:13.629800] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-28T02:03:13.632593] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-28T02:03:13.633315] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-28T02:03:13.631404] [INFO ] [MAIN ] ARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:13.638796] [INFO ] [MAIN ] ARW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:13.638949] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARW took 0.5s. Estimated remaining: 10m 50s. Rate: 205.2 symbols/min [2025-09-28T02:03:13.662321] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARR took 0.7s. Estimated remaining: 10m 46s. Rate: 206.4 symbols/min [2025-09-28T02:03:14.230113] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:14.402063] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:14.551215] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-28T02:03:14.585718] [INFO ] [MAIN ] ASA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:14.586170] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ASA took 0.9s. Estimated remaining: 10m 55s. Rate: 203.5 symbols/min [2025-09-28T02:03:14.614098] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-28T02:03:14.647535] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:14.663735] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-28T02:03:14.669778] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-28T02:03:14.789628] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-28T02:03:14.790394] [INFO ] [MAIN ] AS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:14.804917] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. AS took 1.1s. Estimated remaining: 10m 53s. Rate: 203.8 symbols/min [2025-09-28T02:03:15.090029] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:15.090732] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:03:15.130582] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-28T02:03:15.163699] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:03:15.163273] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:15.163829] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-09-28T02:03:15.164296] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:03:15.164394] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-28T02:03:15.164548] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-28T02:03:15.164800] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-28T02:03:15.165038] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-28T02:03:15.165184] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ARX took 1.8s. Estimated remaining: 10m 54s. Rate: 203.5 symbols/min [2025-09-28T02:03:15.420002] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:15.429375] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-28T02:03:15.447834] [INFO ] [MAIN ] ASBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:15.463498] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ASBA took 0.3s. Estimated remaining: 10m 54s. Rate: 203.5 symbols/min [2025-09-28T02:03:15.500133] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-28T02:03:15.501108] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-28T02:03:15.520214] [INFO ] [MAIN ] ASAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:15.540324] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASAN took 1.0s. Estimated remaining: 10m 50s. Rate: 204.5 symbols/min [2025-09-28T02:03:15.539595] [INFO ] [MAIN ] ASB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:15.556280] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASB took 0.7s. Estimated remaining: 10m 46s. Rate: 205.7 symbols/min [2025-09-28T02:03:15.908469] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:16.051013] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:16.055621] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:16.076165] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-28T02:03:16.084738] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-28T02:03:16.126281] [DEBUG] [LOCAL ] ASG: Loaded 20695 existing records from primary storage. [2025-09-28T02:03:16.127363] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-28T02:03:16.127963] [INFO ] [MAIN ] ASG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:16.128547] [INFO ] [MAIN ] ASGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:16.128211] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASG took 0.6s. Estimated remaining: 10m 50s. Rate: 204.5 symbols/min [2025-09-28T02:03:16.134362] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASGI took 0.5s. Estimated remaining: 10m 46s. Rate: 205.8 symbols/min [2025-09-28T02:03:16.259874] [DEBUG] [LOCAL ] ASC: Loaded 38153 existing records from primary storage. [2025-09-28T02:03:16.270947] [INFO ] [MAIN ] ASC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:16.276211] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASC took 0.8s. Estimated remaining: 10m 43s. Rate: 206.4 symbols/min [2025-09-28T02:03:16.333839] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:16.371634] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-28T02:03:16.372023] [INFO ] [MAIN ] ASGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:16.372126] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGN took 0.2s. Estimated remaining: 10m 40s. Rate: 207.3 symbols/min [2025-09-28T02:03:16.791280] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-28T02:03:16.795101] [INFO ] [REMOTE ] AOMR: Full fetch complete (23082 records). [2025-09-28T02:03:16.795252] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-28T02:03:17.186495] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-28T02:03:17.186619] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-28T02:03:17.187096] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-28T02:03:17.187184] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-28T02:03:17.188164] [DEBUG] [LOCAL ] AOMR: Trimmed 23082 records to 16852 (keeping 200 days of data) [2025-09-28T02:03:17.290477] [DEBUG] [LOCAL ] AOMR: Primary data saved (16852 records). [2025-09-28T02:03:17.290719] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-28T02:03:17.290873] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. AOMR took 11.7s. Estimated remaining: 10m 49s. Rate: 204.5 symbols/min [2025-09-28T02:03:18.033228] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:18.028944] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:18.049013] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:18.069811] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:18.086980] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-28T02:03:18.087597] [INFO ] [MAIN ] ASR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:18.087727] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 0.8s. Estimated remaining: 10m 55s. Rate: 202.4 symbols/min [2025-09-28T02:03:18.239631] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-28T02:03:18.245331] [INFO ] [MAIN ] ASIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:18.271447] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 1.0s. Estimated remaining: 10m 53s. Rate: 202.9 symbols/min [2025-09-28T02:03:18.305859] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-28T02:03:18.362470] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:18.378932] [INFO ] [MAIN ] ASH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:18.397973] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASH took 1.1s. Estimated remaining: 10m 51s. Rate: 203.6 symbols/min [2025-09-28T02:03:18.452254] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-28T02:03:18.512131] [INFO ] [MAIN ] ASPN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:18.556685] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 1.3s. Estimated remaining: 10m 49s. Rate: 204.1 symbols/min [2025-09-28T02:03:18.886750] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:18.919837] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:18.997118] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-28T02:03:19.020589] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:19.021494] [INFO ] [MAIN ] ASX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:19.024303] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASX took 0.9s. Estimated remaining: 10m 51s. Rate: 203.4 symbols/min [2025-09-28T02:03:19.259105] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:19.260206] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-28T02:03:19.272990] [INFO ] [MAIN ] ATGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:19.284251] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATGE took 0.9s. Estimated remaining: 10m 50s. Rate: 203.6 symbols/min [2025-09-28T02:03:19.285004] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-28T02:03:19.290714] [INFO ] [MAIN ] ATEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:19.303898] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATEN took 1.0s. Estimated remaining: 10m 46s. Rate: 204.7 symbols/min [2025-09-28T02:03:19.306492] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-28T02:03:19.348918] [INFO ] [MAIN ] ATHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:19.419713] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHM took 0.8s. Estimated remaining: 10m 43s. Rate: 205.4 symbols/min [2025-09-28T02:03:19.501537] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-28T02:03:19.521236] [INFO ] [MAIN ] ATHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:19.544308] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 0.5s. Estimated remaining: 10m 41s. Rate: 206.1 symbols/min [2025-09-28T02:03:19.773401] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:19.879838] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:20.080665] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:20.104322] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:20.146289] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-28T02:03:20.147819] [INFO ] [MAIN ] ATKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:20.148046] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATKR took 0.8s. Estimated remaining: 10m 45s. Rate: 204.8 symbols/min [2025-09-28T02:03:20.317398] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-28T02:03:20.329014] [INFO ] [MAIN ] ATI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:20.390076] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATI took 1.1s. Estimated remaining: 10m 44s. Rate: 205.1 symbols/min [2025-09-28T02:03:20.426603] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:20.427975] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-28T02:03:20.428588] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-28T02:03:20.485969] [INFO ] [MAIN ] ATO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:20.481298] [INFO ] [MAIN ] ATMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:20.498715] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATO took 0.9s. Estimated remaining: 10m 41s. Rate: 205.8 symbols/min [2025-09-28T02:03:20.529128] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATMU took 1.0s. Estimated remaining: 10m 37s. Rate: 206.9 symbols/min [2025-09-28T02:03:20.873084] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:20.917480] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-28T02:03:20.931304] [INFO ] [MAIN ] ATR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:20.988432] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:20.997850] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATR took 0.8s. Estimated remaining: 10m 39s. Rate: 206.2 symbols/min [2025-09-28T02:03:21.024051] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:21.143341] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-28T02:03:21.172559] [INFO ] [MAIN ] ATS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:21.188569] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 0.8s. Estimated remaining: 10m 38s. Rate: 206.6 symbols/min [2025-09-28T02:03:21.248556] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:21.409389] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-28T02:03:21.416561] [INFO ] [MAIN ] ATUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:21.445780] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 0.9s. Estimated remaining: 10m 37s. Rate: 206.7 symbols/min [2025-09-28T02:03:21.486747] [DEBUG] [LOCAL ] AU: Loaded 53715 existing records from primary storage. [2025-09-28T02:03:21.507859] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:21.508103] [INFO ] [MAIN ] AU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:21.514131] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AU took 0.9s. Estimated remaining: 10m 34s. Rate: 207.6 symbols/min [2025-09-28T02:03:21.652079] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-28T02:03:21.708132] [INFO ] [MAIN ] AUNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:21.713592] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AUNA took 0.5s. Estimated remaining: 10m 33s. Rate: 208.0 symbols/min [2025-09-28T02:03:21.883369] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-28T02:03:21.940630] [INFO ] [MAIN ] AUB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:22.005472] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AUB took 1.0s. Estimated remaining: 10m 32s. Rate: 207.9 symbols/min [2025-09-28T02:03:22.006737] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:22.019822] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:22.282293] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:22.311566] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-28T02:03:22.345260] [INFO ] [MAIN ] AVAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:22.355520] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVAL took 0.8s. Estimated remaining: 10m 33s. Rate: 207.7 symbols/min [2025-09-28T02:03:22.344482] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:22.388110] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-28T02:03:22.393581] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-28T02:03:22.450399] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-28T02:03:22.461959] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-28T02:03:22.502043] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-28T02:03:22.530967] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-28T02:03:22.520413] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-28T02:03:22.565069] [INFO ] [MAIN ] AVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:22.589517] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 1.1s. Estimated remaining: 10m 32s. Rate: 207.9 symbols/min [2025-09-28T02:03:22.719968] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:22.775589] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-28T02:03:22.820974] [INFO ] [MAIN ] AVB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:22.884305] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVB took 1.1s. Estimated remaining: 10m 32s. Rate: 207.9 symbols/min [2025-09-28T02:03:23.077885] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-28T02:03:23.163486] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:23.156745] [INFO ] [MAIN ] AVD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:23.197120] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVD took 0.8s. Estimated remaining: 10m 32s. Rate: 207.8 symbols/min [2025-09-28T02:03:23.508318] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-28T02:03:23.517992] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:23.564129] [INFO ] [MAIN ] AVK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:23.618810] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:23.628704] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVK took 1.0s. Estimated remaining: 10m 33s. Rate: 207.2 symbols/min [2025-09-28T02:03:23.629239] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-28T02:03:23.656283] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:23.862205] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:23.874689] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:03:23.875580] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-28T02:03:23.875896] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:03:23.876695] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-28T02:03:23.877119] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-09-28T02:03:23.877711] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:03:23.878033] [INFO ] [MAIN ] AVNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:23.887492] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVNS took 1.0s. Estimated remaining: 10m 33s. Rate: 207.4 symbols/min [2025-09-28T02:03:23.887277] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-28T02:03:23.904951] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-28T02:03:23.945001] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-28T02:03:24.016420] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-28T02:03:24.008735] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-28T02:03:24.026881] [INFO ] [MAIN ] AVNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:24.027203] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNT took 0.8s. Estimated remaining: 10m 31s. Rate: 207.9 symbols/min [2025-09-28T02:03:24.048689] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVBC took 2.0s. Estimated remaining: 10m 27s. Rate: 209.0 symbols/min [2025-09-28T02:03:24.221163] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:24.479902] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-28T02:03:24.500052] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:24.528252] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:24.528391] [INFO ] [MAIN ] AVTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:24.529134] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVTR took 0.9s. Estimated remaining: 10m 29s. Rate: 208.2 symbols/min [2025-09-28T02:03:24.754947] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:24.764215] [DEBUG] [LOCAL ] AVY: Loaded 38102 existing records from primary storage. [2025-09-28T02:03:24.764776] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-28T02:03:24.773384] [INFO ] [MAIN ] AVY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:24.773711] [INFO ] [MAIN ] AWF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:24.773801] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVY took 0.9s. Estimated remaining: 10m 28s. Rate: 208.4 symbols/min [2025-09-28T02:03:24.774392] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-28T02:03:24.787110] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 0.7s. Estimated remaining: 10m 25s. Rate: 209.4 symbols/min [2025-09-28T02:03:24.787398] [INFO ] [MAIN ] AWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:24.809205] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 0.7s. Estimated remaining: 10m 22s. Rate: 210.5 symbols/min [2025-09-28T02:03:25.238234] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:25.289731] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:25.398799] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-28T02:03:25.396731] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:25.399571] [INFO ] [MAIN ] AWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:25.400210] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWK took 0.9s. Estimated remaining: 10m 25s. Rate: 209.3 symbols/min [2025-09-28T02:03:25.506103] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-28T02:03:25.535763] [DEBUG] [LOCAL ] AWR: Loaded 22993 existing records from primary storage. [2025-09-28T02:03:25.541164] [INFO ] [MAIN ] AWP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:25.554491] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWP took 0.8s. Estimated remaining: 10m 23s. Rate: 209.8 symbols/min [2025-09-28T02:03:25.565502] [INFO ] [MAIN ] AWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:25.614144] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWR took 0.8s. Estimated remaining: 10m 20s. Rate: 210.6 symbols/min [2025-09-28T02:03:25.675490] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:25.781788] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-28T02:03:25.850333] [INFO ] [MAIN ] AX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:25.918732] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 1.1s. Estimated remaining: 10m 20s. Rate: 210.6 symbols/min [2025-09-28T02:03:25.987234] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:26.266260] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:26.284528] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-28T02:03:26.348467] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:26.317929] [INFO ] [MAIN ] AXL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:26.350788] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 1.0s. Estimated remaining: 10m 21s. Rate: 210.0 symbols/min [2025-09-28T02:03:26.359273] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-28T02:03:26.391559] [INFO ] [MAIN ] AXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:26.421946] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 0.7s. Estimated remaining: 10m 19s. Rate: 210.8 symbols/min [2025-09-28T02:03:26.595110] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:26.597039] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-28T02:03:26.597782] [INFO ] [MAIN ] AXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:26.597888] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 1.0s. Estimated remaining: 10m 17s. Rate: 211.2 symbols/min [2025-09-28T02:03:26.616453] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-28T02:03:26.616928] [INFO ] [MAIN ] AXS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:26.617095] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXS took 0.6s. Estimated remaining: 10m 14s. Rate: 212.2 symbols/min [2025-09-28T02:03:26.674402] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-28T02:03:26.674825] [INFO ] [MAIN ] AXTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:26.675462] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 0.3s. Estimated remaining: 10m 11s. Rate: 213.1 symbols/min [2025-09-28T02:03:27.302754] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:27.374668] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:27.378297] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:27.400155] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-28T02:03:27.430000] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-28T02:03:27.455085] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-28T02:03:27.454796] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:27.455582] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-28T02:03:27.455920] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-28T02:03:27.455986] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-28T02:03:27.600336] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-28T02:03:27.627877] [DEBUG] [LOCAL ] AYI: Loaded 25446 existing records from primary storage. [2025-09-28T02:03:27.649311] [INFO ] [MAIN ] AYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:27.649452] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. AYI took 1.0s. Estimated remaining: 10m 19s. Rate: 210.5 symbols/min [2025-09-28T02:03:27.616747] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-28T02:03:27.655013] [INFO ] [MAIN ] AZO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:27.686787] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZO took 1.0s. Estimated remaining: 10m 16s. Rate: 211.4 symbols/min [2025-09-28T02:03:27.637445] [INFO ] [MAIN ] AZZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:27.801758] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AZZ took 1.0s. Estimated remaining: 10m 14s. Rate: 212.0 symbols/min [2025-09-28T02:03:28.223910] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:28.433782] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:28.448389] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-28T02:03:28.418044] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:28.471410] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:28.599484] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-28T02:03:28.600745] [INFO ] [MAIN ] BA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:28.614477] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. BA took 1.0s. Estimated remaining: 10m 19s. Rate: 210.1 symbols/min [2025-09-28T02:03:28.622552] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-28T02:03:28.670154] [INFO ] [MAIN ] BABA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:28.715140] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BABA took 0.9s. Estimated remaining: 10m 17s. Rate: 210.8 symbols/min [2025-09-28T02:03:28.743160] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-28T02:03:28.810756] [INFO ] [MAIN ] BAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:28.874482] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BAC took 1.1s. Estimated remaining: 10m 15s. Rate: 211.2 symbols/min [2025-09-28T02:03:28.910662] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:29.145036] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:29.226212] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:29.248202] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-28T02:03:29.257130] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-28T02:03:29.303666] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-28T02:03:29.313303] [INFO ] [MAIN ] BAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:29.313572] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAH took 0.7s. Estimated remaining: 10m 16s. Rate: 210.7 symbols/min [2025-09-28T02:03:29.460541] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-28T02:03:29.497326] [INFO ] [MAIN ] BAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:29.545538] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-28T02:03:29.537860] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAK took 0.8s. Estimated remaining: 10m 15s. Rate: 210.9 symbols/min [2025-09-28T02:03:29.564025] [INFO ] [MAIN ] BALL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:29.574314] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:29.591184] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-28T02:03:29.574499] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BALL took 0.6s. Estimated remaining: 10m 13s. Rate: 211.8 symbols/min [2025-09-28T02:03:29.607497] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-28T02:03:29.701224] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-28T02:03:29.735938] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-28T02:03:29.775553] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-28T02:03:29.801491] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-28T02:03:29.942332] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:30.101972] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:30.148005] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-28T02:03:30.255579] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-28T02:03:30.421225] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-28T02:03:30.458752] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:03:30.497008] [INFO ] [MAIN ] BAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:30.497151] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-28T02:03:30.535900] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BAM took 1.0s. Estimated remaining: 10m 19s. Rate: 209.4 symbols/min [2025-09-28T02:03:30.536868] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-28T02:03:30.535721] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:30.554156] [INFO ] [MAIN ] BANC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:30.536951] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:03:30.553969] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-28T02:03:30.580903] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-09-28T02:03:30.581613] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BANC took 1.0s. Estimated remaining: 10m 17s. Rate: 210.2 symbols/min [2025-09-28T02:03:30.581894] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:03:30.618908] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-28T02:03:30.773938] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-28T02:03:30.881635] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:30.850704] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-28T02:03:30.938348] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-28T02:03:30.938227] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:30.939449] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. B took 4.2s. Estimated remaining: 10m 17s. Rate: 210.0 symbols/min [2025-09-28T02:03:31.167264] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-28T02:03:31.165735] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:31.168241] [INFO ] [MAIN ] BAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:31.168407] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BAP took 0.6s. Estimated remaining: 10m 16s. Rate: 210.2 symbols/min [2025-09-28T02:03:31.270737] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-28T02:03:31.289366] [INFO ] [MAIN ] BARK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:31.296228] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BARK took 0.7s. Estimated remaining: 10m 14s. Rate: 210.7 symbols/min [2025-09-28T02:03:31.343935] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-28T02:03:31.412541] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-28T02:03:31.569100] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:31.576108] [DEBUG] [LOCAL ] BB: No existing data file found in primary storage. [2025-09-28T02:03:31.582132] [WARN ] [MAIN ] BB: No existing data found, performing full refresh instead. [2025-09-28T02:03:31.598440] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-28T02:03:31.622719] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-28T02:03:31.660304] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:31.660728] [DEBUG] [LOCAL ] BB: No primary data file found to delete. [2025-09-28T02:03:31.661107] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-28T02:03:31.720808] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-28T02:03:31.762559] [INFO ] [MAIN ] BAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:31.788875] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BAX took 0.8s. Estimated remaining: 10m 16s. Rate: 210.0 symbols/min [2025-09-28T02:03:32.241405] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:32.308139] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-28T02:03:32.350420] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:32.351412] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-28T02:03:32.351535] [INFO ] [MAIN ] BBAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:32.353409] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BBAI took 1.1s. Estimated remaining: 10m 19s. Rate: 209.0 symbols/min [2025-09-28T02:03:32.459283] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-28T02:03:32.506637] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-28T02:03:32.598418] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-28T02:03:32.603359] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:32.603931] [INFO ] [MAIN ] BBAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:32.604737] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BBAR took 0.8s. Estimated remaining: 10m 18s. Rate: 209.2 symbols/min [2025-09-28T02:03:32.794608] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:32.849095] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-28T02:03:32.862746] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-28T02:03:32.882049] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-28T02:03:32.891883] [INFO ] [MAIN ] BBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:32.892000] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBD took 0.5s. Estimated remaining: 10m 18s. Rate: 209.2 symbols/min [2025-09-28T02:03:33.025541] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-28T02:03:33.026725] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-28T02:03:33.027391] [INFO ] [MAIN ] BBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:33.035142] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBDC took 0.4s. Estimated remaining: 10m 16s. Rate: 209.6 symbols/min [2025-09-28T02:03:33.040838] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-28T02:03:33.190389] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:33.293836] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-28T02:03:33.310685] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:33.311247] [INFO ] [MAIN ] BBDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:33.311381] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBDO took 0.4s. Estimated remaining: 10m 16s. Rate: 209.7 symbols/min [2025-09-28T02:03:33.311060] [DEBUG] [LOCAL ] BBN: No existing data file found in primary storage. [2025-09-28T02:03:33.357003] [WARN ] [MAIN ] BBN: No existing data found, performing full refresh instead. [2025-09-28T02:03:33.385787] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-28T02:03:33.410912] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-28T02:03:33.422856] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-09-28T02:03:33.423252] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-28T02:03:33.584535] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:33.605876] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-28T02:03:33.616549] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-28T02:03:33.689196] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-28T02:03:33.716923] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-28T02:03:33.747877] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-28T02:03:33.749038] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-28T02:03:33.754944] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-28T02:03:33.761321] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-28T02:03:34.127317] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:34.200803] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-28T02:03:34.246246] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-28T02:03:34.271828] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-28T02:03:34.367071] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:34.368735] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-28T02:03:34.413495] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-28T02:03:34.415867] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-28T02:03:34.505871] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:03:34.506221] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-28T02:03:34.506311] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:03:34.506421] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-09-28T02:03:34.506496] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:03:34.506597] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-28T02:03:34.506792] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-28T02:03:34.506871] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-28T02:03:34.506995] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-28T02:03:34.507085] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBT took 1.2s. Estimated remaining: 10m 24s. Rate: 206.7 symbols/min [2025-09-28T02:03:34.692162] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:34.692745] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-09-28T02:03:34.692860] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-09-28T02:03:34.693000] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-28T02:03:34.693080] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-28T02:03:34.693166] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-09-28T02:03:34.693240] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-28T02:03:35.104276] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-28T02:03:35.137963] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-28T02:03:35.129951] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:35.137013] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-28T02:03:35.139546] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-28T02:03:35.145151] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-28T02:03:35.177298] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-28T02:03:35.189309] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-28T02:03:35.622898] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-28T02:03:35.627761] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-28T02:03:35.704062] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-28T02:03:35.709453] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-28T02:03:35.727292] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-28T02:03:35.729167] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-28T02:03:35.901523] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.19 seconds). [2025-09-28T02:03:35.906137] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-28T02:03:36.036019] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-28T02:03:36.048555] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-28T02:03:36.067733] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-28T02:03:36.073171] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-28T02:03:36.081926] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-09-28T02:03:36.085167] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-28T02:03:36.103522] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-28T02:03:36.105409] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-28T02:03:36.350026] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-28T02:03:36.351694] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-28T02:03:36.641582] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-28T02:03:36.645973] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-28T02:03:36.653418] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-28T02:03:36.657501] [INFO ] [REMOTE ] BALY: Full fetch complete (17169 records). [2025-09-28T02:03:36.657697] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-28T02:03:36.770067] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-28T02:03:36.791963] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-28T02:03:36.883693] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:03:36.884062] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:03:36.884140] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:03:36.884218] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-28T02:03:36.884316] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-28T02:03:36.884391] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-28T02:03:36.884494] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-28T02:03:36.884600] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BALY took 7.6s. Estimated remaining: 10m 44s. Rate: 200.2 symbols/min [2025-09-28T02:03:37.077139] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-28T02:03:37.076885] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:37.079357] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-28T02:03:37.079491] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-09-28T02:03:37.080923] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-09-28T02:03:37.081215] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-28T02:03:37.081319] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-28T02:03:37.081613] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-09-28T02:03:37.081888] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-28T02:03:37.171101] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-28T02:03:37.211595] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-28T02:03:37.491790] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:37.495207] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-28T02:03:37.495474] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-28T02:03:37.497222] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-28T02:03:37.596735] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-28T02:03:37.601628] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-28T02:03:37.718703] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-28T02:03:37.730589] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-28T02:03:37.745750] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-28T02:03:37.749171] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-28T02:03:37.806439] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-28T02:03:37.807940] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-28T02:03:37.884425] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-28T02:03:37.889101] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-28T02:03:37.940833] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.19 seconds). [2025-09-28T02:03:37.943572] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-28T02:03:38.436072] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-28T02:03:38.438882] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-28T02:03:38.494389] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-28T02:03:38.499770] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-28T02:03:38.562283] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-28T02:03:38.565589] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-28T02:03:38.795223] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-28T02:03:38.800816] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-28T02:03:38.947697] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-28T02:03:38.949665] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-28T02:03:39.108984] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-28T02:03:39.113128] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-28T02:03:39.325096] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-28T02:03:39.330078] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-28T02:03:39.400048] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-28T02:03:39.404341] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-28T02:03:39.734868] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-28T02:03:39.746337] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-28T02:03:39.749059] [INFO ] [REMOTE ] BBU: Full fetch complete (6398 records). [2025-09-28T02:03:39.749426] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-28T02:03:39.749569] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-28T02:03:40.047219] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-28T02:03:40.097127] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-28T02:03:40.184354] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-28T02:03:40.184513] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-28T02:03:40.185098] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-28T02:03:40.185212] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-28T02:03:40.186054] [DEBUG] [LOCAL ] BBU: Trimmed 6398 records to 4478 (keeping 200 days of data) [2025-09-28T02:03:40.213873] [DEBUG] [LOCAL ] BBU: Primary data saved (4478 records). [2025-09-28T02:03:40.214029] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-28T02:03:40.214149] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBU took 5.7s. Estimated remaining: 11m 13s. Rate: 191.5 symbols/min [2025-09-28T02:03:40.406043] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:40.406250] [DEBUG] [LOCAL ] BBVA: No existing data file found in primary storage. [2025-09-28T02:03:40.406327] [WARN ] [MAIN ] BBVA: No existing data found, performing full refresh instead. [2025-09-28T02:03:40.406476] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-28T02:03:40.406553] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-28T02:03:40.406639] [DEBUG] [LOCAL ] BBVA: No primary data file found to delete. [2025-09-28T02:03:40.406739] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-28T02:03:40.580886] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-28T02:03:40.609552] [INFO ] [REMOTE ] BBN: Full fetch complete (26742 records). [2025-09-28T02:03:40.630491] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-28T02:03:41.005364] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:41.017162] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-28T02:03:41.188188] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-28T02:03:41.219048] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-28T02:03:41.289529] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-28T02:03:41.289684] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-28T02:03:41.290134] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-28T02:03:41.290216] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-28T02:03:41.291064] [DEBUG] [LOCAL ] BBN: Trimmed 26742 records to 18193 (keeping 200 days of data) [2025-09-28T02:03:41.407694] [DEBUG] [LOCAL ] BBN: Primary data saved (18193 records). [2025-09-28T02:03:41.407881] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-28T02:03:41.408019] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBN took 8.4s. Estimated remaining: 11m 21s. Rate: 189.2 symbols/min [2025-09-28T02:03:41.598199] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:41.632282] [DEBUG] [LOCAL ] BBW: Loaded 27177 existing records from primary storage. [2025-09-28T02:03:41.632664] [INFO ] [MAIN ] BBW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:41.633019] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBW took 0.2s. Estimated remaining: 11m 20s. Rate: 189.4 symbols/min [2025-09-28T02:03:41.840720] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:41.881764] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-28T02:03:41.882196] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-28T02:03:41.962844] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-28T02:03:41.970377] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-28T02:03:41.968971] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-28T02:03:41.983676] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-28T02:03:42.032703] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-09-28T02:03:42.033104] [INFO ] [MAIN ] BBWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:42.033440] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBWI took 0.4s. Estimated remaining: 11m 20s. Rate: 189.2 symbols/min [2025-09-28T02:03:42.218184] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:42.281265] [DEBUG] [LOCAL ] BBY: Loaded 54253 existing records from primary storage. [2025-09-28T02:03:42.281718] [INFO ] [MAIN ] BBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:42.282067] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBY took 0.2s. Estimated remaining: 11m 19s. Rate: 189.4 symbols/min [2025-09-28T02:03:42.462813] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:42.511230] [DEBUG] [LOCAL ] BC: Loaded 45020 existing records from primary storage. [2025-09-28T02:03:42.511605] [INFO ] [MAIN ] BC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:42.511984] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BC took 0.2s. Estimated remaining: 11m 18s. Rate: 189.6 symbols/min [2025-09-28T02:03:42.716355] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:42.757810] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-28T02:03:42.769111] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-28T02:03:42.800788] [DEBUG] [LOCAL ] BCAT: Loaded 34910 existing records from primary storage. [2025-09-28T02:03:42.801204] [INFO ] [MAIN ] BCAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:42.801564] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BCAT took 0.3s. Estimated remaining: 11m 18s. Rate: 189.7 symbols/min [2025-09-28T02:03:42.946926] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-28T02:03:43.004214] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:43.002270] [INFO ] [REMOTE ] BBUC: Full fetch complete (17692 records). [2025-09-28T02:03:43.004612] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-28T02:03:43.312872] [DEBUG] [LOCAL ] BCC: Loaded 28735 existing records from primary storage. [2025-09-28T02:03:43.349839] [INFO ] [MAIN ] BCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:43.375770] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BCC took 0.6s. Estimated remaining: 11m 20s. Rate: 189.0 symbols/min [2025-09-28T02:03:43.571304] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-28T02:03:43.594107] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-28T02:03:43.627011] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-28T02:03:43.649834] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-28T02:03:43.680083] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:43.681832] [DEBUG] [LOCAL ] BBUC: Trimmed 17692 records to 13503 (keeping 200 days of data) [2025-09-28T02:03:43.776100] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-28T02:03:43.794021] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-28T02:03:43.891407] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-28T02:03:43.891702] [DEBUG] [LOCAL ] BBUC: Primary data saved (13503 records). [2025-09-28T02:03:43.905210] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-28T02:03:43.904604] [DEBUG] [LOCAL ] BCE: Loaded 53072 existing records from primary storage. [2025-09-28T02:03:43.906257] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BBUC took 7.0s. Estimated remaining: 11m 21s. Rate: 188.4 symbols/min [2025-09-28T02:03:43.907014] [INFO ] [MAIN ] BCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:43.912823] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-28T02:03:43.913219] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCE took 0.5s. Estimated remaining: 11m 18s. Rate: 189.2 symbols/min [2025-09-28T02:03:44.311934] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:44.316596] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:44.317345] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-09-28T02:03:44.317424] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-09-28T02:03:44.317549] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-28T02:03:44.317622] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-28T02:03:44.317726] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-28T02:03:44.317798] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-28T02:03:44.608160] [DEBUG] [LOCAL ] BCO: Loaded 26740 existing records from primary storage. [2025-09-28T02:03:44.647103] [INFO ] [MAIN ] BCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:44.650911] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCO took 0.7s. Estimated remaining: 11m 22s. Rate: 188.2 symbols/min [2025-09-28T02:03:44.854260] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:44.865752] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-28T02:03:44.931099] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:44.931310] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-09-28T02:03:44.931385] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-09-28T02:03:44.931505] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-28T02:03:44.931579] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-28T02:03:44.931687] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-28T02:03:44.931765] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-28T02:03:45.334576] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:03:45.335268] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-28T02:03:45.421346] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-28T02:03:45.433015] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-28T02:03:46.034170] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-28T02:03:46.063334] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-28T02:03:46.065981] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-28T02:03:46.072529] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-28T02:03:46.871037] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-28T02:03:46.882634] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-28T02:03:46.953253] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-28T02:03:46.964470] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-28T02:03:47.253860] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-28T02:03:47.259250] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-28T02:03:47.677569] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-28T02:03:47.697544] [INFO ] [REMOTE ] BB: Full fetch complete (76984 records). [2025-09-28T02:03:47.697926] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-28T02:03:48.145632] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-28T02:03:48.145813] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-28T02:03:48.146793] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-28T02:03:48.147032] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-28T02:03:48.163353] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-28T02:03:48.170281] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-28T02:03:48.170446] [DEBUG] [LOCAL ] BB: Trimmed 76984 records to 53701 (keeping 200 days of data) [2025-09-28T02:03:48.433764] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-28T02:03:48.451809] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-28T02:03:48.532447] [DEBUG] [LOCAL ] BB: Primary data saved (53701 records). [2025-09-28T02:03:48.532663] [INFO ] [MAIN ] BB: Full history saved. [2025-09-28T02:03:48.532800] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BB took 17.4s. Estimated remaining: 11m 54s. Rate: 179.6 symbols/min [2025-09-28T02:03:48.727113] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:48.763096] [DEBUG] [LOCAL ] BCSF: Loaded 28231 existing records from primary storage. [2025-09-28T02:03:48.763747] [INFO ] [MAIN ] BCSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:48.764357] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCSF took 0.2s. Estimated remaining: 11m 53s. Rate: 179.8 symbols/min [2025-09-28T02:03:48.952689] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:48.982754] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-28T02:03:48.994143] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-28T02:03:49.013438] [DEBUG] [LOCAL ] BCX: Loaded 21920 existing records from primary storage. [2025-09-28T02:03:49.013952] [INFO ] [MAIN ] BCX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:49.014118] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCX took 0.2s. Estimated remaining: 11m 52s. Rate: 180.0 symbols/min [2025-09-28T02:03:49.203605] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:03:49.229227] [DEBUG] [LOCAL ] BDC: Loaded 25073 existing records from primary storage. [2025-09-28T02:03:49.229550] [INFO ] [MAIN ] BDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:03:49.229679] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BDC took 0.2s. Estimated remaining: 11m 50s. Rate: 180.3 symbols/min [2025-09-28T02:03:49.270251] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-28T02:03:49.276990] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-28T02:03:50.181985] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-28T02:03:50.193971] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-28T02:03:50.671110] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-28T02:03:50.678969] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-28T02:03:50.901290] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-28T02:03:50.912138] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-28T02:03:52.024058] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-28T02:03:52.035497] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-28T02:03:52.209795] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-28T02:03:52.216444] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-28T02:03:52.889584] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-28T02:03:52.901992] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-28T02:03:53.417038] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-28T02:03:53.423809] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-28T02:03:53.474986] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-28T02:03:53.486275] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-28T02:03:54.760567] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-28T02:03:54.768578] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-28T02:03:54.869474] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-28T02:03:54.882137] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-28T02:03:55.036306] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-28T02:03:55.046161] [INFO ] [REMOTE ] BBVA: Full fetch complete (71572 records). [2025-09-28T02:03:55.046426] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-28T02:03:55.470886] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-28T02:03:55.471032] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-28T02:03:55.471822] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-28T02:03:55.471910] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-28T02:03:55.473483] [DEBUG] [LOCAL ] BBVA: Trimmed 71572 records to 50167 (keeping 200 days of data) [2025-09-28T02:03:55.780035] [DEBUG] [LOCAL ] BBVA: Primary data saved (50167 records). [2025-09-28T02:03:55.780235] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-28T02:03:55.780430] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BBVA took 15.6s. Estimated remaining: 12m 46s. Rate: 167.2 symbols/min [2025-09-28T02:03:56.075997] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-28T02:03:56.082623] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-28T02:03:56.730776] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-28T02:03:56.742983] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-28T02:03:57.311176] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-28T02:03:57.317773] [INFO ] [REMOTE ] BCH: Full fetch complete (40848 records). [2025-09-28T02:03:57.317968] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-28T02:03:57.720511] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-28T02:03:57.720682] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-28T02:03:57.721288] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-28T02:03:57.721391] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-28T02:03:57.722672] [DEBUG] [LOCAL ] BCH: Trimmed 40848 records to 30039 (keeping 200 days of data) [2025-09-28T02:03:57.900444] [DEBUG] [LOCAL ] BCH: Primary data saved (30039 records). [2025-09-28T02:03:57.900676] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-28T02:03:57.900830] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCH took 14.0s. Estimated remaining: 13m 1s. Rate: 163.8 symbols/min [2025-09-28T02:03:58.537334] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-28T02:03:58.548899] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-28T02:04:00.601365] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-28T02:04:00.620466] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-28T02:04:03.177525] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-28T02:04:03.194664] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-28T02:04:05.140371] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-28T02:04:05.151297] [INFO ] [REMOTE ] BCS: Full fetch complete (77288 records). [2025-09-28T02:04:05.151492] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-28T02:04:05.580461] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-28T02:04:05.580607] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-28T02:04:05.581463] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-28T02:04:05.581592] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-28T02:04:05.583526] [DEBUG] [LOCAL ] BCS: Trimmed 77288 records to 54242 (keeping 200 days of data) [2025-09-28T02:04:05.923568] [DEBUG] [LOCAL ] BCS: Primary data saved (54242 records). [2025-09-28T02:04:05.923824] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-28T02:04:05.923967] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BCS took 21.3s. Estimated remaining: 14m 9s. Rate: 150.7 symbols/min [2025-09-28T02:04:06.547826] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:06.649373] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:06.623254] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:06.719495] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:06.809974] [DEBUG] [LOCAL ] BDJ: Loaded 29325 existing records from primary storage. [2025-09-28T02:04:06.811011] [INFO ] [MAIN ] BDJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:06.826845] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 0.9s. Estimated remaining: 14m 13s. Rate: 149.9 symbols/min [2025-09-28T02:04:06.990393] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-28T02:04:06.976261] [DEBUG] [LOCAL ] BDN: Loaded 48230 existing records from primary storage. [2025-09-28T02:04:07.023386] [DEBUG] [LOCAL ] BDX: Loaded 53191 existing records from primary storage. [2025-09-28T02:04:07.021600] [INFO ] [MAIN ] BE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:07.015387] [INFO ] [MAIN ] BDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:07.023905] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BE took 1.1s. Estimated remaining: 14m 10s. Rate: 150.2 symbols/min [2025-09-28T02:04:07.024574] [INFO ] [MAIN ] BDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:07.041549] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDN took 1.1s. Estimated remaining: 14m 7s. Rate: 150.8 symbols/min [2025-09-28T02:04:07.110803] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BDX took 1.1s. Estimated remaining: 14m 3s. Rate: 151.3 symbols/min [2025-09-28T02:04:07.236700] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:07.335354] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-28T02:04:07.439676] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-28T02:04:07.498599] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-28T02:04:07.595942] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-28T02:04:07.599489] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-28T02:04:07.680845] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-28T02:04:07.831698] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:07.930825] [DEBUG] [LOCAL ] BEKE: No existing data file found in primary storage. [2025-09-28T02:04:08.018358] [WARN ] [MAIN ] BEKE: No existing data found, performing full refresh instead. [2025-09-28T02:04:08.027798] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:08.043479] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-28T02:04:08.044898] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:08.066085] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-28T02:04:08.071437] [DEBUG] [LOCAL ] BEP: No existing data file found in primary storage. [2025-09-28T02:04:08.086800] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-09-28T02:04:08.086911] [WARN ] [MAIN ] BEP: No existing data found, performing full refresh instead. [2025-09-28T02:04:08.092730] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-28T02:04:08.104103] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-28T02:04:08.161419] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-28T02:04:08.254113] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-09-28T02:04:08.300075] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-28T02:04:08.812609] [DEBUG] [LOCAL ] BEN: Loaded 53833 existing records from primary storage. [2025-09-28T02:04:08.880436] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:08.911907] [INFO ] [MAIN ] BEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:08.952218] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEN took 1.8s. Estimated remaining: 14m 16s. Rate: 149.1 symbols/min [2025-09-28T02:04:08.912402] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-28T02:04:09.195213] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:09.281448] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-28T02:04:09.377782] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-28T02:04:09.398469] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:09.400379] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-28T02:04:09.488195] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:09.488717] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-28T02:04:09.524242] [DEBUG] [LOCAL ] BEPC: Loaded 47209 existing records from primary storage. [2025-09-28T02:04:09.524602] [INFO ] [MAIN ] BEPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:09.524753] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEPC took 0.6s. Estimated remaining: 14m 17s. Rate: 148.8 symbols/min [2025-09-28T02:04:09.641184] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-28T02:04:09.642540] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-28T02:04:09.722978] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:09.732776] [DEBUG] [LOCAL ] BEPH: Loaded 5208 existing records from primary storage. [2025-09-28T02:04:09.733087] [INFO ] [MAIN ] BEPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:09.733192] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEPH took 0.2s. Estimated remaining: 14m 15s. Rate: 149.1 symbols/min [2025-09-28T02:04:09.849312] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-28T02:04:09.866807] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-28T02:04:09.931535] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:09.938107] [DEBUG] [LOCAL ] BEPI: Loaded 3487 existing records from primary storage. [2025-09-28T02:04:09.938375] [INFO ] [MAIN ] BEPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:09.938483] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEPI took 0.2s. Estimated remaining: 14m 12s. Rate: 149.4 symbols/min [2025-09-28T02:04:10.128047] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:10.134670] [DEBUG] [LOCAL ] BEPJ: Loaded 3268 existing records from primary storage. [2025-09-28T02:04:10.135082] [INFO ] [MAIN ] BEPJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:10.135208] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPJ took 0.2s. Estimated remaining: 14m 10s. Rate: 149.7 symbols/min [2025-09-28T02:04:10.233512] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-28T02:04:10.251604] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-28T02:04:10.334117] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:10.361964] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-28T02:04:10.372188] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-28T02:04:10.407340] [DEBUG] [LOCAL ] BFAM: Loaded 33519 existing records from primary storage. [2025-09-28T02:04:10.407814] [INFO ] [MAIN ] BFAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:10.407924] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BFAM took 0.3s. Estimated remaining: 14m 9s. Rate: 149.9 symbols/min [2025-09-28T02:04:10.594345] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-28T02:04:10.644669] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:10.648667] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-28T02:04:10.647057] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-28T02:04:10.663173] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-28T02:04:10.705208] [DEBUG] [LOCAL ] BFH: Loaded 42308 existing records from primary storage. [2025-09-28T02:04:10.705621] [INFO ] [MAIN ] BFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:10.705763] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BFH took 0.3s. Estimated remaining: 14m 8s. Rate: 150.1 symbols/min [2025-09-28T02:04:10.820466] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.17 seconds). [2025-09-28T02:04:10.827739] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-28T02:04:10.904392] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:10.920970] [DEBUG] [LOCAL ] BFK: Loaded 14145 existing records from primary storage. [2025-09-28T02:04:10.921295] [INFO ] [MAIN ] BFK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:10.921419] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BFK took 0.2s. Estimated remaining: 14m 6s. Rate: 150.3 symbols/min [2025-09-28T02:04:11.119520] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:11.119717] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-28T02:04:11.121840] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-28T02:04:11.157118] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-28T02:04:11.168778] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-28T02:04:11.201464] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-28T02:04:11.214763] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-28T02:04:11.254799] [DEBUG] [LOCAL ] BFLY: Loaded 52590 existing records from primary storage. [2025-09-28T02:04:11.255231] [INFO ] [MAIN ] BFLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:11.255340] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFLY took 0.3s. Estimated remaining: 14m 5s. Rate: 150.4 symbols/min [2025-09-28T02:04:11.343790] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-28T02:04:11.364304] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-28T02:04:11.467317] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:11.480115] [DEBUG] [LOCAL ] BFS: Loaded 9240 existing records from primary storage. [2025-09-28T02:04:11.480432] [INFO ] [MAIN ] BFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:11.480540] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFS took 0.2s. Estimated remaining: 14m 3s. Rate: 150.7 symbols/min [2025-09-28T02:04:11.557411] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.19 seconds). [2025-09-28T02:04:11.597369] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-28T02:04:11.784886] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:11.801865] [DEBUG] [LOCAL ] BFZ: Loaded 12223 existing records from primary storage. [2025-09-28T02:04:11.802221] [INFO ] [MAIN ] BFZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:11.802570] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFZ took 0.3s. Estimated remaining: 14m 2s. Rate: 150.8 symbols/min [2025-09-28T02:04:11.872033] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-28T02:04:11.894232] [INFO ] [REMOTE ] BEDU: Full fetch complete (1429 records). [2025-09-28T02:04:11.924616] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-28T02:04:12.095683] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:12.153061] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-28T02:04:12.206984] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-28T02:04:12.269443] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-28T02:04:12.286393] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:04:12.299438] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:04:12.301261] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-28T02:04:12.299774] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-28T02:04:12.311093] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-28T02:04:12.311931] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-28T02:04:12.312368] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-28T02:04:12.312795] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-28T02:04:12.313080] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BEDU took 5.5s. Estimated remaining: 14m 2s. Rate: 150.7 symbols/min [2025-09-28T02:04:12.546091] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:12.547534] [DEBUG] [LOCAL ] BG: Loaded 51118 existing records from primary storage. [2025-09-28T02:04:12.548346] [INFO ] [MAIN ] BG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:12.548492] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BG took 0.7s. Estimated remaining: 14m 1s. Rate: 150.9 symbols/min [2025-09-28T02:04:12.753123] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:12.731268] [DEBUG] [LOCAL ] BGB: Loaded 17621 existing records from primary storage. [2025-09-28T02:04:12.754557] [INFO ] [MAIN ] BGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:12.754842] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BGB took 0.4s. Estimated remaining: 13m 59s. Rate: 151.2 symbols/min [2025-09-28T02:04:12.899513] [DEBUG] [LOCAL ] BGH: Loaded 16728 existing records from primary storage. [2025-09-28T02:04:12.940926] [INFO ] [MAIN ] BGH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:12.961533] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGH took 0.4s. Estimated remaining: 13m 57s. Rate: 151.5 symbols/min [2025-09-28T02:04:12.966177] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:13.101396] [DEBUG] [LOCAL ] BGR: Loaded 13658 existing records from primary storage. [2025-09-28T02:04:13.103112] [INFO ] [MAIN ] BGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:13.163370] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGR took 0.4s. Estimated remaining: 13m 55s. Rate: 151.7 symbols/min [2025-09-28T02:04:13.246585] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:13.250285] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-28T02:04:13.300959] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-28T02:04:13.312276] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-28T02:04:13.353481] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-28T02:04:13.494637] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:13.512498] [DEBUG] [LOCAL ] BGS: Loaded 51183 existing records from primary storage. [2025-09-28T02:04:13.514547] [INFO ] [MAIN ] BGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:13.514740] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGS took 0.5s. Estimated remaining: 13m 54s. Rate: 151.8 symbols/min [2025-09-28T02:04:13.590638] [DEBUG] [LOCAL ] BGSF: Loaded 7050 existing records from primary storage. [2025-09-28T02:04:13.614314] [INFO ] [MAIN ] BGSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:13.634420] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGSF took 0.4s. Estimated remaining: 13m 51s. Rate: 152.2 symbols/min [2025-09-28T02:04:13.828002] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:13.932429] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:13.939783] [DEBUG] [LOCAL ] BGT: Loaded 16793 existing records from primary storage. [2025-09-28T02:04:13.940516] [INFO ] [MAIN ] BGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:13.940717] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGT took 0.4s. Estimated remaining: 13m 50s. Rate: 152.3 symbols/min [2025-09-28T02:04:14.058408] [DEBUG] [LOCAL ] BGX: Loaded 10900 existing records from primary storage. [2025-09-28T02:04:14.059333] [INFO ] [MAIN ] BGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:14.059905] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGX took 0.4s. Estimated remaining: 13m 48s. Rate: 152.7 symbols/min [2025-09-28T02:04:14.213594] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:14.348227] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:14.354583] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-09-28T02:04:14.354736] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-09-28T02:04:14.355386] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-28T02:04:14.366087] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-28T02:04:14.387275] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-28T02:04:14.397770] [DEBUG] [LOCAL ] BGY: Loaded 22790 existing records from primary storage. [2025-09-28T02:04:14.396905] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-28T02:04:14.401504] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-28T02:04:14.452603] [INFO ] [MAIN ] BGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:14.512529] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGY took 0.6s. Estimated remaining: 13m 48s. Rate: 152.7 symbols/min [2025-09-28T02:04:14.534503] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-28T02:04:14.604762] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-28T02:04:14.785902] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-28T02:04:14.992685] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:15.090854] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:15.091399] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-28T02:04:15.132990] [DEBUG] [LOCAL ] BHC: Loaded 47495 existing records from primary storage. [2025-09-28T02:04:15.133404] [INFO ] [MAIN ] BHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:15.133517] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BHC took 0.6s. Estimated remaining: 13m 49s. Rate: 152.3 symbols/min [2025-09-28T02:04:15.333364] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:15.333935] [DEBUG] [LOCAL ] BHE: No existing data file found in primary storage. [2025-09-28T02:04:15.334294] [WARN ] [MAIN ] BHE: No existing data found, performing full refresh instead. [2025-09-28T02:04:15.334885] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-28T02:04:15.335022] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-28T02:04:15.335351] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-09-28T02:04:15.335619] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-28T02:04:15.571287] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-28T02:04:15.656174] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-28T02:04:15.743422] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-28T02:04:15.753738] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-28T02:04:15.838576] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:15.839256] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-28T02:04:15.863476] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-28T02:04:15.873173] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-28T02:04:16.115185] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-28T02:04:16.117742] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-28T02:04:16.273270] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-28T02:04:16.297051] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-28T02:04:16.300257] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-28T02:04:16.307297] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-28T02:04:16.313541] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-28T02:04:16.316406] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-28T02:04:16.485869] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.17 seconds). [2025-09-28T02:04:16.489052] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-28T02:04:16.520182] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-28T02:04:16.532098] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-28T02:04:16.645173] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-28T02:04:16.654514] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-28T02:04:16.931633] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-28T02:04:16.943977] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-28T02:04:16.988861] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-28T02:04:16.995042] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-28T02:04:17.072926] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-28T02:04:17.074720] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-28T02:04:17.086055] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-28T02:04:17.086393] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-28T02:04:17.225222] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-28T02:04:17.231161] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-28T02:04:17.315614] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-28T02:04:17.327825] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-28T02:04:17.351917] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-28T02:04:17.360624] [INFO ] [REMOTE ] BEP: Full fetch complete (58337 records). [2025-09-28T02:04:17.360875] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-28T02:04:17.687278] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-28T02:04:17.762473] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-28T02:04:17.825119] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-28T02:04:17.838739] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-28T02:04:17.839682] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-28T02:04:17.840099] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-28T02:04:17.841746] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-28T02:04:17.850200] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-28T02:04:17.851957] [DEBUG] [LOCAL ] BEP: Trimmed 58337 records to 39244 (keeping 200 days of data) [2025-09-28T02:04:18.106026] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-28T02:04:18.135035] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-28T02:04:18.142178] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-28T02:04:18.135556] [INFO ] [REMOTE ] BEKE: Full fetch complete (77195 records). [2025-09-28T02:04:18.144183] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-28T02:04:18.419361] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-28T02:04:18.494750] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-28T02:04:18.644739] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-28T02:04:18.646004] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-28T02:04:18.647218] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-28T02:04:18.647681] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-28T02:04:18.652737] [DEBUG] [LOCAL ] BEKE: Trimmed 77195 records to 54025 (keeping 200 days of data) [2025-09-28T02:04:18.707792] [DEBUG] [LOCAL ] BEP: Primary data saved (39244 records). [2025-09-28T02:04:18.716810] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-28T02:04:18.717103] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BEP took 11.6s. Estimated remaining: 14m 14s. Rate: 147.8 symbols/min [2025-09-28T02:04:18.893295] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-28T02:04:18.915888] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-28T02:04:18.989291] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:19.017346] [DEBUG] [LOCAL ] BHK: Loaded 22922 existing records from primary storage. [2025-09-28T02:04:19.018849] [INFO ] [MAIN ] BHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:19.019501] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BHK took 0.3s. Estimated remaining: 14m 13s. Rate: 148.0 symbols/min [2025-09-28T02:04:19.336906] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:19.361151] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-28T02:04:19.370871] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-28T02:04:19.436799] [DEBUG] [LOCAL ] BHP: Loaded 54153 existing records from primary storage. [2025-09-28T02:04:19.438883] [INFO ] [MAIN ] BHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:19.439378] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHP took 0.4s. Estimated remaining: 14m 12s. Rate: 148.0 symbols/min [2025-09-28T02:04:19.706386] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:19.729508] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-28T02:04:19.747400] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-28T02:04:19.774075] [DEBUG] [LOCAL ] BHR: Loaded 21771 existing records from primary storage. [2025-09-28T02:04:19.775018] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-28T02:04:19.782374] [INFO ] [MAIN ] BHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:19.783511] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHR took 0.3s. Estimated remaining: 14m 12s. Rate: 148.0 symbols/min [2025-09-28T02:04:19.784287] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-28T02:04:20.006416] [DEBUG] [LOCAL ] BEKE: Primary data saved (54025 records). [2025-09-28T02:04:20.006787] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-28T02:04:20.007018] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BEKE took 13.0s. Estimated remaining: 14m 10s. Rate: 148.3 symbols/min [2025-09-28T02:04:20.006295] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:20.041842] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-28T02:04:20.079530] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-28T02:04:20.102530] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-28T02:04:20.122305] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-28T02:04:20.122476] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-28T02:04:20.122549] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-28T02:04:20.296946] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:20.463595] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-28T02:04:20.590010] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-28T02:04:20.583429] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-28T02:04:20.618885] [INFO ] [REMOTE ] BH: Full fetch complete (19460 records). [2025-09-28T02:04:20.676911] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-28T02:04:20.711046] [DEBUG] [LOCAL ] BHVN: Loaded 50401 existing records from primary storage. [2025-09-28T02:04:20.715580] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:20.758320] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-28T02:04:20.740579] [INFO ] [MAIN ] BHVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:20.790992] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHVN took 0.8s. Estimated remaining: 14m 12s. Rate: 147.8 symbols/min [2025-09-28T02:04:21.111447] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-28T02:04:21.160597] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-28T02:04:21.172682] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:21.359237] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-28T02:04:21.359952] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-28T02:04:21.360883] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-28T02:04:21.360306] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-28T02:04:21.367031] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-28T02:04:21.367520] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-28T02:04:21.383900] [DEBUG] [LOCAL ] BH: Trimmed 19460 records to 15938 (keeping 200 days of data) [2025-09-28T02:04:21.477431] [DEBUG] [LOCAL ] BILL: Loaded 53105 existing records from primary storage. [2025-09-28T02:04:21.479776] [INFO ] [MAIN ] BILL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:21.481233] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BILL took 0.7s. Estimated remaining: 14m 14s. Rate: 147.4 symbols/min [2025-09-28T02:04:21.613515] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-28T02:04:21.619518] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-28T02:04:21.705767] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:21.718047] [DEBUG] [LOCAL ] BH: Primary data saved (15938 records). [2025-09-28T02:04:21.718281] [INFO ] [MAIN ] BH: Full history saved. [2025-09-28T02:04:21.718414] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BH took 7.6s. Estimated remaining: 14m 12s. Rate: 147.6 symbols/min [2025-09-28T02:04:21.937879] [DEBUG] [LOCAL ] BIO: Loaded 25533 existing records from primary storage. [2025-09-28T02:04:21.943258] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:21.943834] [INFO ] [MAIN ] BIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:21.944354] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BIO took 0.5s. Estimated remaining: 14m 11s. Rate: 147.9 symbols/min [2025-09-28T02:04:21.994429] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-28T02:04:21.995909] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-28T02:04:22.081722] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-28T02:04:22.103155] [INFO ] [REMOTE ] BHE: Full fetch complete (36506 records). [2025-09-28T02:04:22.119110] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-28T02:04:22.189104] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:22.278172] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-28T02:04:22.327493] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-28T02:04:22.329253] [DEBUG] [LOCAL ] BIP: Loaded 40240 existing records from primary storage. [2025-09-28T02:04:22.355141] [INFO ] [MAIN ] BIP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:22.398039] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BIP took 0.7s. Estimated remaining: 14m 10s. Rate: 147.8 symbols/min [2025-09-28T02:04:22.587405] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-28T02:04:22.671608] [DEBUG] [LOCAL ] BIPC: Loaded 42317 existing records from primary storage. [2025-09-28T02:04:22.704714] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-28T02:04:22.735611] [INFO ] [MAIN ] BIPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:22.772517] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIPC took 0.8s. Estimated remaining: 14m 10s. Rate: 147.8 symbols/min [2025-09-28T02:04:22.890733] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:22.934975] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-28T02:04:22.935101] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-28T02:04:22.935607] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-28T02:04:22.935722] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-28T02:04:22.937063] [DEBUG] [LOCAL ] BHE: Trimmed 36506 records to 25353 (keeping 200 days of data) [2025-09-28T02:04:22.941303] [DEBUG] [LOCAL ] BIPH: Loaded 2632 existing records from primary storage. [2025-09-28T02:04:23.001249] [INFO ] [MAIN ] BIPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:23.001492] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIPH took 0.6s. Estimated remaining: 14m 8s. Rate: 148.1 symbols/min [2025-09-28T02:04:23.033148] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-28T02:04:23.035779] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-28T02:04:23.104550] [DEBUG] [LOCAL ] BHE: Primary data saved (25353 records). [2025-09-28T02:04:23.104758] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-28T02:04:23.104886] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BHE took 8.0s. Estimated remaining: 14m 5s. Rate: 148.5 symbols/min [2025-09-28T02:04:23.212225] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.18 seconds). [2025-09-28T02:04:23.213249] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-28T02:04:23.354250] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.14 seconds). [2025-09-28T02:04:23.355323] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-28T02:04:23.653459] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-28T02:04:23.855818] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-28T02:04:24.083625] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-28T02:04:24.084636] [INFO ] [REMOTE ] BHV: Full fetch complete (1368 records). [2025-09-28T02:04:24.084755] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-28T02:04:24.276269] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-28T02:04:24.276476] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:04:24.276551] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:04:24.276629] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-28T02:04:24.276745] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-28T02:04:24.276842] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-28T02:04:24.276958] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-28T02:04:24.277058] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BHV took 4.5s. Estimated remaining: 14m 11s. Rate: 147.5 symbols/min [2025-09-28T02:04:24.962341] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:25.019039] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:24.993484] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:25.074444] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:25.077463] [DEBUG] [LOCAL ] BIPJ: Loaded 3026 existing records from primary storage. [2025-09-28T02:04:25.077979] [INFO ] [MAIN ] BIPJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:25.078374] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 0.8s. Estimated remaining: 14m 13s. Rate: 147.0 symbols/min [2025-09-28T02:04:25.213113] [DEBUG] [LOCAL ] BIPI: Loaded 3282 existing records from primary storage. [2025-09-28T02:04:25.214011] [DEBUG] [LOCAL ] BIT: Loaded 22765 existing records from primary storage. [2025-09-28T02:04:25.214357] [INFO ] [MAIN ] BIPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:25.225783] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPI took 0.9s. Estimated remaining: 14m 11s. Rate: 147.3 symbols/min [2025-09-28T02:04:25.215013] [INFO ] [MAIN ] BIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:25.276614] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIT took 1.0s. Estimated remaining: 14m 8s. Rate: 147.8 symbols/min [2025-09-28T02:04:25.330367] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:25.516806] [DEBUG] [LOCAL ] BIRK: Loaded 51674 existing records from primary storage. [2025-09-28T02:04:25.541296] [INFO ] [MAIN ] BIRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:25.570401] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 1.3s. Estimated remaining: 14m 7s. Rate: 147.9 symbols/min [2025-09-28T02:04:25.711384] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:25.832226] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:25.972480] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:25.975075] [DEBUG] [LOCAL ] BJ: Loaded 52156 existing records from primary storage. [2025-09-28T02:04:25.975839] [INFO ] [MAIN ] BJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:25.975973] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 0.9s. Estimated remaining: 14m 6s. Rate: 147.9 symbols/min [2025-09-28T02:04:26.177325] [DEBUG] [LOCAL ] BKD: Loaded 50889 existing records from primary storage. [2025-09-28T02:04:26.203579] [DEBUG] [LOCAL ] BK: Loaded 54319 existing records from primary storage. [2025-09-28T02:04:26.228160] [INFO ] [MAIN ] BKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:26.231745] [INFO ] [MAIN ] BK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:26.240027] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BKD took 0.9s. Estimated remaining: 14m 5s. Rate: 148.1 symbols/min [2025-09-28T02:04:26.273473] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:26.273550] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BK took 1.0s. Estimated remaining: 14m 2s. Rate: 148.6 symbols/min [2025-09-28T02:04:26.317237] [DEBUG] [LOCAL ] BKE: Loaded 35206 existing records from primary storage. [2025-09-28T02:04:26.392557] [INFO ] [MAIN ] BKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:26.424518] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKE took 0.8s. Estimated remaining: 13m 59s. Rate: 148.9 symbols/min [2025-09-28T02:04:26.699790] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:26.839960] [DEBUG] [LOCAL ] BKH: Loaded 37133 existing records from primary storage. [2025-09-28T02:04:26.828186] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:26.850940] [INFO ] [MAIN ] BKH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:26.851224] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKH took 0.9s. Estimated remaining: 13m 59s. Rate: 148.8 symbols/min [2025-09-28T02:04:26.980430] [DEBUG] [LOCAL ] BKN: Loaded 7853 existing records from primary storage. [2025-09-28T02:04:27.005426] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:27.005859] [INFO ] [MAIN ] BKN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:27.031382] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKN took 0.7s. Estimated remaining: 13m 57s. Rate: 149.1 symbols/min [2025-09-28T02:04:27.239660] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:27.192741] [DEBUG] [LOCAL ] BKKT: Loaded 35164 existing records from primary storage. [2025-09-28T02:04:27.294440] [INFO ] [MAIN ] BKKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:27.299353] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKKT took 1.1s. Estimated remaining: 13m 56s. Rate: 149.3 symbols/min [2025-09-28T02:04:27.421578] [DEBUG] [LOCAL ] BKT: Loaded 11125 existing records from primary storage. [2025-09-28T02:04:27.436620] [INFO ] [MAIN ] BKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:27.492040] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:27.518536] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKT took 0.6s. Estimated remaining: 13m 54s. Rate: 149.5 symbols/min [2025-09-28T02:04:27.520081] [DEBUG] [LOCAL ] BKSY: Loaded 48993 existing records from primary storage. [2025-09-28T02:04:27.526252] [INFO ] [MAIN ] BKSY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:27.541881] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKSY took 1.1s. Estimated remaining: 13m 51s. Rate: 150.0 symbols/min [2025-09-28T02:04:27.763594] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:27.990428] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:28.008690] [DEBUG] [LOCAL ] BKU: Loaded 42412 existing records from primary storage. [2025-09-28T02:04:28.031524] [INFO ] [MAIN ] BKU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:28.031053] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:28.032679] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKU took 1.0s. Estimated remaining: 13m 51s. Rate: 149.9 symbols/min [2025-09-28T02:04:28.130235] [DEBUG] [LOCAL ] BKV: Loaded 30278 existing records from primary storage. [2025-09-28T02:04:28.188788] [INFO ] [MAIN ] BKV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:28.200098] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKV took 0.9s. Estimated remaining: 13m 49s. Rate: 150.2 symbols/min [2025-09-28T02:04:28.256265] [DEBUG] [LOCAL ] BLD: Loaded 28408 existing records from primary storage. [2025-09-28T02:04:28.320454] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:28.347515] [INFO ] [MAIN ] BLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:28.373338] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLD took 0.8s. Estimated remaining: 13m 47s. Rate: 150.5 symbols/min [2025-09-28T02:04:28.390597] [DEBUG] [LOCAL ] BLCO: Loaded 36110 existing records from primary storage. [2025-09-28T02:04:28.436034] [INFO ] [MAIN ] BLCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:28.442018] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLCO took 0.9s. Estimated remaining: 13m 45s. Rate: 150.9 symbols/min [2025-09-28T02:04:28.623276] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:28.851082] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:28.945982] [DEBUG] [LOCAL ] BLE: Loaded 14718 existing records from primary storage. [2025-09-28T02:04:28.950815] [DEBUG] [LOCAL ] BLDR: Loaded 52403 existing records from primary storage. [2025-09-28T02:04:28.952127] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:28.952703] [INFO ] [MAIN ] BLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:28.952925] [INFO ] [MAIN ] BLDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:28.953035] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 0.7s. Estimated remaining: 13m 45s. Rate: 150.8 symbols/min [2025-09-28T02:04:28.954717] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLDR took 0.9s. Estimated remaining: 13m 42s. Rate: 151.3 symbols/min [2025-09-28T02:04:29.385340] [DEBUG] [LOCAL ] BLK: Loaded 35240 existing records from primary storage. [2025-09-28T02:04:29.384147] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:29.385843] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-28T02:04:29.331629] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:29.386058] [INFO ] [MAIN ] BLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:29.385943] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-28T02:04:29.386626] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLK took 1.0s. Estimated remaining: 13m 42s. Rate: 151.2 symbols/min [2025-09-28T02:04:29.386781] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-28T02:04:29.420385] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-28T02:04:29.497096] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-28T02:04:29.513757] [DEBUG] [LOCAL ] BLND: Loaded 50107 existing records from primary storage. [2025-09-28T02:04:29.524870] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-28T02:04:29.530351] [DEBUG] [LOCAL ] BLW: Loaded 13044 existing records from primary storage. [2025-09-28T02:04:29.530524] [INFO ] [MAIN ] BLND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:29.541393] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLND took 1.1s. Estimated remaining: 13m 40s. Rate: 151.5 symbols/min [2025-09-28T02:04:29.606953] [INFO ] [MAIN ] BLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:29.699506] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:29.704757] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLW took 0.7s. Estimated remaining: 13m 38s. Rate: 151.8 symbols/min [2025-09-28T02:04:30.131192] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:30.122079] [DEBUG] [LOCAL ] BLX: Loaded 15880 existing records from primary storage. [2025-09-28T02:04:30.250275] [INFO ] [MAIN ] BLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:30.254616] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:30.254998] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLX took 0.9s. Estimated remaining: 13m 38s. Rate: 151.6 symbols/min [2025-09-28T02:04:30.488961] [DEBUG] [LOCAL ] BME: Loaded 10968 existing records from primary storage. [2025-09-28T02:04:30.547043] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:30.567972] [INFO ] [MAIN ] BME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:30.633753] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BME took 0.9s. Estimated remaining: 13m 38s. Rate: 151.6 symbols/min [2025-09-28T02:04:30.633581] [DEBUG] [LOCAL ] BMA: Loaded 35645 existing records from primary storage. [2025-09-28T02:04:30.643221] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:30.607170] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-28T02:04:30.649294] [INFO ] [MAIN ] BMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:30.685007] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 1.1s. Estimated remaining: 13m 35s. Rate: 152.1 symbols/min [2025-09-28T02:04:30.920888] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:04:31.003873] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-28T02:04:31.033772] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:31.010678] [DEBUG] [LOCAL ] BMEZ: Loaded 26421 existing records from primary storage. [2025-09-28T02:04:31.035250] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:31.035847] [INFO ] [MAIN ] BMEZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:31.036035] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:04:31.036435] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BMEZ took 0.8s. Estimated remaining: 13m 34s. Rate: 152.1 symbols/min [2025-09-28T02:04:31.036552] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-09-28T02:04:31.048482] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:04:31.075508] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-28T02:04:31.107027] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-28T02:04:31.146980] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-28T02:04:31.136063] [DEBUG] [LOCAL ] BMN: Loaded 2548 existing records from primary storage. [2025-09-28T02:04:31.158550] [INFO ] [MAIN ] BMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:31.158719] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-28T02:04:31.158807] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMN took 0.4s. Estimated remaining: 13m 32s. Rate: 152.5 symbols/min [2025-09-28T02:04:31.213390] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BLSH took 2.3s. Estimated remaining: 13m 30s. Rate: 152.9 symbols/min [2025-09-28T02:04:31.345175] [DEBUG] [LOCAL ] BMI: Loaded 24611 existing records from primary storage. [2025-09-28T02:04:31.327029] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:31.377425] [INFO ] [MAIN ] BMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:31.393084] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMI took 0.8s. Estimated remaining: 13m 28s. Rate: 153.2 symbols/min [2025-09-28T02:04:31.653759] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:31.778169] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:31.889745] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:31.893280] [DEBUG] [LOCAL ] BMO: Loaded 41940 existing records from primary storage. [2025-09-28T02:04:31.893947] [INFO ] [MAIN ] BMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:31.894169] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 0.9s. Estimated remaining: 13m 28s. Rate: 153.0 symbols/min [2025-09-28T02:04:32.161445] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:32.134071] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-28T02:04:32.162339] [INFO ] [MAIN ] BMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:32.178264] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 1.0s. Estimated remaining: 13m 27s. Rate: 153.2 symbols/min [2025-09-28T02:04:32.176463] [DEBUG] [LOCAL ] BNED: Loaded 30226 existing records from primary storage. [2025-09-28T02:04:32.184478] [INFO ] [MAIN ] BNED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:32.191864] [DEBUG] [LOCAL ] BN: Loaded 53774 existing records from primary storage. [2025-09-28T02:04:32.205376] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BNED took 0.8s. Estimated remaining: 13m 24s. Rate: 153.6 symbols/min [2025-09-28T02:04:32.226251] [INFO ] [MAIN ] BN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:32.255559] [DEBUG] [LOCAL ] BNH: Loaded 4926 existing records from primary storage. [2025-09-28T02:04:32.313057] [INFO ] [MAIN ] BNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:32.291906] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BN took 1.0s. Estimated remaining: 13m 22s. Rate: 154.0 symbols/min [2025-09-28T02:04:32.416913] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNH took 0.5s. Estimated remaining: 13m 20s. Rate: 154.3 symbols/min [2025-09-28T02:04:32.736702] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:32.737997] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:32.909605] [DEBUG] [LOCAL ] BNJ: Loaded 2631 existing records from primary storage. [2025-09-28T02:04:32.909340] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:32.921018] [INFO ] [MAIN ] BNJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:32.926688] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 0.7s. Estimated remaining: 13m 20s. Rate: 154.2 symbols/min [2025-09-28T02:04:33.042586] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:33.210936] [DEBUG] [LOCAL ] BNL: Loaded 47577 existing records from primary storage. [2025-09-28T02:04:33.204330] [DEBUG] [LOCAL ] BNT: Loaded 3473 existing records from primary storage. [2025-09-28T02:04:33.217161] [INFO ] [MAIN ] BNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:33.231307] [INFO ] [MAIN ] BNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:33.218137] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNL took 1.0s. Estimated remaining: 13m 19s. Rate: 154.3 symbols/min [2025-09-28T02:04:33.310022] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:33.266061] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNT took 0.7s. Estimated remaining: 13m 16s. Rate: 154.7 symbols/min [2025-09-28T02:04:33.332361] [DEBUG] [LOCAL ] BNS: Loaded 52212 existing records from primary storage. [2025-09-28T02:04:33.372607] [INFO ] [MAIN ] BNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:33.405420] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNS took 1.0s. Estimated remaining: 13m 14s. Rate: 155.1 symbols/min [2025-09-28T02:04:33.436569] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-28T02:04:33.486075] [INFO ] [MAIN ] BNY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:33.488028] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:33.488341] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNY took 0.6s. Estimated remaining: 13m 12s. Rate: 155.4 symbols/min [2025-09-28T02:04:33.488431] [DEBUG] [LOCAL ] BOC: No existing data file found in primary storage. [2025-09-28T02:04:33.488557] [WARN ] [MAIN ] BOC: No existing data found, performing full refresh instead. [2025-09-28T02:04:33.488868] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-28T02:04:33.488956] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-28T02:04:33.489074] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-09-28T02:04:33.489164] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-28T02:04:33.869874] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:33.870235] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-28T02:04:34.896948] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-28T02:04:34.901284] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-28T02:04:35.951433] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-28T02:04:35.956030] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-28T02:04:36.903494] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-28T02:04:36.907329] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-28T02:04:37.917664] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-28T02:04:37.922142] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-28T02:04:39.258368] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-28T02:04:39.264088] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-28T02:04:40.187192] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-28T02:04:40.191524] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-28T02:04:40.928122] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-28T02:04:40.932885] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-28T02:04:41.991690] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-28T02:04:41.996951] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-28T02:04:42.796346] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-28T02:04:42.801834] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-28T02:04:43.785162] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-28T02:04:43.789777] [INFO ] [REMOTE ] BOC: Full fetch complete (25830 records). [2025-09-28T02:04:43.789971] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-28T02:04:44.190292] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-28T02:04:44.190448] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-28T02:04:44.190903] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-28T02:04:44.191009] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-28T02:04:44.192072] [DEBUG] [LOCAL ] BOC: Trimmed 25830 records to 18626 (keeping 200 days of data) [2025-09-28T02:04:44.304997] [DEBUG] [LOCAL ] BOC: Primary data saved (18626 records). [2025-09-28T02:04:44.305203] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-28T02:04:44.305350] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 11.0s. Estimated remaining: 14m 19s. Rate: 143.3 symbols/min [2025-09-28T02:04:44.959029] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:45.053919] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:45.033729] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:45.092744] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:45.121926] [DEBUG] [LOCAL ] BOE: Loaded 17816 existing records from primary storage. [2025-09-28T02:04:45.122633] [INFO ] [MAIN ] BOE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:45.122872] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOE took 0.8s. Estimated remaining: 14m 21s. Rate: 142.9 symbols/min [2025-09-28T02:04:45.247283] [DEBUG] [LOCAL ] BOH: Loaded 31676 existing records from primary storage. [2025-09-28T02:04:45.247963] [INFO ] [MAIN ] BOH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:45.253767] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOH took 0.9s. Estimated remaining: 14m 18s. Rate: 143.2 symbols/min [2025-09-28T02:04:45.319525] [DEBUG] [LOCAL ] BOND: Loaded 32554 existing records from primary storage. [2025-09-28T02:04:45.379893] [INFO ] [MAIN ] BOND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:45.410433] [DEBUG] [LOCAL ] BOOT: Loaded 41409 existing records from primary storage. [2025-09-28T02:04:45.404397] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOND took 1.1s. Estimated remaining: 14m 16s. Rate: 143.5 symbols/min [2025-09-28T02:04:45.457971] [INFO ] [MAIN ] BOOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:45.497400] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOOT took 1.2s. Estimated remaining: 14m 14s. Rate: 143.8 symbols/min [2025-09-28T02:04:45.576840] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:45.788387] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:45.995731] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:46.016856] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:46.028273] [DEBUG] [LOCAL ] BOW: Loaded 23974 existing records from primary storage. [2025-09-28T02:04:46.044199] [INFO ] [MAIN ] BOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:46.044371] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 0.8s. Estimated remaining: 14m 14s. Rate: 143.7 symbols/min [2025-09-28T02:04:46.045299] [DEBUG] [LOCAL ] BORR: Loaded 51902 existing records from primary storage. [2025-09-28T02:04:46.051626] [INFO ] [MAIN ] BORR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:46.078951] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 1.0s. Estimated remaining: 14m 11s. Rate: 144.1 symbols/min [2025-09-28T02:04:46.424075] [DEBUG] [LOCAL ] BOX: Loaded 51017 existing records from primary storage. [2025-09-28T02:04:46.426703] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:46.444760] [INFO ] [MAIN ] BOX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:46.473200] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOX took 1.0s. Estimated remaining: 14m 11s. Rate: 144.1 symbols/min [2025-09-28T02:04:46.497891] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:46.499990] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-28T02:04:46.512804] [INFO ] [MAIN ] BP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:46.514140] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BP took 1.0s. Estimated remaining: 14m 8s. Rate: 144.5 symbols/min [2025-09-28T02:04:46.876001] [DEBUG] [LOCAL ] BR: Loaded 35251 existing records from primary storage. [2025-09-28T02:04:46.921896] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:46.977663] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:46.928350] [INFO ] [MAIN ] BR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:46.980939] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 0.9s. Estimated remaining: 14m 8s. Rate: 144.5 symbols/min [2025-09-28T02:04:46.979332] [DEBUG] [LOCAL ] BRBR: Loaded 51987 existing records from primary storage. [2025-09-28T02:04:46.986937] [INFO ] [MAIN ] BRBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:47.025230] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRBR took 0.9s. Estimated remaining: 14m 5s. Rate: 144.9 symbols/min [2025-09-28T02:04:47.299985] [DEBUG] [LOCAL ] BRCC: Loaded 40896 existing records from primary storage. [2025-09-28T02:04:47.194950] [DEBUG] [LOCAL ] BRC: Loaded 19567 existing records from primary storage. [2025-09-28T02:04:47.333622] [INFO ] [MAIN ] BRCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:47.333941] [INFO ] [MAIN ] BRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:47.346602] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:47.339781] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRCC took 0.8s. Estimated remaining: 14m 4s. Rate: 145.0 symbols/min [2025-09-28T02:04:47.399298] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRC took 0.9s. Estimated remaining: 14m 2s. Rate: 145.4 symbols/min [2025-09-28T02:04:47.434518] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:47.802351] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:47.855298] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:47.838685] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-28T02:04:47.872221] [DEBUG] [LOCAL ] BRO: Loaded 52664 existing records from primary storage. [2025-09-28T02:04:47.872576] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-28T02:04:47.872851] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-28T02:04:47.873261] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-28T02:04:47.873370] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-28T02:04:47.873205] [INFO ] [MAIN ] BRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:47.873528] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRO took 0.9s. Estimated remaining: 14m 2s. Rate: 145.3 symbols/min [2025-09-28T02:04:47.873575] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-28T02:04:48.101765] [DEBUG] [LOCAL ] BROS: Loaded 54067 existing records from primary storage. [2025-09-28T02:04:48.153127] [INFO ] [MAIN ] BROS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:48.180744] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BROS took 1.1s. Estimated remaining: 14m 1s. Rate: 145.4 symbols/min [2025-09-28T02:04:48.288507] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:48.356185] [DEBUG] [LOCAL ] BRSP: Loaded 37442 existing records from primary storage. [2025-09-28T02:04:48.432436] [INFO ] [MAIN ] BRSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:48.481056] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSP took 1.0s. Estimated remaining: 13m 59s. Rate: 145.5 symbols/min [2025-09-28T02:04:48.544533] [DEBUG] [LOCAL ] BRT: Loaded 5034 existing records from primary storage. [2025-09-28T02:04:48.561968] [INFO ] [MAIN ] BRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:48.605990] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRT took 0.7s. Estimated remaining: 13m 57s. Rate: 145.8 symbols/min [2025-09-28T02:04:48.866595] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:48.886130] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:48.936894] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-28T02:04:49.032327] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:49.166199] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:49.168001] [DEBUG] [LOCAL ] BRW: Loaded 19862 existing records from primary storage. [2025-09-28T02:04:49.168718] [INFO ] [MAIN ] BRW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:49.169078] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRW took 0.9s. Estimated remaining: 13m 58s. Rate: 145.7 symbols/min [2025-09-28T02:04:49.197784] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:04:49.252363] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-28T02:04:49.269889] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:04:49.281172] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-09-28T02:04:49.312122] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:04:49.322264] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-28T02:04:49.322437] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-28T02:04:49.322592] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-28T02:04:49.338669] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-28T02:04:49.367102] [DEBUG] [LOCAL ] BRX: Loaded 52462 existing records from primary storage. [2025-09-28T02:04:49.419945] [INFO ] [MAIN ] BRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:49.419745] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:49.382282] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRSL took 2.0s. Estimated remaining: 13m 56s. Rate: 145.9 symbols/min [2025-09-28T02:04:49.432832] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BRX took 0.9s. Estimated remaining: 13m 54s. Rate: 146.2 symbols/min [2025-09-28T02:04:49.432529] [DEBUG] [LOCAL ] BSAC: Loaded 33389 existing records from primary storage. [2025-09-28T02:04:49.465357] [INFO ] [MAIN ] BSAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:49.527079] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSAC took 0.7s. Estimated remaining: 13m 51s. Rate: 146.6 symbols/min [2025-09-28T02:04:49.951712] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:49.999851] [DEBUG] [LOCAL ] BSL: No existing data file found in primary storage. [2025-09-28T02:04:50.006581] [WARN ] [MAIN ] BSL: No existing data found, performing full refresh instead. [2025-09-28T02:04:50.006415] [DEBUG] [LOCAL ] BSBR: Loaded 35731 existing records from primary storage. [2025-09-28T02:04:50.042032] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:50.053315] [INFO ] [MAIN ] BSBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:50.071772] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSBR took 0.9s. Estimated remaining: 13m 52s. Rate: 146.4 symbols/min [2025-09-28T02:04:50.053069] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-28T02:04:50.072169] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-28T02:04:50.088929] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:50.071872] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-09-28T02:04:50.094395] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-09-28T02:04:50.106866] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-28T02:04:50.113129] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-09-28T02:04:50.152200] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-28T02:04:50.157582] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-28T02:04:50.230847] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-09-28T02:04:50.241756] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-28T02:04:50.369416] [DEBUG] [LOCAL ] BST: Loaded 19385 existing records from primary storage. [2025-09-28T02:04:50.449044] [INFO ] [MAIN ] BST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:50.506082] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BST took 0.9s. Estimated remaining: 13m 51s. Rate: 146.4 symbols/min [2025-09-28T02:04:50.733945] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:50.759637] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-09-28T02:04:50.818064] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-09-28T02:04:51.009208] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-28T02:04:51.113839] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:51.189123] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-28T02:04:51.231408] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-09-28T02:04:51.193488] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:51.242221] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-28T02:04:51.247882] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-28T02:04:51.559032] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:51.620185] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-28T02:04:51.721126] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-28T02:04:51.734026] [INFO ] [MAIN ] BSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:51.739556] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSX took 1.2s. Estimated remaining: 13m 56s. Rate: 145.6 symbols/min [2025-09-28T02:04:51.873684] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:51.917297] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-28T02:04:52.023573] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:52.031513] [DEBUG] [LOCAL ] BTA: Loaded 5464 existing records from primary storage. [2025-09-28T02:04:52.031799] [INFO ] [MAIN ] BTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:52.031901] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BTA took 0.3s. Estimated remaining: 13m 55s. Rate: 145.7 symbols/min [2025-09-28T02:04:52.154772] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-28T02:04:52.184301] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-28T02:04:52.238852] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:52.256187] [DEBUG] [LOCAL ] BTCM: Loaded 15122 existing records from primary storage. [2025-09-28T02:04:52.256618] [INFO ] [MAIN ] BTCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:52.256796] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BTCM took 0.2s. Estimated remaining: 13m 53s. Rate: 145.9 symbols/min [2025-09-28T02:04:52.435173] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:52.489316] [DEBUG] [LOCAL ] BTE: Loaded 53505 existing records from primary storage. [2025-09-28T02:04:52.489843] [INFO ] [MAIN ] BTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:52.490528] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BTE took 0.2s. Estimated remaining: 13m 52s. Rate: 146.1 symbols/min [2025-09-28T02:04:52.677065] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:52.677273] [DEBUG] [LOCAL ] BTI: No existing data file found in primary storage. [2025-09-28T02:04:52.677345] [WARN ] [MAIN ] BTI: No existing data found, performing full refresh instead. [2025-09-28T02:04:52.677469] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-28T02:04:52.677575] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-28T02:04:52.677680] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-09-28T02:04:52.677829] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-28T02:04:53.026486] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-28T02:04:53.072911] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-28T02:04:53.131566] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:04:53.135066] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-28T02:04:53.134231] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-28T02:04:53.145057] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-28T02:04:53.202448] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-28T02:04:53.208580] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-28T02:04:53.657918] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-28T02:04:53.661546] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-28T02:04:54.060741] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-28T02:04:54.067139] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-28T02:04:54.205034] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-28T02:04:54.208297] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-28T02:04:54.465015] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-28T02:04:54.471531] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-28T02:04:54.939069] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-28T02:04:54.944425] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-28T02:04:55.001827] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-28T02:04:55.005155] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-28T02:04:55.145549] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-28T02:04:55.160030] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-28T02:04:55.743497] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-28T02:04:55.746138] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-28T02:04:55.917746] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-28T02:04:55.925041] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-28T02:04:56.137395] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-28T02:04:56.143960] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-28T02:04:56.434439] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-28T02:04:56.436802] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-28T02:04:57.089638] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-28T02:04:57.097373] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-28T02:04:57.165930] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-28T02:04:57.177758] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-28T02:04:57.221300] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-28T02:04:57.224534] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-28T02:04:57.358050] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-28T02:04:57.364950] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-28T02:04:57.822260] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-28T02:04:57.824362] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-28T02:04:58.180602] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-28T02:04:58.187396] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-28T02:04:58.487219] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-28T02:04:58.492705] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-28T02:04:58.675253] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-28T02:04:58.678130] [INFO ] [REMOTE ] BSL: Full fetch complete (12647 records). [2025-09-28T02:04:58.678264] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-28T02:04:59.103567] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-28T02:04:59.104117] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-28T02:04:59.104457] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-28T02:04:59.104767] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-28T02:04:59.105866] [DEBUG] [LOCAL ] BSL: Trimmed 12647 records to 8196 (keeping 200 days of data) [2025-09-28T02:04:59.139289] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-28T02:04:59.201279] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-28T02:04:59.249932] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-28T02:04:59.261807] [DEBUG] [LOCAL ] BSL: Primary data saved (8196 records). [2025-09-28T02:04:59.262153] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-28T02:04:59.262330] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BSL took 9.8s. Estimated remaining: 14m 29s. Rate: 139.8 symbols/min [2025-09-28T02:04:59.298887] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-28T02:04:59.454136] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:59.469285] [DEBUG] [LOCAL ] BTO: Loaded 8982 existing records from primary storage. [2025-09-28T02:04:59.469687] [INFO ] [MAIN ] BTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:59.469837] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTO took 0.2s. Estimated remaining: 14m 27s. Rate: 140.0 symbols/min [2025-09-28T02:04:59.656480] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:59.682044] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-28T02:04:59.694076] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-28T02:04:59.702742] [DEBUG] [LOCAL ] BTT: Loaded 16126 existing records from primary storage. [2025-09-28T02:04:59.703052] [INFO ] [MAIN ] BTT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:59.703160] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTT took 0.2s. Estimated remaining: 14m 25s. Rate: 140.2 symbols/min [2025-09-28T02:04:59.901108] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:04:59.983338] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-28T02:04:59.983861] [INFO ] [MAIN ] BTU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:04:59.985068] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTU took 0.3s. Estimated remaining: 14m 24s. Rate: 140.3 symbols/min [2025-09-28T02:05:00.176062] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:00.176299] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-28T02:05:00.176380] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-28T02:05:00.176516] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-28T02:05:00.176593] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-28T02:05:00.176707] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-28T02:05:00.176807] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-28T02:05:00.597275] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:05:00.621783] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-28T02:05:00.626788] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-28T02:05:00.635620] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-28T02:05:00.861526] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-28T02:05:00.868117] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-28T02:05:00.874106] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:05:00.874483] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-28T02:05:00.874578] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:05:00.874685] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-09-28T02:05:00.874780] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:05:00.874902] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-28T02:05:00.875011] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-28T02:05:00.875086] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-28T02:05:00.875192] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-28T02:05:00.875284] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTX took 0.9s. Estimated remaining: 14m 26s. Rate: 139.9 symbols/min [2025-09-28T02:05:01.071182] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:01.072156] [DEBUG] [LOCAL ] BTZ: No existing data file found in primary storage. [2025-09-28T02:05:01.072511] [WARN ] [MAIN ] BTZ: No existing data found, performing full refresh instead. [2025-09-28T02:05:01.072720] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-28T02:05:01.072803] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-28T02:05:01.072916] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-09-28T02:05:01.072998] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-28T02:05:01.481876] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:05:01.518455] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-28T02:05:01.524998] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-28T02:05:01.538268] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-28T02:05:02.215832] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-28T02:05:02.222371] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-28T02:05:02.247973] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-28T02:05:02.256887] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-28T02:05:02.573275] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-28T02:05:03.055724] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-28T02:05:03.500182] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-28T02:05:03.506086] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36629 records). [2025-09-28T02:05:03.506306] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-28T02:05:03.891402] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-28T02:05:03.992919] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-28T02:05:04.007561] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-28T02:05:04.007879] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-28T02:05:04.008525] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-28T02:05:04.016475] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-28T02:05:04.032089] [DEBUG] [LOCAL ] BSTZ: Trimmed 36629 records to 25188 (keeping 200 days of data) [2025-09-28T02:05:04.033383] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-28T02:05:04.220282] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25188 records). [2025-09-28T02:05:04.220473] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-28T02:05:04.220618] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BSTZ took 14.1s. Estimated remaining: 14m 43s. Rate: 137.3 symbols/min [2025-09-28T02:05:04.440044] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:04.442038] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-28T02:05:04.515606] [DEBUG] [LOCAL ] BUD: Loaded 53504 existing records from primary storage. [2025-09-28T02:05:04.516104] [INFO ] [MAIN ] BUD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:04.516237] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BUD took 0.3s. Estimated remaining: 14m 41s. Rate: 137.4 symbols/min [2025-09-28T02:05:04.667549] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-28T02:05:04.703374] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:04.717207] [DEBUG] [LOCAL ] BUI: Loaded 11615 existing records from primary storage. [2025-09-28T02:05:04.717619] [INFO ] [MAIN ] BUI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:04.717761] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BUI took 0.2s. Estimated remaining: 14m 40s. Rate: 137.6 symbols/min [2025-09-28T02:05:04.901807] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:04.902045] [DEBUG] [LOCAL ] BUR: No existing data file found in primary storage. [2025-09-28T02:05:04.902125] [WARN ] [MAIN ] BUR: No existing data found, performing full refresh instead. [2025-09-28T02:05:04.902253] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-28T02:05:04.902373] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-28T02:05:04.902471] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-28T02:05:04.902544] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-28T02:05:05.296091] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:05:05.455737] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-28T02:05:05.819228] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-28T02:05:06.255729] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-28T02:05:06.344177] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-28T02:05:06.733320] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-28T02:05:07.055720] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-28T02:05:07.525405] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-28T02:05:07.855735] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-28T02:05:08.655695] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-28T02:05:08.735272] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-28T02:05:09.234741] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-28T02:05:09.455734] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-28T02:05:10.255734] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-28T02:05:10.619000] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-28T02:05:10.755253] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-28T02:05:11.055720] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-28T02:05:11.228935] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-28T02:05:11.855753] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-28T02:05:12.044241] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-28T02:05:12.655716] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-28T02:05:13.240331] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-28T02:05:13.248593] [INFO ] [REMOTE ] BSM: Full fetch complete (47543 records). [2025-09-28T02:05:13.248844] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-28T02:05:13.460881] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-28T02:05:13.662299] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-28T02:05:13.662433] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-28T02:05:13.663088] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-28T02:05:13.663183] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-28T02:05:13.664521] [DEBUG] [LOCAL ] BSM: Trimmed 47543 records to 32809 (keeping 200 days of data) [2025-09-28T02:05:13.886010] [DEBUG] [LOCAL ] BSM: Primary data saved (32809 records). [2025-09-28T02:05:13.886206] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-28T02:05:13.886399] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BSM took 24.4s. Estimated remaining: 15m 29s. Rate: 130.3 symbols/min [2025-09-28T02:05:14.086351] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:14.136577] [DEBUG] [LOCAL ] BURL: Loaded 46896 existing records from primary storage. [2025-09-28T02:05:14.137095] [INFO ] [MAIN ] BURL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:14.137804] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BURL took 0.3s. Estimated remaining: 15m 27s. Rate: 130.4 symbols/min [2025-09-28T02:05:14.259753] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-28T02:05:14.338182] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:14.372321] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-28T02:05:14.399601] [DEBUG] [LOCAL ] BUXX: Loaded 15364 existing records from primary storage. [2025-09-28T02:05:14.399923] [INFO ] [MAIN ] BUXX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:14.400028] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUXX took 0.3s. Estimated remaining: 15m 25s. Rate: 130.6 symbols/min [2025-09-28T02:05:15.055738] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-28T02:05:15.471624] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-28T02:05:15.510109] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-28T02:05:15.855740] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-28T02:05:16.448624] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-28T02:05:16.655743] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-28T02:05:17.455766] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-28T02:05:17.892327] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-28T02:05:17.968729] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-28T02:05:18.239136] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-28T02:05:18.255685] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-28T02:05:19.051459] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-28T02:05:19.058633] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-28T02:05:19.060901] [INFO ] [REMOTE ] BTZ: Full fetch complete (33707 records). [2025-09-28T02:05:19.061108] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-28T02:05:19.659911] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-28T02:05:19.660151] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-28T02:05:19.660885] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-28T02:05:19.661017] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-28T02:05:19.662790] [DEBUG] [LOCAL ] BTZ: Trimmed 33707 records to 23002 (keeping 200 days of data) [2025-09-28T02:05:19.848890] [DEBUG] [LOCAL ] BTZ: Primary data saved (23002 records). [2025-09-28T02:05:19.849133] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-28T02:05:19.849293] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BTZ took 19.0s. Estimated remaining: 15m 53s. Rate: 126.7 symbols/min [2025-09-28T02:05:19.855792] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-28T02:05:20.673599] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-28T02:05:20.684203] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-28T02:05:21.854170] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-28T02:05:21.864948] [INFO ] [REMOTE ] BTI: Full fetch complete (77429 records). [2025-09-28T02:05:21.865130] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-28T02:05:22.303010] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-28T02:05:22.303329] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-28T02:05:22.304500] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-28T02:05:22.304625] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-28T02:05:22.306617] [DEBUG] [LOCAL ] BTI: Trimmed 77429 records to 54335 (keeping 200 days of data) [2025-09-28T02:05:22.450479] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-28T02:05:22.463350] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-28T02:05:22.699784] [DEBUG] [LOCAL ] BTI: Primary data saved (54335 records). [2025-09-28T02:05:22.699973] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-28T02:05:22.700115] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BTI took 30.2s. Estimated remaining: 16m 6s. Rate: 125.0 symbols/min [2025-09-28T02:05:24.073576] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-28T02:05:24.084465] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-28T02:05:25.674200] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-28T02:05:25.683881] [INFO ] [REMOTE ] BUR: Full fetch complete (63384 records). [2025-09-28T02:05:25.684087] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-28T02:05:26.129001] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-28T02:05:26.129180] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-28T02:05:26.129893] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-28T02:05:26.129985] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-28T02:05:26.131582] [DEBUG] [LOCAL ] BUR: Trimmed 63384 records to 45700 (keeping 200 days of data) [2025-09-28T02:05:26.414627] [DEBUG] [LOCAL ] BUR: Primary data saved (45700 records). [2025-09-28T02:05:26.414877] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-28T02:05:26.415023] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BUR took 21.7s. Estimated remaining: 16m 23s. Rate: 122.7 symbols/min [2025-09-28T02:05:27.112529] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:27.182465] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:27.199055] [DEBUG] [LOCAL ] BWA: No existing data file found in primary storage. [2025-09-28T02:05:27.234025] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:27.262085] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:27.262752] [WARN ] [MAIN ] BWA: No existing data found, performing full refresh instead. [2025-09-28T02:05:27.263418] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-28T02:05:27.263523] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-28T02:05:27.263687] [DEBUG] [LOCAL ] BWA: No primary data file found to delete. [2025-09-28T02:05:27.263816] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-28T02:05:27.625104] [DEBUG] [LOCAL ] BV: Loaded 39048 existing records from primary storage. [2025-09-28T02:05:27.658629] [DEBUG] [LOCAL ] BVN: Loaded 44520 existing records from primary storage. [2025-09-28T02:05:27.664468] [DEBUG] [LOCAL ] BW: Loaded 40297 existing records from primary storage. [2025-09-28T02:05:27.686078] [INFO ] [MAIN ] BVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:27.686637] [INFO ] [MAIN ] BW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:27.680391] [INFO ] [MAIN ] BV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:27.686477] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BVN took 1.3s. Estimated remaining: 16m 27s. Rate: 122.1 symbols/min [2025-09-28T02:05:27.709490] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BW took 1.3s. Estimated remaining: 16m 24s. Rate: 122.5 symbols/min [2025-09-28T02:05:27.807379] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BV took 1.3s. Estimated remaining: 16m 22s. Rate: 122.7 symbols/min [2025-09-28T02:05:28.001140] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:05:28.035917] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-28T02:05:28.262032] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:28.307511] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:28.404085] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:28.415530] [DEBUG] [LOCAL ] BWG: Loaded 12478 existing records from primary storage. [2025-09-28T02:05:28.416173] [INFO ] [MAIN ] BWG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:28.416294] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BWG took 0.7s. Estimated remaining: 16m 22s. Rate: 122.7 symbols/min [2025-09-28T02:05:28.528317] [DEBUG] [LOCAL ] BWMX: Loaded 7676 existing records from primary storage. [2025-09-28T02:05:28.543420] [INFO ] [MAIN ] BWMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:28.547933] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWMX took 0.6s. Estimated remaining: 16m 19s. Rate: 122.9 symbols/min [2025-09-28T02:05:28.743985] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:28.779626] [DEBUG] [LOCAL ] BWLP: Loaded 33185 existing records from primary storage. [2025-09-28T02:05:28.834792] [INFO ] [MAIN ] BWLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:28.842291] [DEBUG] [LOCAL ] BWNB: Loaded 4468 existing records from primary storage. [2025-09-28T02:05:28.839480] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:28.842582] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWLP took 1.0s. Estimated remaining: 16m 18s. Rate: 123.0 symbols/min [2025-09-28T02:05:28.843197] [INFO ] [MAIN ] BWNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:28.865346] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWNB took 0.4s. Estimated remaining: 16m 15s. Rate: 123.4 symbols/min [2025-09-28T02:05:28.988922] [DEBUG] [LOCAL ] BWSN: Loaded 5130 existing records from primary storage. [2025-09-28T02:05:29.019596] [INFO ] [MAIN ] BWSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:29.072699] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWSN took 0.5s. Estimated remaining: 16m 13s. Rate: 123.5 symbols/min [2025-09-28T02:05:29.184421] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:29.346428] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:29.429625] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:29.474948] [DEBUG] [LOCAL ] BXC: Loaded 13880 existing records from primary storage. [2025-09-28T02:05:29.475266] [INFO ] [MAIN ] BXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:29.475408] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BXC took 0.4s. Estimated remaining: 16m 12s. Rate: 123.6 symbols/min [2025-09-28T02:05:29.630493] [DEBUG] [LOCAL ] BWXT: Loaded 47442 existing records from primary storage. [2025-09-28T02:05:29.650164] [DEBUG] [LOCAL ] BX: Loaded 54270 existing records from primary storage. [2025-09-28T02:05:29.662432] [INFO ] [MAIN ] BX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:29.668062] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BX took 0.8s. Estimated remaining: 16m 10s. Rate: 123.8 symbols/min [2025-09-28T02:05:29.662751] [INFO ] [MAIN ] BWXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:29.689221] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BWXT took 0.8s. Estimated remaining: 16m 7s. Rate: 124.1 symbols/min [2025-09-28T02:05:29.784046] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:30.083210] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:30.156312] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:30.198088] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-28T02:05:30.227026] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-28T02:05:30.234622] [DEBUG] [LOCAL ] BXMT: Loaded 47994 existing records from primary storage. [2025-09-28T02:05:30.240362] [INFO ] [MAIN ] BXMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:30.240957] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BXMT took 0.8s. Estimated remaining: 16m 7s. Rate: 124.1 symbols/min [2025-09-28T02:05:30.313379] [DEBUG] [LOCAL ] BXMX: Loaded 19855 existing records from primary storage. [2025-09-28T02:05:30.342523] [INFO ] [MAIN ] BXMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:30.383977] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXMX took 0.7s. Estimated remaining: 16m 4s. Rate: 124.3 symbols/min [2025-09-28T02:05:30.602277] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:30.627366] [DEBUG] [LOCAL ] BXP: Loaded 50577 existing records from primary storage. [2025-09-28T02:05:30.628096] [INFO ] [MAIN ] BXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:30.634043] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXP took 0.9s. Estimated remaining: 16m 3s. Rate: 124.5 symbols/min [2025-09-28T02:05:30.749775] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:30.927809] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:30.939038] [DEBUG] [LOCAL ] BY: Loaded 21895 existing records from primary storage. [2025-09-28T02:05:30.939712] [INFO ] [MAIN ] BY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:30.939906] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BY took 0.5s. Estimated remaining: 16m 1s. Rate: 124.6 symbols/min [2025-09-28T02:05:30.979800] [DEBUG] [LOCAL ] BXSL: Loaded 48276 existing records from primary storage. [2025-09-28T02:05:31.006841] [INFO ] [MAIN ] BXSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:31.035992] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXSL took 0.8s. Estimated remaining: 15m 59s. Rate: 124.9 symbols/min [2025-09-28T02:05:31.309627] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:31.392192] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:31.393520] [DEBUG] [LOCAL ] BYD: Loaded 45804 existing records from primary storage. [2025-09-28T02:05:31.394582] [INFO ] [MAIN ] BYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:31.395308] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BYD took 0.7s. Estimated remaining: 15m 58s. Rate: 124.9 symbols/min [2025-09-28T02:05:31.523278] [DEBUG] [LOCAL ] BYM: Loaded 12225 existing records from primary storage. [2025-09-28T02:05:31.548626] [INFO ] [MAIN ] BYM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:31.614187] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:31.576992] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BYM took 0.6s. Estimated remaining: 15m 55s. Rate: 125.2 symbols/min [2025-09-28T02:05:31.650107] [DEBUG] [LOCAL ] BZH: Loaded 33088 existing records from primary storage. [2025-09-28T02:05:31.696836] [INFO ] [MAIN ] BZH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:31.742701] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BZH took 0.7s. Estimated remaining: 15m 53s. Rate: 125.4 symbols/min [2025-09-28T02:05:31.866040] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:32.080281] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-28T02:05:32.080909] [DEBUG] [LOCAL ] CAAP: Loaded 20021 existing records from primary storage. [2025-09-28T02:05:32.077449] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:32.081861] [INFO ] [MAIN ] C: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:32.082814] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. C took 0.7s. Estimated remaining: 15m 52s. Rate: 125.5 symbols/min [2025-09-28T02:05:32.083001] [INFO ] [MAIN ] CAAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:32.095507] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. CAAP took 0.5s. Estimated remaining: 15m 49s. Rate: 125.8 symbols/min [2025-09-28T02:05:32.310958] [DEBUG] [LOCAL ] CABO: Loaded 17549 existing records from primary storage. [2025-09-28T02:05:32.325316] [INFO ] [MAIN ] CABO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:32.325828] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CABO took 0.6s. Estimated remaining: 15m 47s. Rate: 126.0 symbols/min [2025-09-28T02:05:32.565479] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:32.546737] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:32.468689] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-28T02:05:32.602411] [DEBUG] [LOCAL ] CADE: No existing data file found in primary storage. [2025-09-28T02:05:32.624846] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-28T02:05:32.624214] [WARN ] [MAIN ] CADE: No existing data found, performing full refresh instead. [2025-09-28T02:05:32.632129] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-28T02:05:32.649110] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-28T02:05:32.655199] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-28T02:05:32.660626] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-28T02:05:32.757684] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:32.876558] [DEBUG] [LOCAL ] CACI: Loaded 25384 existing records from primary storage. [2025-09-28T02:05:32.900204] [INFO ] [MAIN ] CACI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:32.952707] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. CACI took 0.9s. Estimated remaining: 15m 48s. Rate: 125.9 symbols/min [2025-09-28T02:05:33.113258] [DEBUG] [LOCAL ] CAE: Loaded 39622 existing records from primary storage. [2025-09-28T02:05:33.233267] [INFO ] [MAIN ] CAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:33.248991] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CAE took 0.9s. Estimated remaining: 15m 46s. Rate: 126.0 symbols/min [2025-09-28T02:05:33.402725] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:05:33.470841] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-28T02:05:33.450550] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:33.581088] [DEBUG] [LOCAL ] CAF: Loaded 3471 existing records from primary storage. [2025-09-28T02:05:33.602833] [INFO ] [MAIN ] CAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:33.602370] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:33.603100] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 0.6s. Estimated remaining: 15m 45s. Rate: 126.1 symbols/min [2025-09-28T02:05:33.804511] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:33.853165] [DEBUG] [LOCAL ] CAG: Loaded 54439 existing records from primary storage. [2025-09-28T02:05:33.853714] [INFO ] [MAIN ] CAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:33.854201] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CAG took 0.6s. Estimated remaining: 15m 44s. Rate: 126.2 symbols/min [2025-09-28T02:05:34.095391] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:34.097277] [DEBUG] [LOCAL ] CAH: Loaded 52209 existing records from primary storage. [2025-09-28T02:05:34.098538] [INFO ] [MAIN ] CAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:34.099150] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAH took 0.5s. Estimated remaining: 15m 42s. Rate: 126.4 symbols/min [2025-09-28T02:05:34.293795] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:34.353362] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-28T02:05:34.355852] [DEBUG] [LOCAL ] CAL: Loaded 43833 existing records from primary storage. [2025-09-28T02:05:34.367190] [INFO ] [MAIN ] CAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:34.367688] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAL took 0.5s. Estimated remaining: 15m 40s. Rate: 126.5 symbols/min [2025-09-28T02:05:34.373565] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-28T02:05:34.530666] [DEBUG] [LOCAL ] CALX: Loaded 38931 existing records from primary storage. [2025-09-28T02:05:34.561256] [INFO ] [MAIN ] CALX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:34.579160] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CALX took 0.5s. Estimated remaining: 15m 39s. Rate: 126.7 symbols/min [2025-09-28T02:05:34.607954] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:34.814781] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:34.827773] [DEBUG] [LOCAL ] CANG: Loaded 27132 existing records from primary storage. [2025-09-28T02:05:34.830038] [INFO ] [MAIN ] CANG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:34.830317] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CANG took 0.5s. Estimated remaining: 15m 37s. Rate: 126.8 symbols/min [2025-09-28T02:05:34.895801] [DEBUG] [LOCAL ] CAPL: Loaded 5930 existing records from primary storage. [2025-09-28T02:05:34.914419] [INFO ] [MAIN ] CAPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:34.923215] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CAPL took 0.3s. Estimated remaining: 15m 35s. Rate: 127.1 symbols/min [2025-09-28T02:05:34.926195] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-28T02:05:35.002857] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-28T02:05:35.264333] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:35.272492] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:35.356092] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-09-28T02:05:35.357039] [DEBUG] [LOCAL ] CARS: Loaded 40616 existing records from primary storage. [2025-09-28T02:05:35.357252] [INFO ] [MAIN ] CARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:35.357766] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CARR took 0.5s. Estimated remaining: 15m 34s. Rate: 127.1 symbols/min [2025-09-28T02:05:35.363370] [INFO ] [MAIN ] CARS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:35.364471] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CARS took 0.4s. Estimated remaining: 15m 31s. Rate: 127.5 symbols/min [2025-09-28T02:05:35.717860] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:35.755403] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:35.778867] [DEBUG] [LOCAL ] CATO: Loaded 7286 existing records from primary storage. [2025-09-28T02:05:35.779608] [INFO ] [MAIN ] CATO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:35.779826] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CATO took 0.4s. Estimated remaining: 15m 30s. Rate: 127.5 symbols/min [2025-09-28T02:05:35.986912] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:36.006050] [DEBUG] [LOCAL ] CAT: Loaded 53693 existing records from primary storage. [2025-09-28T02:05:36.006523] [INFO ] [MAIN ] CAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:36.006673] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CAT took 0.6s. Estimated remaining: 15m 29s. Rate: 127.7 symbols/min [2025-09-28T02:05:36.212451] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:36.235548] [DEBUG] [LOCAL ] CAVA: Loaded 54330 existing records from primary storage. [2025-09-28T02:05:36.236461] [INFO ] [MAIN ] CAVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:36.237430] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CAVA took 0.5s. Estimated remaining: 15m 27s. Rate: 127.8 symbols/min [2025-09-28T02:05:36.403727] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-28T02:05:36.473809] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-28T02:05:36.513921] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:36.515422] [DEBUG] [LOCAL ] CB: Loaded 50773 existing records from primary storage. [2025-09-28T02:05:36.515928] [INFO ] [MAIN ] CB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:36.517872] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CB took 0.5s. Estimated remaining: 15m 26s. Rate: 128.0 symbols/min [2025-09-28T02:05:36.547454] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-28T02:05:36.559984] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-28T02:05:36.566676] [DEBUG] [LOCAL ] CBAN: Loaded 11141 existing records from primary storage. [2025-09-28T02:05:36.567050] [INFO ] [MAIN ] CBAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:36.567179] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CBAN took 0.3s. Estimated remaining: 15m 23s. Rate: 128.2 symbols/min [2025-09-28T02:05:38.167583] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-28T02:05:38.177345] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-28T02:05:38.344769] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-28T02:05:38.356115] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-28T02:05:39.581675] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-28T02:05:39.592934] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-28T02:05:40.082512] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-28T02:05:40.094293] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-28T02:05:41.488229] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-28T02:05:41.500577] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-28T02:05:41.861704] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-28T02:05:41.873267] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-28T02:05:43.191362] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-28T02:05:43.202096] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-28T02:05:43.657263] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-28T02:05:43.670008] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-28T02:05:45.497290] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-28T02:05:45.514372] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-28T02:05:45.515120] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-28T02:05:45.527486] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-28T02:05:47.251755] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-28T02:05:47.264903] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-28T02:05:47.295405] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-28T02:05:47.306696] [INFO ] [REMOTE ] BWA: Full fetch complete (75714 records). [2025-09-28T02:05:47.307015] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-28T02:05:47.730434] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-28T02:05:47.730565] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-28T02:05:47.731380] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-28T02:05:47.731476] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-28T02:05:47.733251] [DEBUG] [LOCAL ] BWA: Trimmed 75714 records to 52976 (keeping 200 days of data) [2025-09-28T02:05:48.062494] [DEBUG] [LOCAL ] BWA: Primary data saved (52976 records). [2025-09-28T02:05:48.063208] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-28T02:05:48.063455] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. BWA took 21.6s. Estimated remaining: 16m 17s. Rate: 121.1 symbols/min [2025-09-28T02:05:49.142246] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-28T02:05:49.153619] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-28T02:05:50.856159] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-28T02:05:50.866423] [INFO ] [REMOTE ] CADE: Full fetch complete (69750 records). [2025-09-28T02:05:50.866598] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-28T02:05:51.292740] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-28T02:05:51.292871] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-28T02:05:51.293683] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-28T02:05:51.293777] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-28T02:05:51.295540] [DEBUG] [LOCAL ] CADE: Trimmed 69750 records to 49496 (keeping 200 days of data) [2025-09-28T02:05:51.609015] [DEBUG] [LOCAL ] CADE: Primary data saved (49496 records). [2025-09-28T02:05:51.609265] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-28T02:05:51.609397] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CADE took 19.5s. Estimated remaining: 16m 32s. Rate: 119.3 symbols/min [2025-09-28T02:05:52.295160] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:52.368524] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:52.369464] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:52.394825] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-28T02:05:52.417693] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:52.416524] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-28T02:05:52.418756] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-28T02:05:52.418840] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-28T02:05:52.418903] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-28T02:05:52.418949] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-28T02:05:52.481323] [DEBUG] [LOCAL ] CBNA: Loaded 2923 existing records from primary storage. [2025-09-28T02:05:52.490846] [INFO ] [MAIN ] CBNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:52.491168] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBNA took 0.9s. Estimated remaining: 16m 33s. Rate: 119.0 symbols/min [2025-09-28T02:05:52.622377] [DEBUG] [LOCAL ] CBL: Loaded 16862 existing records from primary storage. [2025-09-28T02:05:52.688806] [INFO ] [MAIN ] CBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:52.762361] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBL took 1.2s. Estimated remaining: 16m 31s. Rate: 119.2 symbols/min [2025-09-28T02:05:52.894165] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:52.936514] [DEBUG] [LOCAL ] CBRE: Loaded 51366 existing records from primary storage. [2025-09-28T02:05:52.993605] [INFO ] [MAIN ] CBRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:53.072399] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBRE took 1.5s. Estimated remaining: 16m 30s. Rate: 119.3 symbols/min [2025-09-28T02:05:53.404553] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:53.423208] [DEBUG] [LOCAL ] CBT: Loaded 31567 existing records from primary storage. [2025-09-28T02:05:53.421587] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:05:53.429430] [INFO ] [MAIN ] CBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:53.450277] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBT took 0.9s. Estimated remaining: 16m 29s. Rate: 119.4 symbols/min [2025-09-28T02:05:53.438087] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-28T02:05:53.529298] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:53.557105] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-28T02:05:53.588565] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-28T02:05:53.635173] [DEBUG] [LOCAL ] CBU: Loaded 23130 existing records from primary storage. [2025-09-28T02:05:53.656045] [INFO ] [MAIN ] CBU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:53.656231] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-28T02:05:53.656536] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBU took 0.8s. Estimated remaining: 16m 27s. Rate: 119.5 symbols/min [2025-09-28T02:05:53.656710] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-28T02:05:53.692831] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-28T02:05:53.709216] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-28T02:05:53.819350] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:05:53.938627] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:53.938779] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-28T02:05:53.990372] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:05:54.034128] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-09-28T02:05:54.067792] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:05:54.151722] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-28T02:05:54.227194] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-28T02:05:54.227035] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:54.293717] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-28T02:05:54.299471] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-28T02:05:54.299595] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBO took 2.7s. Estimated remaining: 16m 27s. Rate: 119.4 symbols/min [2025-09-28T02:05:54.451529] [DEBUG] [LOCAL ] CBZ: Loaded 34130 existing records from primary storage. [2025-09-28T02:05:54.526358] [INFO ] [MAIN ] CBZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:54.598071] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBZ took 1.1s. Estimated remaining: 16m 26s. Rate: 119.6 symbols/min [2025-09-28T02:05:54.597713] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:05:54.683463] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-28T02:05:54.786142] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:54.884628] [DEBUG] [LOCAL ] CC: Loaded 53801 existing records from primary storage. [2025-09-28T02:05:54.910700] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:54.911363] [INFO ] [MAIN ] CC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:54.911519] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-28T02:05:54.911925] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CC took 1.3s. Estimated remaining: 16m 24s. Rate: 119.7 symbols/min [2025-09-28T02:05:54.911842] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-28T02:05:54.936875] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-28T02:05:54.937142] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-28T02:05:54.947818] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-28T02:05:54.960616] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-28T02:05:55.077692] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:05:55.120833] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-28T02:05:55.147148] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:05:55.214342] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-09-28T02:05:55.247439] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:55.257920] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:05:55.314014] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-28T02:05:55.321151] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-28T02:05:55.321252] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-28T02:05:55.332894] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-28T02:05:55.333138] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CBX took 2.2s. Estimated remaining: 16m 23s. Rate: 119.7 symbols/min [2025-09-28T02:05:55.334837] [DEBUG] [LOCAL ] CCI: Loaded 53922 existing records from primary storage. [2025-09-28T02:05:55.379503] [INFO ] [MAIN ] CCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:55.433050] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CCI took 1.1s. Estimated remaining: 16m 21s. Rate: 120.0 symbols/min [2025-09-28T02:05:55.500472] [DEBUG] [LOCAL ] CCIF: Loaded 15698 existing records from primary storage. [2025-09-28T02:05:55.559448] [INFO ] [MAIN ] CCIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:55.666805] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCIF took 0.8s. Estimated remaining: 16m 19s. Rate: 120.1 symbols/min [2025-09-28T02:05:56.035030] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:56.095748] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:05:56.091621] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:56.103377] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-28T02:05:56.189685] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:56.276691] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-09-28T02:05:56.279049] [DEBUG] [LOCAL ] CCK: Loaded 47083 existing records from primary storage. [2025-09-28T02:05:56.278410] [INFO ] [MAIN ] CCJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:56.279333] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCJ took 0.9s. Estimated remaining: 16m 19s. Rate: 120.0 symbols/min [2025-09-28T02:05:56.279427] [INFO ] [MAIN ] CCK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:56.280068] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCK took 0.8s. Estimated remaining: 16m 16s. Rate: 120.3 symbols/min [2025-09-28T02:05:56.492759] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-28T02:05:56.543240] [INFO ] [MAIN ] CCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:56.586099] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCL took 0.9s. Estimated remaining: 16m 15s. Rate: 120.4 symbols/min [2025-09-28T02:05:56.543677] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-28T02:05:56.623385] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:56.629690] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-28T02:05:56.723420] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:56.729983] [DEBUG] [LOCAL ] CCRD: No existing data file found in primary storage. [2025-09-28T02:05:56.773501] [WARN ] [MAIN ] CCRD: No existing data found, performing full refresh instead. [2025-09-28T02:05:56.807507] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-28T02:05:56.812675] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-28T02:05:56.823487] [DEBUG] [LOCAL ] CCRD: No primary data file found to delete. [2025-09-28T02:05:56.857182] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-28T02:05:56.900685] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:57.064971] [DEBUG] [LOCAL ] CCO: Loaded 48387 existing records from primary storage. [2025-09-28T02:05:57.117725] [INFO ] [MAIN ] CCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:57.186614] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCO took 0.9s. Estimated remaining: 16m 15s. Rate: 120.4 symbols/min [2025-09-28T02:05:57.225472] [DEBUG] [LOCAL ] CCS: Loaded 31155 existing records from primary storage. [2025-09-28T02:05:57.270674] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-28T02:05:57.265290] [INFO ] [MAIN ] CCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:57.319407] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-28T02:05:57.338133] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCS took 0.7s. Estimated remaining: 16m 13s. Rate: 120.6 symbols/min [2025-09-28T02:05:57.550052] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:05:57.601043] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-28T02:05:57.777697] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:57.781075] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:57.781571] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-28T02:05:57.781897] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-28T02:05:57.782154] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-28T02:05:57.782229] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-28T02:05:57.782313] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-28T02:05:57.782422] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-28T02:05:57.845695] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-28T02:05:57.877093] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-28T02:05:58.094412] [DEBUG] [LOCAL ] CCU: Loaded 23800 existing records from primary storage. [2025-09-28T02:05:58.123534] [INFO ] [MAIN ] CCU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:58.124102] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCU took 0.9s. Estimated remaining: 16m 14s. Rate: 120.4 symbols/min [2025-09-28T02:05:58.349799] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:05:58.369277] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-28T02:05:58.385622] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-28T02:05:58.413343] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-28T02:05:58.442343] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:58.469906] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-28T02:05:58.474282] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-28T02:05:58.512805] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-28T02:05:58.513213] [INFO ] [MAIN ] CDE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:58.513319] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CDE took 0.4s. Estimated remaining: 16m 13s. Rate: 120.5 symbols/min [2025-09-28T02:05:58.696460] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:58.709071] [DEBUG] [LOCAL ] CDLR: Loaded 9966 existing records from primary storage. [2025-09-28T02:05:58.709356] [INFO ] [MAIN ] CDLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:58.709477] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CDLR took 0.2s. Estimated remaining: 16m 11s. Rate: 120.7 symbols/min [2025-09-28T02:05:58.788463] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-28T02:05:58.822178] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-28T02:05:58.904942] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:58.905771] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-28T02:05:58.907496] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-28T02:05:58.951352] [DEBUG] [LOCAL ] CDP: Loaded 43357 existing records from primary storage. [2025-09-28T02:05:58.951816] [INFO ] [MAIN ] CDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:58.952746] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CDP took 0.2s. Estimated remaining: 16m 9s. Rate: 120.8 symbols/min [2025-09-28T02:05:59.088845] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-28T02:05:59.107193] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-28T02:05:59.162983] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:59.191918] [DEBUG] [LOCAL ] CDRE: Loaded 25747 existing records from primary storage. [2025-09-28T02:05:59.192250] [INFO ] [MAIN ] CDRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:59.192355] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDRE took 0.2s. Estimated remaining: 16m 7s. Rate: 121.0 symbols/min [2025-09-28T02:05:59.308053] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-28T02:05:59.325196] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-28T02:05:59.400614] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:59.405431] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-28T02:05:59.407843] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-28T02:05:59.458402] [DEBUG] [LOCAL ] CE: Loaded 52316 existing records from primary storage. [2025-09-28T02:05:59.458869] [INFO ] [MAIN ] CE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:59.458977] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CE took 0.3s. Estimated remaining: 16m 6s. Rate: 121.1 symbols/min [2025-09-28T02:05:59.642728] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:59.644865] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-28T02:05:59.646162] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-28T02:05:59.657018] [DEBUG] [LOCAL ] CEE: Loaded 6697 existing records from primary storage. [2025-09-28T02:05:59.657321] [INFO ] [MAIN ] CEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:59.657425] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CEE took 0.2s. Estimated remaining: 16m 4s. Rate: 121.3 symbols/min [2025-09-28T02:05:59.733323] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-28T02:05:59.761615] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-28T02:05:59.850848] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-28T02:05:59.859030] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-28T02:05:59.888703] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:05:59.898842] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-28T02:05:59.900771] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-28T02:05:59.925255] [DEBUG] [LOCAL ] CEPU: Loaded 26454 existing records from primary storage. [2025-09-28T02:05:59.925604] [INFO ] [MAIN ] CEPU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:05:59.925743] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CEPU took 0.3s. Estimated remaining: 16m 2s. Rate: 121.4 symbols/min [2025-09-28T02:06:00.108981] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:00.121518] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-28T02:06:00.124204] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-28T02:06:00.166332] [DEBUG] [LOCAL ] CF: Loaded 52983 existing records from primary storage. [2025-09-28T02:06:00.166800] [INFO ] [MAIN ] CF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:00.167448] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CF took 0.2s. Estimated remaining: 16m 1s. Rate: 121.5 symbols/min [2025-09-28T02:06:00.277916] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-28T02:06:00.290099] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-28T02:06:00.362167] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:00.366333] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-28T02:06:00.368506] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-28T02:06:00.421119] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-28T02:06:00.421558] [INFO ] [MAIN ] CFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:00.421688] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CFG took 0.3s. Estimated remaining: 15m 59s. Rate: 121.7 symbols/min [2025-09-28T02:06:00.557240] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-28T02:06:00.585165] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-28T02:06:00.613386] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:00.613588] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-28T02:06:00.613700] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-28T02:06:00.613831] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-28T02:06:00.613904] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-28T02:06:00.613984] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-28T02:06:00.614054] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-28T02:06:00.889904] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-28T02:06:00.915675] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-28T02:06:01.005066] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:01.005472] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-28T02:06:01.135506] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-28T02:06:01.137581] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-28T02:06:01.260314] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:06:01.260705] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-28T02:06:01.260823] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:06:01.260933] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-09-28T02:06:01.261035] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:06:01.261145] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-28T02:06:01.261295] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-28T02:06:01.261397] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-28T02:06:01.261559] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-28T02:06:01.261700] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CFND took 0.8s. Estimated remaining: 16m 0s. Rate: 121.5 symbols/min [2025-09-28T02:06:01.455668] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:01.497576] [DEBUG] [LOCAL ] CFR: Loaded 33971 existing records from primary storage. [2025-09-28T02:06:01.498080] [INFO ] [MAIN ] CFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:01.498612] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFR took 0.2s. Estimated remaining: 15m 59s. Rate: 121.6 symbols/min [2025-09-28T02:06:01.693862] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:01.738286] [DEBUG] [LOCAL ] CGAU: Loaded 43406 existing records from primary storage. [2025-09-28T02:06:01.738710] [INFO ] [MAIN ] CGAU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:01.739405] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CGAU took 0.2s. Estimated remaining: 15m 57s. Rate: 121.8 symbols/min [2025-09-28T02:06:01.902316] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-28T02:06:01.931639] [INFO ] [REMOTE ] CCIA: Full fetch complete (2044 records). [2025-09-28T02:06:01.930282] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:01.931888] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-28T02:06:01.931981] [DEBUG] [LOCAL ] CGV: No existing data file found in primary storage. [2025-09-28T02:06:01.946412] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:06:01.990288] [WARN ] [MAIN ] CGV: No existing data found, performing full refresh instead. [2025-09-28T02:06:02.000289] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-28T02:06:02.029011] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:06:02.029173] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-28T02:06:02.042592] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-09-28T02:06:02.042743] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-28T02:06:02.042897] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:06:02.055532] [DEBUG] [LOCAL ] CGV: No primary data file found to delete. [2025-09-28T02:06:02.055772] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-28T02:06:02.055869] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-28T02:06:02.094335] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-28T02:06:02.185531] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-28T02:06:02.225830] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:06:02.252739] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:06:02.278954] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-28T02:06:02.279242] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:06:02.279625] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CCZ took 4.9s. Estimated remaining: 15m 57s. Rate: 121.7 symbols/min [2025-09-28T02:06:02.285386] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-28T02:06:02.312697] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-28T02:06:02.340713] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-28T02:06:02.464208] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-28T02:06:02.496585] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CCIA took 7.9s. Estimated remaining: 15m 55s. Rate: 121.9 symbols/min [2025-09-28T02:06:02.561744] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-28T02:06:02.760914] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-28T02:06:02.821763] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:02.971574] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:02.999530] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-28T02:06:03.067032] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:03.078621] [DEBUG] [LOCAL ] CHCT: Loaded 24309 existing records from primary storage. [2025-09-28T02:06:03.079076] [INFO ] [MAIN ] CHCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:03.079308] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CHCT took 0.8s. Estimated remaining: 15m 55s. Rate: 121.8 symbols/min [2025-09-28T02:06:03.264564] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:03.300902] [DEBUG] [LOCAL ] CHD: Loaded 52767 existing records from primary storage. [2025-09-28T02:06:03.301450] [INFO ] [MAIN ] CHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:03.301590] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CHD took 0.8s. Estimated remaining: 15m 53s. Rate: 122.0 symbols/min [2025-09-28T02:06:03.430261] [DEBUG] [LOCAL ] CHE: Loaded 14983 existing records from primary storage. [2025-09-28T02:06:03.467047] [INFO ] [MAIN ] CHE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:03.509771] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CHE took 0.4s. Estimated remaining: 15m 51s. Rate: 122.2 symbols/min [2025-09-28T02:06:03.509494] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:03.547517] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-28T02:06:03.574717] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-28T02:06:03.710538] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:03.745487] [DEBUG] [LOCAL ] CHGG: Loaded 48434 existing records from primary storage. [2025-09-28T02:06:03.745918] [INFO ] [MAIN ] CHGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:03.746690] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHGG took 0.4s. Estimated remaining: 15m 50s. Rate: 122.3 symbols/min [2025-09-28T02:06:03.846303] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-28T02:06:03.882000] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-28T02:06:03.944211] [DEBUG] [LOCAL ] CHH: Loaded 32744 existing records from primary storage. [2025-09-28T02:06:03.973007] [INFO ] [MAIN ] CHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:03.974715] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:03.974994] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHH took 0.5s. Estimated remaining: 15m 48s. Rate: 122.5 symbols/min [2025-09-28T02:06:04.116921] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-28T02:06:04.172994] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:04.174350] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-28T02:06:04.177255] [DEBUG] [LOCAL ] CHMI: Loaded 22359 existing records from primary storage. [2025-09-28T02:06:04.178670] [INFO ] [MAIN ] CHMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:04.178792] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHMI took 0.4s. Estimated remaining: 15m 46s. Rate: 122.6 symbols/min [2025-09-28T02:06:04.185437] [DEBUG] [LOCAL ] CHN: Loaded 4900 existing records from primary storage. [2025-09-28T02:06:04.185731] [INFO ] [MAIN ] CHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:04.185833] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHN took 0.2s. Estimated remaining: 15m 44s. Rate: 122.9 symbols/min [2025-09-28T02:06:04.684926] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-28T02:06:04.686247] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-28T02:06:04.803359] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-28T02:06:04.806712] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-28T02:06:05.131876] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-28T02:06:05.455757] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-28T02:06:05.675952] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-28T02:06:05.839989] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-28T02:06:06.255731] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-28T02:06:07.031305] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-28T02:06:07.034124] [INFO ] [REMOTE ] CCRD: Full fetch complete (11849 records). [2025-09-28T02:06:07.034257] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-28T02:06:07.068617] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-28T02:06:07.447554] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-28T02:06:07.447726] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-28T02:06:07.448070] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-28T02:06:07.448174] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-28T02:06:07.449051] [DEBUG] [LOCAL ] CCRD: Trimmed 11849 records to 9100 (keeping 200 days of data) [2025-09-28T02:06:07.504382] [DEBUG] [LOCAL ] CCRD: Primary data saved (9100 records). [2025-09-28T02:06:07.504583] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-28T02:06:07.504737] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CCRD took 11.2s. Estimated remaining: 15m 56s. Rate: 121.3 symbols/min [2025-09-28T02:06:07.593278] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-28T02:06:07.855721] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-28T02:06:08.490104] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-28T02:06:08.655723] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-28T02:06:09.112296] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-28T02:06:09.455724] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-28T02:06:09.829589] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-28T02:06:10.255726] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-28T02:06:10.695876] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-28T02:06:10.696891] [INFO ] [REMOTE ] CGV: Full fetch complete (2298 records). [2025-09-28T02:06:10.696998] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-28T02:06:11.091995] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-28T02:06:11.092117] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-28T02:06:11.092260] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-28T02:06:11.092340] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-28T02:06:11.092790] [DEBUG] [LOCAL ] CGV: Trimmed 2298 records to 1431 (keeping 200 days of data) [2025-09-28T02:06:11.101951] [DEBUG] [LOCAL ] CGV: Primary data saved (1431 records). [2025-09-28T02:06:11.102039] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-28T02:06:11.102139] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CGV took 9.4s. Estimated remaining: 16m 9s. Rate: 119.6 symbols/min [2025-09-28T02:06:11.791096] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:11.844472] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:11.929433] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:11.974410] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:12.024265] [DEBUG] [LOCAL ] CHT: Loaded 19816 existing records from primary storage. [2025-09-28T02:06:12.024746] [INFO ] [MAIN ] CHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:12.024858] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 0.9s. Estimated remaining: 16m 10s. Rate: 119.4 symbols/min [2025-09-28T02:06:12.141192] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-09-28T02:06:12.148346] [INFO ] [MAIN ] CHWY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:12.204273] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHWY took 1.1s. Estimated remaining: 16m 8s. Rate: 119.5 symbols/min [2025-09-28T02:06:12.340233] [DEBUG] [LOCAL ] CHPT: Loaded 49765 existing records from primary storage. [2025-09-28T02:06:12.419936] [INFO ] [MAIN ] CHPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:12.419591] [DEBUG] [LOCAL ] CI: Loaded 50561 existing records from primary storage. [2025-09-28T02:06:12.447980] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHPT took 1.3s. Estimated remaining: 16m 7s. Rate: 119.7 symbols/min [2025-09-28T02:06:12.497879] [INFO ] [MAIN ] CI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:12.593065] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CI took 1.4s. Estimated remaining: 16m 5s. Rate: 119.9 symbols/min [2025-09-28T02:06:12.656788] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:12.880210] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:13.022080] [DEBUG] [LOCAL ] CIA: Loaded 17213 existing records from primary storage. [2025-09-28T02:06:13.060517] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:13.099000] [INFO ] [MAIN ] CIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:13.099259] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-28T02:06:13.132454] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-28T02:06:13.131833] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:13.132780] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-28T02:06:13.132141] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CIA took 1.1s. Estimated remaining: 16m 4s. Rate: 119.9 symbols/min [2025-09-28T02:06:13.132973] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-28T02:06:13.165806] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-28T02:06:13.171234] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-28T02:06:13.364790] [DEBUG] [LOCAL ] CIB: Loaded 31435 existing records from primary storage. [2025-09-28T02:06:13.429843] [INFO ] [MAIN ] CIB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:13.430807] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CIB took 1.2s. Estimated remaining: 16m 3s. Rate: 120.0 symbols/min [2025-09-28T02:06:13.641945] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:13.878717] [DEBUG] [LOCAL ] CIEN: Loaded 52854 existing records from primary storage. [2025-09-28T02:06:13.903368] [DEBUG] [LOCAL ] CIF: Loaded 4396 existing records from primary storage. [2025-09-28T02:06:13.928632] [INFO ] [MAIN ] CIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:13.955519] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIF took 0.8s. Estimated remaining: 16m 2s. Rate: 119.9 symbols/min [2025-09-28T02:06:13.934053] [INFO ] [MAIN ] CIEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:13.986985] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIEN took 1.3s. Estimated remaining: 15m 60s. Rate: 120.2 symbols/min [2025-09-28T02:06:14.089895] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:14.197227] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:14.281934] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-28T02:06:14.441166] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:14.545185] [DEBUG] [LOCAL ] CIG: Loaded 44447 existing records from primary storage. [2025-09-28T02:06:14.542985] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:14.546184] [INFO ] [MAIN ] CIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:14.546297] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIG took 1.1s. Estimated remaining: 15m 60s. Rate: 120.2 symbols/min [2025-09-28T02:06:14.681430] [DEBUG] [LOCAL ] CII: Loaded 15638 existing records from primary storage. [2025-09-28T02:06:14.687627] [INFO ] [MAIN ] CII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:14.688104] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CII took 0.7s. Estimated remaining: 15m 58s. Rate: 120.4 symbols/min [2025-09-28T02:06:14.813342] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:14.912224] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-09-28T02:06:14.923169] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-28T02:06:14.913736] [DEBUG] [LOCAL ] CIM: Loaded 37858 existing records from primary storage. [2025-09-28T02:06:14.925593] [INFO ] [MAIN ] CIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:14.925407] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-28T02:06:14.923716] [INFO ] [MAIN ] CIMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:14.925882] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIM took 0.8s. Estimated remaining: 15m 56s. Rate: 120.5 symbols/min [2025-09-28T02:06:14.943357] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMN took 0.4s. Estimated remaining: 15m 54s. Rate: 120.8 symbols/min [2025-09-28T02:06:15.246315] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:15.267880] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-28T02:06:15.389094] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:15.389180] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-28T02:06:15.404752] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-28T02:06:15.393932] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-28T02:06:15.415352] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-28T02:06:15.422918] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-28T02:06:15.423034] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-28T02:06:15.446342] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-28T02:06:15.422816] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-28T02:06:15.450078] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-28T02:06:15.450209] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-28T02:06:15.514969] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:15.531076] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-28T02:06:15.549873] [DEBUG] [LOCAL ] CINT: No existing data file found in primary storage. [2025-09-28T02:06:15.573765] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-28T02:06:15.581858] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-28T02:06:15.573850] [WARN ] [MAIN ] CINT: No existing data found, performing full refresh instead. [2025-09-28T02:06:15.607262] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-28T02:06:15.672923] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-28T02:06:15.750027] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-09-28T02:06:15.757556] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-28T02:06:15.998760] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-28T02:06:16.088987] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-28T02:06:16.453248] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:16.518238] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-28T02:06:16.638367] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-28T02:06:16.643285] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:16.644771] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-28T02:06:16.646149] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-28T02:06:16.741339] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:16.741783] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-28T02:06:17.079335] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:06:17.079725] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-28T02:06:17.079819] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:06:17.079912] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-09-28T02:06:17.080016] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:06:17.080134] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-28T02:06:17.080277] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-28T02:06:17.080370] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-28T02:06:17.080532] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-28T02:06:17.080628] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMP took 2.2s. Estimated remaining: 15m 60s. Rate: 119.9 symbols/min [2025-09-28T02:06:17.196444] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-28T02:06:17.275380] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:17.275661] [DEBUG] [LOCAL ] CIO: No existing data file found in primary storage. [2025-09-28T02:06:17.275739] [WARN ] [MAIN ] CIO: No existing data found, performing full refresh instead. [2025-09-28T02:06:17.275859] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-28T02:06:17.275933] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-28T02:06:17.276020] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-09-28T02:06:17.276091] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-28T02:06:17.464000] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-28T02:06:17.464071] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-28T02:06:17.694729] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:17.704480] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-28T02:06:17.942976] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-28T02:06:18.255724] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-28T02:06:19.055747] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-28T02:06:19.173702] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-28T02:06:19.855767] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-28T02:06:20.184129] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-28T02:06:20.655758] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-28T02:06:20.938913] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-28T02:06:21.455695] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-28T02:06:21.761879] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-28T02:06:22.255720] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-28T02:06:22.519222] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-28T02:06:22.598972] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-28T02:06:23.055728] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-28T02:06:23.855758] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-28T02:06:24.023289] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-28T02:06:24.325675] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-28T02:06:24.655790] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-28T02:06:25.082606] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-28T02:06:25.455787] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-28T02:06:26.255710] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-28T02:06:26.494926] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-28T02:06:27.055802] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-28T02:06:27.423205] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-28T02:06:27.522008] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-28T02:06:27.855783] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-28T02:06:28.655773] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-28T02:06:29.024811] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-28T02:06:29.455736] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-28T02:06:29.720478] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-28T02:06:29.795759] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-28T02:06:30.255738] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-28T02:06:30.618993] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-28T02:06:30.619985] [INFO ] [REMOTE ] CICB: Full fetch complete (2111 records). [2025-09-28T02:06:30.620104] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-28T02:06:30.810364] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:06:30.810597] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:06:30.810712] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:06:30.810811] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-28T02:06:30.810933] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-28T02:06:30.811027] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-28T02:06:30.811199] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-28T02:06:30.811323] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CICB took 18.3s. Estimated remaining: 16m 55s. Rate: 113.3 symbols/min [2025-09-28T02:06:30.991500] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:31.028756] [DEBUG] [LOCAL ] CION: Loaded 29661 existing records from primary storage. [2025-09-28T02:06:31.029114] [INFO ] [MAIN ] CION: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:31.029737] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CION took 0.2s. Estimated remaining: 16m 53s. Rate: 113.4 symbols/min [2025-09-28T02:06:31.061328] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-28T02:06:31.231574] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:31.297328] [DEBUG] [LOCAL ] CIVI: Loaded 53363 existing records from primary storage. [2025-09-28T02:06:31.297778] [INFO ] [MAIN ] CIVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:31.298580] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CIVI took 0.3s. Estimated remaining: 16m 52s. Rate: 113.6 symbols/min [2025-09-28T02:06:31.480255] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:31.538912] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-28T02:06:31.539319] [INFO ] [MAIN ] CL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:31.540111] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CL took 0.2s. Estimated remaining: 16m 50s. Rate: 113.7 symbols/min [2025-09-28T02:06:31.721436] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:31.766397] [DEBUG] [LOCAL ] CLB: Loaded 33475 existing records from primary storage. [2025-09-28T02:06:31.766836] [INFO ] [MAIN ] CLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:31.767626] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CLB took 0.2s. Estimated remaining: 16m 48s. Rate: 113.8 symbols/min [2025-09-28T02:06:31.860946] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-28T02:06:31.979440] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:32.000465] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-09-28T02:06:32.000910] [INFO ] [MAIN ] CLCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:32.001045] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CLCO took 0.2s. Estimated remaining: 16m 47s. Rate: 114.0 symbols/min [2025-09-28T02:06:32.192235] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-28T02:06:32.211530] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:32.248035] [DEBUG] [LOCAL ] CLDT: Loaded 26082 existing records from primary storage. [2025-09-28T02:06:32.248376] [INFO ] [MAIN ] CLDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:32.248482] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLDT took 0.2s. Estimated remaining: 16m 45s. Rate: 114.1 symbols/min [2025-09-28T02:06:32.407396] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-28T02:06:32.436783] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:32.499155] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-09-28T02:06:32.499632] [INFO ] [MAIN ] CLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:32.500560] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CLF took 0.3s. Estimated remaining: 16m 43s. Rate: 114.2 symbols/min [2025-09-28T02:06:32.665747] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-28T02:06:32.706075] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:32.706333] [DEBUG] [LOCAL ] CLH: No existing data file found in primary storage. [2025-09-28T02:06:32.706407] [WARN ] [MAIN ] CLH: No existing data found, performing full refresh instead. [2025-09-28T02:06:32.706535] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-28T02:06:32.706611] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-28T02:06:32.706717] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-09-28T02:06:32.706819] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-28T02:06:33.091737] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:33.455752] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-28T02:06:34.033265] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-28T02:06:34.255683] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-28T02:06:34.648051] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-28T02:06:34.823054] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-28T02:06:35.055756] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-28T02:06:35.855716] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-28T02:06:36.020779] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-28T02:06:36.655756] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-28T02:06:37.180237] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-28T02:06:37.455725] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-28T02:06:37.643210] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-28T02:06:38.255746] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-28T02:06:38.891503] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-28T02:06:39.055700] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-28T02:06:39.347600] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-28T02:06:39.353316] [INFO ] [REMOTE ] CINT: Full fetch complete (26212 records). [2025-09-28T02:06:39.353478] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-28T02:06:39.784764] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-28T02:06:39.784890] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-28T02:06:39.785340] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-28T02:06:39.785427] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-28T02:06:39.787003] [DEBUG] [LOCAL ] CINT: Trimmed 26212 records to 18868 (keeping 200 days of data) [2025-09-28T02:06:39.877146] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-28T02:06:39.911238] [DEBUG] [LOCAL ] CINT: Primary data saved (18868 records). [2025-09-28T02:06:39.911427] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-28T02:06:39.911557] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CINT took 24.9s. Estimated remaining: 17m 11s. Rate: 111.1 symbols/min [2025-09-28T02:06:40.107845] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:40.127315] [DEBUG] [LOCAL ] CLPR: Loaded 11615 existing records from primary storage. [2025-09-28T02:06:40.127628] [INFO ] [MAIN ] CLPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:40.127791] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLPR took 0.2s. Estimated remaining: 17m 9s. Rate: 111.2 symbols/min [2025-09-28T02:06:40.314610] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:40.376231] [DEBUG] [LOCAL ] CLS: Loaded 54412 existing records from primary storage. [2025-09-28T02:06:40.376612] [INFO ] [MAIN ] CLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:40.376762] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLS took 0.2s. Estimated remaining: 17m 8s. Rate: 111.4 symbols/min [2025-09-28T02:06:40.573816] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:40.595783] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-28T02:06:40.650290] [DEBUG] [LOCAL ] CLVT: Loaded 52713 existing records from primary storage. [2025-09-28T02:06:40.650706] [INFO ] [MAIN ] CLVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:40.650816] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLVT took 0.3s. Estimated remaining: 17m 6s. Rate: 111.5 symbols/min [2025-09-28T02:06:40.657346] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-28T02:06:40.838984] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:40.861815] [DEBUG] [LOCAL ] CLW: Loaded 22226 existing records from primary storage. [2025-09-28T02:06:40.862124] [INFO ] [MAIN ] CLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:40.862230] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLW took 0.2s. Estimated remaining: 17m 4s. Rate: 111.6 symbols/min [2025-09-28T02:06:41.057138] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:41.120112] [DEBUG] [LOCAL ] CLX: Loaded 52189 existing records from primary storage. [2025-09-28T02:06:41.120506] [INFO ] [MAIN ] CLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:41.121891] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLX took 0.3s. Estimated remaining: 17m 2s. Rate: 111.7 symbols/min [2025-09-28T02:06:41.313635] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:41.367163] [DEBUG] [LOCAL ] CM: Loaded 49317 existing records from primary storage. [2025-09-28T02:06:41.367591] [INFO ] [MAIN ] CM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:41.367763] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CM took 0.2s. Estimated remaining: 17m 1s. Rate: 111.9 symbols/min [2025-09-28T02:06:41.456450] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-28T02:06:41.508928] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-28T02:06:41.606849] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:41.607108] [DEBUG] [LOCAL ] CMA: No existing data file found in primary storage. [2025-09-28T02:06:41.607188] [WARN ] [MAIN ] CMA: No existing data found, performing full refresh instead. [2025-09-28T02:06:41.607309] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-28T02:06:41.607393] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-28T02:06:41.607483] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-09-28T02:06:41.607554] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-28T02:06:41.996421] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:42.111965] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-28T02:06:42.255714] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-28T02:06:42.311499] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-28T02:06:43.055728] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-28T02:06:43.512137] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-28T02:06:43.805859] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-28T02:06:43.855679] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-28T02:06:44.655755] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-28T02:06:45.085960] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-28T02:06:45.455770] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-28T02:06:46.255704] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-28T02:06:46.419246] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-28T02:06:46.522925] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-28T02:06:46.528226] [INFO ] [REMOTE ] CIO: Full fetch complete (28935 records). [2025-09-28T02:06:46.528409] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-28T02:06:46.646423] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-28T02:06:46.954024] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-28T02:06:46.954199] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-28T02:06:46.954862] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-28T02:06:46.954959] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-28T02:06:46.956870] [DEBUG] [LOCAL ] CIO: Trimmed 28935 records to 20406 (keeping 200 days of data) [2025-09-28T02:06:47.056056] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-28T02:06:47.091585] [DEBUG] [LOCAL ] CIO: Primary data saved (20406 records). [2025-09-28T02:06:47.091778] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-28T02:06:47.091934] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CIO took 30.0s. Estimated remaining: 17m 21s. Rate: 109.6 symbols/min [2025-09-28T02:06:47.283454] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:47.305756] [DEBUG] [LOCAL ] CMBT: Loaded 22911 existing records from primary storage. [2025-09-28T02:06:47.306077] [INFO ] [MAIN ] CMBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:47.306179] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CMBT took 0.2s. Estimated remaining: 17m 19s. Rate: 109.7 symbols/min [2025-09-28T02:06:47.420210] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-28T02:06:47.497282] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:47.542019] [DEBUG] [LOCAL ] CMC: Loaded 46311 existing records from primary storage. [2025-09-28T02:06:47.542430] [INFO ] [MAIN ] CMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:47.542537] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CMC took 0.2s. Estimated remaining: 17m 17s. Rate: 109.9 symbols/min [2025-09-28T02:06:47.719561] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:47.726446] [DEBUG] [LOCAL ] CMCM: Loaded 4834 existing records from primary storage. [2025-09-28T02:06:47.726720] [INFO ] [MAIN ] CMCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:47.726845] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMCM took 0.2s. Estimated remaining: 17m 15s. Rate: 110.0 symbols/min [2025-09-28T02:06:47.860908] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-28T02:06:47.914953] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:47.915158] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-28T02:06:47.915233] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-28T02:06:47.915352] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-28T02:06:47.915427] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-28T02:06:47.915559] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-28T02:06:47.915666] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-28T02:06:48.314050] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:48.521541] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-28T02:06:48.655690] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-28T02:06:49.455726] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-28T02:06:49.918242] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-28T02:06:50.256044] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-28T02:06:50.257136] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-28T02:06:50.260389] [INFO ] [REMOTE ] CIMO: Full fetch complete (5472 records). [2025-09-28T02:06:50.260504] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-28T02:06:50.469619] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:06:50.469891] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:06:50.469965] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:06:50.470043] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-28T02:06:50.470141] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-28T02:06:50.470215] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-28T02:06:50.470325] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-28T02:06:50.470478] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CIMO took 35.7s. Estimated remaining: 17m 24s. Rate: 109.1 symbols/min [2025-09-28T02:06:50.663222] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:50.738294] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-09-28T02:06:50.738749] [INFO ] [MAIN ] CMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:50.739430] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMG took 0.3s. Estimated remaining: 17m 22s. Rate: 109.2 symbols/min [2025-09-28T02:06:50.922635] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:50.971772] [DEBUG] [LOCAL ] CMI: Loaded 42484 existing records from primary storage. [2025-09-28T02:06:50.972157] [INFO ] [MAIN ] CMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:50.972616] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMI took 0.2s. Estimated remaining: 17m 20s. Rate: 109.4 symbols/min [2025-09-28T02:06:51.060862] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-28T02:06:51.162248] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:51.162479] [DEBUG] [LOCAL ] CMP: No existing data file found in primary storage. [2025-09-28T02:06:51.162572] [WARN ] [MAIN ] CMP: No existing data found, performing full refresh instead. [2025-09-28T02:06:51.162739] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-28T02:06:51.162854] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-28T02:06:51.162967] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-28T02:06:51.163058] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-28T02:06:51.553179] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:06:51.855735] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-28T02:06:52.131708] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-28T02:06:52.205587] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-28T02:06:52.655728] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-28T02:06:53.319745] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-28T02:06:53.455764] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-28T02:06:53.667849] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:06:53.668201] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-28T02:06:53.668291] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:06:53.668400] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-09-28T02:06:53.668473] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:06:53.668550] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-28T02:06:53.668677] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-28T02:06:53.668752] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-28T02:06:53.668855] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-28T02:06:53.668942] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMDB took 5.9s. Estimated remaining: 17m 28s. Rate: 108.5 symbols/min [2025-09-28T02:06:53.855185] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:06:53.910443] [DEBUG] [LOCAL ] CMPO: Loaded 40071 existing records from primary storage. [2025-09-28T02:06:53.910841] [INFO ] [MAIN ] CMPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:06:53.911693] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMPO took 0.2s. Estimated remaining: 17m 26s. Rate: 108.6 symbols/min [2025-09-28T02:06:54.255764] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-28T02:06:54.291277] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-28T02:06:55.055741] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-28T02:06:55.143849] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-28T02:06:55.855742] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-28T02:06:56.655753] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-28T02:06:56.964845] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-28T02:06:57.065411] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-28T02:06:57.071410] [INFO ] [REMOTE ] CLH: Full fetch complete (41875 records). [2025-09-28T02:06:57.071635] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-28T02:06:57.460857] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-28T02:06:57.537388] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-28T02:06:57.537541] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-28T02:06:57.538315] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-28T02:06:57.538441] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-28T02:06:57.539751] [DEBUG] [LOCAL ] CLH: Trimmed 41875 records to 28493 (keeping 200 days of data) [2025-09-28T02:06:57.721519] [DEBUG] [LOCAL ] CLH: Primary data saved (28493 records). [2025-09-28T02:06:57.721719] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-28T02:06:57.721886] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CLH took 25.2s. Estimated remaining: 17m 39s. Rate: 107.3 symbols/min [2025-09-28T02:06:58.035375] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-28T02:06:58.255732] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-28T02:06:59.471775] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-28T02:06:59.484393] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-28T02:06:59.518839] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-28T02:06:59.855732] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-28T02:07:01.091352] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-28T02:07:01.099783] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-28T02:07:01.269562] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-28T02:07:01.455728] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-28T02:07:02.663678] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-28T02:07:02.672432] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-28T02:07:02.993393] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-28T02:07:03.055677] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-28T02:07:04.195162] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-28T02:07:04.205959] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-28T02:07:04.867220] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-28T02:07:04.886427] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-28T02:07:05.601464] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-28T02:07:05.610820] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-28T02:07:06.560016] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-28T02:07:06.572589] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-28T02:07:07.236190] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-28T02:07:07.245605] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-28T02:07:08.298865] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-28T02:07:08.308631] [INFO ] [REMOTE ] CMA: Full fetch complete (73195 records). [2025-09-28T02:07:08.308832] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-28T02:07:08.760852] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-28T02:07:08.762198] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-28T02:07:08.762452] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-28T02:07:08.770505] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-28T02:07:08.770810] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-28T02:07:08.771422] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-28T02:07:08.773874] [DEBUG] [LOCAL ] CMA: Trimmed 73195 records to 50721 (keeping 200 days of data) [2025-09-28T02:07:09.084147] [DEBUG] [LOCAL ] CMA: Primary data saved (50721 records). [2025-09-28T02:07:09.084326] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-28T02:07:09.084445] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMA took 27.7s. Estimated remaining: 18m 21s. Rate: 103.1 symbols/min [2025-09-28T02:07:09.833900] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-28T02:07:09.841406] [INFO ] [REMOTE ] CMP: Full fetch complete (52879 records). [2025-09-28T02:07:09.841676] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-28T02:07:10.278343] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-28T02:07:10.278482] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-28T02:07:10.279225] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-28T02:07:10.279316] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-28T02:07:10.280999] [DEBUG] [LOCAL ] CMP: Trimmed 52879 records to 36848 (keeping 200 days of data) [2025-09-28T02:07:10.507994] [DEBUG] [LOCAL ] CMP: Primary data saved (36848 records). [2025-09-28T02:07:10.508215] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-28T02:07:10.508372] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMP took 19.5s. Estimated remaining: 18m 24s. Rate: 102.8 symbols/min [2025-09-28T02:07:11.135394] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:11.215977] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:11.298320] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:11.305047] [DEBUG] [LOCAL ] CMRE: No existing data file found in primary storage. [2025-09-28T02:07:11.302253] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:11.305591] [DEBUG] [LOCAL ] CMSA: Loaded 3421 existing records from primary storage. [2025-09-28T02:07:11.306161] [INFO ] [MAIN ] CMSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:11.306267] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSA took 0.8s. Estimated remaining: 18m 24s. Rate: 102.7 symbols/min [2025-09-28T02:07:11.305205] [WARN ] [MAIN ] CMRE: No existing data found, performing full refresh instead. [2025-09-28T02:07:11.312198] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-28T02:07:11.325783] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-28T02:07:11.369836] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-09-28T02:07:11.392748] [DEBUG] [LOCAL ] CMSC: Loaded 5131 existing records from primary storage. [2025-09-28T02:07:11.403204] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-28T02:07:11.408824] [INFO ] [MAIN ] CMSC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:11.489241] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSC took 1.0s. Estimated remaining: 18m 22s. Rate: 102.9 symbols/min [2025-09-28T02:07:11.646550] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:11.794009] [DEBUG] [LOCAL ] CMS: Loaded 53371 existing records from primary storage. [2025-09-28T02:07:11.864766] [INFO ] [MAIN ] CMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:11.923210] [DEBUG] [LOCAL ] CMSD: Loaded 8184 existing records from primary storage. [2025-09-28T02:07:11.893922] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMS took 1.4s. Estimated remaining: 18m 21s. Rate: 102.9 symbols/min [2025-09-28T02:07:11.936214] [INFO ] [MAIN ] CMSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:11.977080] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMSD took 0.7s. Estimated remaining: 18m 18s. Rate: 103.1 symbols/min [2025-09-28T02:07:12.012570] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:12.410536] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:12.470847] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:07:12.494371] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-28T02:07:12.564285] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:12.565628] [DEBUG] [LOCAL ] CMTG: Loaded 37931 existing records from primary storage. [2025-09-28T02:07:12.570499] [DEBUG] [LOCAL ] CMU: Loaded 7303 existing records from primary storage. [2025-09-28T02:07:12.570751] [INFO ] [MAIN ] CMTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:12.571214] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMTG took 1.1s. Estimated remaining: 18m 17s. Rate: 103.1 symbols/min [2025-09-28T02:07:12.571040] [INFO ] [MAIN ] CMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:12.577050] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMU took 0.6s. Estimated remaining: 18m 15s. Rate: 103.3 symbols/min [2025-09-28T02:07:12.924172] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:12.960720] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:12.961541] [DEBUG] [LOCAL ] CNC: No existing data file found in primary storage. [2025-09-28T02:07:12.962033] [WARN ] [MAIN ] CNC: No existing data found, performing full refresh instead. [2025-09-28T02:07:12.970704] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-28T02:07:12.972541] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-28T02:07:12.972787] [DEBUG] [LOCAL ] CNC: No primary data file found to delete. [2025-09-28T02:07:12.972880] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-28T02:07:12.973620] [DEBUG] [LOCAL ] CNA: Loaded 33235 existing records from primary storage. [2025-09-28T02:07:12.986500] [INFO ] [MAIN ] CNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:13.023852] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CNA took 1.0s. Estimated remaining: 18m 14s. Rate: 103.4 symbols/min [2025-09-28T02:07:13.110031] [DEBUG] [LOCAL ] CNF: Loaded 11166 existing records from primary storage. [2025-09-28T02:07:13.181548] [INFO ] [MAIN ] CNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:13.212449] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNF took 0.6s. Estimated remaining: 18m 11s. Rate: 103.5 symbols/min [2025-09-28T02:07:13.481255] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:13.727184] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:13.775887] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-28T02:07:13.843878] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:07:13.837025] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-28T02:07:13.845319] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-28T02:07:13.901805] [DEBUG] [LOCAL ] CNH: Loaded 54337 existing records from primary storage. [2025-09-28T02:07:13.915636] [INFO ] [MAIN ] CNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:13.915837] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNH took 0.9s. Estimated remaining: 18m 11s. Rate: 103.5 symbols/min [2025-09-28T02:07:13.963703] [DEBUG] [LOCAL ] CNI: Loaded 52419 existing records from primary storage. [2025-09-28T02:07:14.001873] [INFO ] [MAIN ] CNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:14.020302] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNI took 0.8s. Estimated remaining: 18m 9s. Rate: 103.6 symbols/min [2025-09-28T02:07:14.234848] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:14.235575] [DEBUG] [LOCAL ] CNK: No existing data file found in primary storage. [2025-09-28T02:07:14.241187] [WARN ] [MAIN ] CNK: No existing data found, performing full refresh instead. [2025-09-28T02:07:14.251636] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-28T02:07:14.262115] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-28T02:07:14.293154] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-09-28T02:07:14.293597] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-28T02:07:14.387091] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:14.743438] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:07:14.746474] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-28T02:07:14.745877] [DEBUG] [LOCAL ] CNM: Loaded 51747 existing records from primary storage. [2025-09-28T02:07:14.748389] [INFO ] [MAIN ] CNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:14.748514] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNM took 0.7s. Estimated remaining: 18m 9s. Rate: 103.6 symbols/min [2025-09-28T02:07:14.960065] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:15.018948] [DEBUG] [LOCAL ] CNMD: Loaded 32884 existing records from primary storage. [2025-09-28T02:07:15.019403] [INFO ] [MAIN ] CNMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:15.020245] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNMD took 0.3s. Estimated remaining: 18m 7s. Rate: 103.7 symbols/min [2025-09-28T02:07:15.238256] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-28T02:07:15.313989] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-28T02:07:15.319957] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:15.365586] [DEBUG] [LOCAL ] CNNE: Loaded 37257 existing records from primary storage. [2025-09-28T02:07:15.366051] [INFO ] [MAIN ] CNNE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:15.366196] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNNE took 0.3s. Estimated remaining: 18m 6s. Rate: 103.8 symbols/min [2025-09-28T02:07:15.636705] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:15.691882] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-28T02:07:15.704118] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-28T02:07:15.752210] [DEBUG] [LOCAL ] CNO: Loaded 41901 existing records from primary storage. [2025-09-28T02:07:15.752824] [INFO ] [MAIN ] CNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:15.753698] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNO took 0.4s. Estimated remaining: 18m 4s. Rate: 103.9 symbols/min [2025-09-28T02:07:16.006476] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:16.063348] [DEBUG] [LOCAL ] CNP: Loaded 54249 existing records from primary storage. [2025-09-28T02:07:16.063792] [INFO ] [MAIN ] CNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:16.064431] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNP took 0.3s. Estimated remaining: 18m 3s. Rate: 104.0 symbols/min [2025-09-28T02:07:16.261856] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:16.318395] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-09-28T02:07:16.318824] [INFO ] [MAIN ] CNQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:16.319583] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNQ took 0.3s. Estimated remaining: 18m 1s. Rate: 104.1 symbols/min [2025-09-28T02:07:16.513452] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:16.514405] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-28T02:07:16.514537] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-28T02:07:16.514716] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-28T02:07:16.514953] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-28T02:07:16.515252] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-28T02:07:16.515331] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-28T02:07:16.675663] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-28T02:07:16.752541] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-28T02:07:16.871159] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-28T02:07:16.903290] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-28T02:07:16.989309] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:07:16.989712] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-28T02:07:17.227528] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:07:17.227976] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-28T02:07:17.228073] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:07:17.228161] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-09-28T02:07:17.228238] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:07:17.228323] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-28T02:07:17.228424] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-28T02:07:17.228526] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-28T02:07:17.228638] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-28T02:07:17.228773] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNR took 0.9s. Estimated remaining: 18m 2s. Rate: 103.9 symbols/min [2025-09-28T02:07:17.421822] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:17.447084] [DEBUG] [LOCAL ] CNS: Loaded 21245 existing records from primary storage. [2025-09-28T02:07:17.447449] [INFO ] [MAIN ] CNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:17.447569] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNS took 0.2s. Estimated remaining: 17m 60s. Rate: 104.1 symbols/min [2025-09-28T02:07:17.635373] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:17.667992] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-28T02:07:17.679777] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-28T02:07:17.727886] [DEBUG] [LOCAL ] CNX: Loaded 52150 existing records from primary storage. [2025-09-28T02:07:17.728290] [INFO ] [MAIN ] CNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:17.729037] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNX took 0.3s. Estimated remaining: 17m 58s. Rate: 104.2 symbols/min [2025-09-28T02:07:17.914284] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:17.958433] [DEBUG] [LOCAL ] CODI: Loaded 40312 existing records from primary storage. [2025-09-28T02:07:17.958908] [INFO ] [MAIN ] CODI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:17.959559] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CODI took 0.2s. Estimated remaining: 17m 56s. Rate: 104.3 symbols/min [2025-09-28T02:07:18.151513] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:18.208720] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-09-28T02:07:18.209149] [INFO ] [MAIN ] COF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:18.209670] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. COF took 0.2s. Estimated remaining: 17m 54s. Rate: 104.4 symbols/min [2025-09-28T02:07:18.393969] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:18.450993] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-28T02:07:18.460469] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-28T02:07:18.479505] [DEBUG] [LOCAL ] COHR: Loaded 54144 existing records from primary storage. [2025-09-28T02:07:18.479973] [INFO ] [MAIN ] COHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:18.480639] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. COHR took 0.3s. Estimated remaining: 17m 53s. Rate: 104.5 symbols/min [2025-09-28T02:07:18.641583] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-28T02:07:18.679839] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-28T02:07:18.748507] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:18.810619] [DEBUG] [LOCAL ] COLD: Loaded 52785 existing records from primary storage. [2025-09-28T02:07:18.811090] [INFO ] [MAIN ] COLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:18.811209] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. COLD took 0.3s. Estimated remaining: 17m 51s. Rate: 104.6 symbols/min [2025-09-28T02:07:19.066890] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:19.126539] [DEBUG] [LOCAL ] COMP: Loaded 54166 existing records from primary storage. [2025-09-28T02:07:19.127023] [INFO ] [MAIN ] COMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:19.127737] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COMP took 0.3s. Estimated remaining: 17m 50s. Rate: 104.7 symbols/min [2025-09-28T02:07:19.307196] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:19.351449] [DEBUG] [LOCAL ] CON: Loaded 39289 existing records from primary storage. [2025-09-28T02:07:19.351831] [INFO ] [MAIN ] CON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:19.352469] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. CON took 0.2s. Estimated remaining: 17m 48s. Rate: 104.8 symbols/min [2025-09-28T02:07:19.542034] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:19.573231] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-28T02:07:19.584730] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-28T02:07:19.605784] [DEBUG] [LOCAL ] COOK: Loaded 24850 existing records from primary storage. [2025-09-28T02:07:19.606147] [INFO ] [MAIN ] COOK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:19.606250] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COOK took 0.3s. Estimated remaining: 17m 46s. Rate: 105.0 symbols/min [2025-09-28T02:07:19.801586] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:19.802294] [DEBUG] [LOCAL ] COP: No existing data file found in primary storage. [2025-09-28T02:07:19.802482] [WARN ] [MAIN ] COP: No existing data found, performing full refresh instead. [2025-09-28T02:07:19.802768] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-28T02:07:19.802956] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-28T02:07:19.803203] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-09-28T02:07:19.803396] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-28T02:07:19.938978] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-28T02:07:19.969636] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-28T02:07:20.229389] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:07:20.229962] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-28T02:07:20.508444] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-28T02:07:20.655799] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-28T02:07:21.284550] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-28T02:07:21.347824] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-28T02:07:21.455766] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-28T02:07:21.927096] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-28T02:07:22.260840] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-28T02:07:22.279237] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-28T02:07:23.055701] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-28T02:07:23.168252] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-28T02:07:23.855679] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-28T02:07:24.058119] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-28T02:07:24.655724] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-28T02:07:24.940638] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-28T02:07:25.255267] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-28T02:07:25.455739] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-28T02:07:26.255774] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-28T02:07:26.590150] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-28T02:07:27.055752] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-28T02:07:27.468343] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-28T02:07:27.855746] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-28T02:07:28.065096] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-28T02:07:28.406163] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-28T02:07:28.655741] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-28T02:07:29.460910] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-28T02:07:29.474858] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-28T02:07:30.255764] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-28T02:07:30.451620] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-28T02:07:31.055803] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-28T02:07:31.554637] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-28T02:07:31.855769] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-28T02:07:32.479502] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-28T02:07:32.655703] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-28T02:07:32.815513] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-28T02:07:33.267065] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-28T02:07:33.455738] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-28T02:07:34.255723] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-28T02:07:34.649403] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-28T02:07:35.055775] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-28T02:07:35.564811] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-28T02:07:35.571608] [INFO ] [REMOTE ] CMRE: Full fetch complete (49748 records). [2025-09-28T02:07:35.571840] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-28T02:07:35.862581] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-28T02:07:36.076415] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-28T02:07:36.075080] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-28T02:07:36.087573] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-28T02:07:36.088807] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-28T02:07:36.089318] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-28T02:07:36.090484] [DEBUG] [LOCAL ] CMRE: Trimmed 49748 records to 36068 (keeping 200 days of data) [2025-09-28T02:07:36.311342] [DEBUG] [LOCAL ] CMRE: Primary data saved (36068 records). [2025-09-28T02:07:36.311534] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-28T02:07:36.311684] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. CMRE took 25.8s. Estimated remaining: 18m 45s. Rate: 99.4 symbols/min [2025-09-28T02:07:36.499945] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:36.547185] [DEBUG] [LOCAL ] COR: Loaded 47937 existing records from primary storage. [2025-09-28T02:07:36.577140] [INFO ] [MAIN ] COR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:36.580744] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. COR took 0.3s. Estimated remaining: 18m 43s. Rate: 99.5 symbols/min [2025-09-28T02:07:36.578891] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-28T02:07:36.661159] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-28T02:07:36.797847] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:36.857294] [DEBUG] [LOCAL ] COTY: Loaded 54014 existing records from primary storage. [2025-09-28T02:07:36.857761] [INFO ] [MAIN ] COTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:36.858722] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COTY took 0.3s. Estimated remaining: 18m 41s. Rate: 99.6 symbols/min [2025-09-28T02:07:37.061632] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:37.113258] [DEBUG] [LOCAL ] COUR: Loaded 49636 existing records from primary storage. [2025-09-28T02:07:37.113692] [INFO ] [MAIN ] COUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:37.114411] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COUR took 0.3s. Estimated remaining: 18m 39s. Rate: 99.8 symbols/min [2025-09-28T02:07:37.311701] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:37.367684] [DEBUG] [LOCAL ] CP: Loaded 54051 existing records from primary storage. [2025-09-28T02:07:37.368102] [INFO ] [MAIN ] CP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:37.368777] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. CP took 0.3s. Estimated remaining: 18m 38s. Rate: 99.9 symbols/min [2025-09-28T02:07:37.464818] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-28T02:07:37.559536] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:37.559785] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-09-28T02:07:37.559872] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-09-28T02:07:37.560002] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-28T02:07:37.560093] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-28T02:07:37.560199] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-09-28T02:07:37.560280] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-28T02:07:37.960190] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:07:38.046525] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-28T02:07:38.255731] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-28T02:07:39.055783] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-28T02:07:39.192585] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-28T02:07:39.205896] [INFO ] [REMOTE ] CNK: Full fetch complete (75698 records). [2025-09-28T02:07:39.206120] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-28T02:07:39.598849] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-09-28T02:07:39.688635] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-28T02:07:39.669573] [INFO ] [REMOTE ] CNC: Full fetch complete (77673 records). [2025-09-28T02:07:39.688863] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-28T02:07:39.688941] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-28T02:07:39.690018] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-28T02:07:39.690395] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-28T02:07:39.803190] [DEBUG] [LOCAL ] CNK: Trimmed 75698 records to 53658 (keeping 200 days of data) [2025-09-28T02:07:40.245302] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-28T02:07:40.246598] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-28T02:07:40.248984] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-28T02:07:40.249473] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-28T02:07:40.254491] [DEBUG] [LOCAL ] CNC: Trimmed 77673 records to 54518 (keeping 200 days of data) [2025-09-28T02:07:40.423023] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-28T02:07:40.498174] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-28T02:07:40.738694] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-28T02:07:40.752087] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-28T02:07:40.792854] [DEBUG] [LOCAL ] CNC: Primary data saved (54518 records). [2025-09-28T02:07:40.794355] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-28T02:07:40.794778] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. CNC took 28.2s. Estimated remaining: 18m 47s. Rate: 99.0 symbols/min [2025-09-28T02:07:40.988010] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:40.989987] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-28T02:07:40.993010] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-28T02:07:40.993139] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-28T02:07:40.993214] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-28T02:07:40.993301] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-28T02:07:40.993375] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-28T02:07:41.509466] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:07:41.511418] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-28T02:07:41.522508] [DEBUG] [LOCAL ] CNK: Primary data saved (53658 records). [2025-09-28T02:07:41.522785] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-28T02:07:41.522941] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. CNK took 27.6s. Estimated remaining: 18m 47s. Rate: 98.9 symbols/min [2025-09-28T02:07:41.723266] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:41.759009] [DEBUG] [LOCAL ] CPAY: Loaded 31286 existing records from primary storage. [2025-09-28T02:07:41.759537] [INFO ] [MAIN ] CPAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:41.759686] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CPAY took 0.2s. Estimated remaining: 18m 45s. Rate: 99.0 symbols/min [2025-09-28T02:07:41.957102] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:41.974387] [DEBUG] [LOCAL ] CPF: Loaded 15618 existing records from primary storage. [2025-09-28T02:07:41.974749] [INFO ] [MAIN ] CPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:41.974857] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPF took 0.2s. Estimated remaining: 18m 43s. Rate: 99.2 symbols/min [2025-09-28T02:07:42.096063] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-28T02:07:42.177094] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:42.190211] [DEBUG] [LOCAL ] CPK: No existing data file found in primary storage. [2025-09-28T02:07:42.191366] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-28T02:07:42.191614] [WARN ] [MAIN ] CPK: No existing data found, performing full refresh instead. [2025-09-28T02:07:42.199991] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-28T02:07:42.200076] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-28T02:07:42.200164] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-09-28T02:07:42.200306] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-28T02:07:42.260899] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-28T02:07:42.601742] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:07:42.704476] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-28T02:07:42.839021] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-28T02:07:43.055734] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-28T02:07:43.855718] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-28T02:07:43.895201] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-28T02:07:44.655740] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-28T02:07:45.024313] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-28T02:07:45.212358] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-28T02:07:45.455750] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-28T02:07:46.255769] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-28T02:07:46.948389] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-28T02:07:47.059171] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-28T02:07:47.060225] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-28T02:07:47.855759] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-28T02:07:48.486017] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-28T02:07:48.655737] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-28T02:07:49.013510] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-28T02:07:49.455708] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-28T02:07:49.790106] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-28T02:07:50.255713] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-28T02:07:50.303557] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-28T02:07:51.055727] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-28T02:07:51.839735] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-28T02:07:51.855671] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-28T02:07:52.177474] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-28T02:07:52.188560] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-28T02:07:52.188821] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-28T02:07:52.599188] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-28T02:07:52.599322] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-28T02:07:52.600154] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-28T02:07:52.600248] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-28T02:07:52.602052] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54507 (keeping 200 days of data) [2025-09-28T02:07:52.662956] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-28T02:07:52.730345] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-28T02:07:52.980794] [DEBUG] [LOCAL ] COP: Primary data saved (54507 records). [2025-09-28T02:07:52.980979] [INFO ] [MAIN ] COP: Full history saved. [2025-09-28T02:07:52.981098] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. COP took 33.4s. Estimated remaining: 19m 20s. Rate: 96.0 symbols/min [2025-09-28T02:07:53.158119] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:07:53.216884] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-09-28T02:07:53.217268] [INFO ] [MAIN ] CPNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:07:53.218594] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPNG took 0.2s. Estimated remaining: 19m 18s. Rate: 96.1 symbols/min [2025-09-28T02:07:53.455726] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-28T02:07:54.085104] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-28T02:07:54.255776] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-28T02:07:54.481039] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-28T02:07:55.055679] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-28T02:07:55.548275] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-28T02:07:55.855706] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-28T02:07:55.975209] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-28T02:07:56.237408] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-28T02:07:56.655782] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-28T02:07:57.455799] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-28T02:07:57.627734] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-28T02:07:57.829332] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-28T02:07:58.255733] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-28T02:07:58.604491] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-28T02:07:59.055726] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-28T02:07:59.855760] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-28T02:08:00.394792] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-28T02:08:00.655714] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-28T02:08:00.770900] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-28T02:08:01.455813] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-28T02:08:01.977274] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-28T02:08:02.255754] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-28T02:08:02.524537] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-28T02:08:02.527825] [INFO ] [REMOTE ] CPK: Full fetch complete (17769 records). [2025-09-28T02:08:02.527930] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-28T02:08:02.917748] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-28T02:08:02.917887] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-28T02:08:02.918268] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-28T02:08:02.918353] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-28T02:08:02.919118] [DEBUG] [LOCAL ] CPK: Trimmed 17769 records to 13588 (keeping 200 days of data) [2025-09-28T02:08:03.008043] [DEBUG] [LOCAL ] CPK: Primary data saved (13588 records). [2025-09-28T02:08:03.008238] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-28T02:08:03.008362] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPK took 21.0s. Estimated remaining: 19m 50s. Rate: 93.4 symbols/min [2025-09-28T02:08:03.055694] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-28T02:08:03.467629] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-28T02:08:03.473622] [INFO ] [REMOTE ] CPA: Full fetch complete (42082 records). [2025-09-28T02:08:03.473855] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-28T02:08:03.593400] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-28T02:08:03.860880] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-28T02:08:03.903458] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-28T02:08:03.903568] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-28T02:08:03.904159] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-28T02:08:03.904245] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-28T02:08:03.905349] [DEBUG] [LOCAL ] CPA: Trimmed 42082 records to 29208 (keeping 200 days of data) [2025-09-28T02:08:04.089445] [DEBUG] [LOCAL ] CPA: Primary data saved (29208 records). [2025-09-28T02:08:04.089632] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-28T02:08:04.089822] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPA took 26.7s. Estimated remaining: 19m 51s. Rate: 93.3 symbols/min [2025-09-28T02:08:04.362133] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-28T02:08:04.655731] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-28T02:08:05.136520] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-28T02:08:05.137591] [INFO ] [REMOTE ] CPAC: Full fetch complete (1887 records). [2025-09-28T02:08:05.137717] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-28T02:08:05.343375] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:08:05.344209] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:08:05.344302] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:08:05.344356] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-28T02:08:05.344421] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-28T02:08:05.344463] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-28T02:08:05.344508] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-28T02:08:05.344573] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPAC took 24.5s. Estimated remaining: 19m 52s. Rate: 93.1 symbols/min [2025-09-28T02:08:06.102697] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:06.167016] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:06.186086] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:06.215672] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:06.243097] [DEBUG] [LOCAL ] CQP: Loaded 20033 existing records from primary storage. [2025-09-28T02:08:06.243718] [INFO ] [MAIN ] CQP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:06.243888] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 0.9s. Estimated remaining: 19m 53s. Rate: 93.1 symbols/min [2025-09-28T02:08:06.409235] [DEBUG] [LOCAL ] CPS: Loaded 26476 existing records from primary storage. [2025-09-28T02:08:06.421997] [INFO ] [MAIN ] CPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:06.517747] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 1.2s. Estimated remaining: 19m 51s. Rate: 93.2 symbols/min [2025-09-28T02:08:06.526853] [DEBUG] [LOCAL ] CPT: Loaded 45034 existing records from primary storage. [2025-09-28T02:08:06.519806] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:06.520781] [DEBUG] [LOCAL ] CPRI: Loaded 53326 existing records from primary storage. [2025-09-28T02:08:06.544347] [INFO ] [MAIN ] CPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:06.551965] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPT took 1.2s. Estimated remaining: 19m 48s. Rate: 93.3 symbols/min [2025-09-28T02:08:06.544235] [INFO ] [MAIN ] CPRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:06.570695] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPRI took 1.2s. Estimated remaining: 19m 45s. Rate: 93.5 symbols/min [2025-09-28T02:08:07.002001] [DEBUG] [LOCAL ] CR: Loaded 25019 existing records from primary storage. [2025-09-28T02:08:07.066045] [INFO ] [MAIN ] CR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:07.106170] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:07.044035] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:07.129906] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CR took 0.9s. Estimated remaining: 19m 44s. Rate: 93.5 symbols/min [2025-09-28T02:08:07.192445] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:07.211778] [DEBUG] [LOCAL ] CRBG: No existing data file found in primary storage. [2025-09-28T02:08:07.224312] [WARN ] [MAIN ] CRBG: No existing data found, performing full refresh instead. [2025-09-28T02:08:07.252327] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-28T02:08:07.280819] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-28T02:08:07.285806] [DEBUG] [LOCAL ] CRBD: Loaded 9131 existing records from primary storage. [2025-09-28T02:08:07.286326] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-09-28T02:08:07.313562] [INFO ] [MAIN ] CRBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:07.331743] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-28T02:08:07.349263] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CRBD took 0.8s. Estimated remaining: 19m 42s. Rate: 93.7 symbols/min [2025-09-28T02:08:07.464807] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:07.523940] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-28T02:08:07.553030] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-28T02:08:07.563776] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-28T02:08:07.588364] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-28T02:08:07.588564] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-28T02:08:07.612398] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-28T02:08:07.658232] [DEBUG] [LOCAL ] CRC: Loaded 44946 existing records from primary storage. [2025-09-28T02:08:07.716752] [INFO ] [MAIN ] CRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:07.761311] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRC took 1.2s. Estimated remaining: 19m 41s. Rate: 93.7 symbols/min [2025-09-28T02:08:07.994291] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:08.482269] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:08.489638] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:08.528514] [DEBUG] [LOCAL ] CRH: No existing data file found in primary storage. [2025-09-28T02:08:08.528371] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-28T02:08:08.564790] [WARN ] [MAIN ] CRH: No existing data found, performing full refresh instead. [2025-09-28T02:08:08.570751] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-28T02:08:08.570927] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-28T02:08:08.587490] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-09-28T02:08:08.592932] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-28T02:08:08.698430] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:08.742144] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-28T02:08:08.728507] [DEBUG] [LOCAL ] CRGY: Loaded 53290 existing records from primary storage. [2025-09-28T02:08:08.795206] [INFO ] [MAIN ] CRGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:08.810904] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRGY took 1.4s. Estimated remaining: 19m 41s. Rate: 93.6 symbols/min [2025-09-28T02:08:09.191275] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:08:09.231492] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-28T02:08:09.305619] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:09.348877] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:09.341076] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:08:09.349146] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-09-28T02:08:09.349524] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-28T02:08:09.349815] [DEBUG] [LOCAL ] CRI: No existing data file found in primary storage. [2025-09-28T02:08:09.351069] [WARN ] [MAIN ] CRI: No existing data found, performing full refresh instead. [2025-09-28T02:08:09.351002] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:08:09.351383] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-28T02:08:09.351309] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-28T02:08:09.351534] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-28T02:08:09.351685] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-28T02:08:09.351885] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-28T02:08:09.352087] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-09-28T02:08:09.352418] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-28T02:08:09.352235] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-28T02:08:09.352556] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRCL took 2.2s. Estimated remaining: 19m 40s. Rate: 93.6 symbols/min [2025-09-28T02:08:09.712450] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:09.940309] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:09.940834] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-28T02:08:09.985632] [DEBUG] [LOCAL ] CRK: Loaded 52891 existing records from primary storage. [2025-09-28T02:08:09.986096] [INFO ] [MAIN ] CRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:09.986505] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRK took 0.6s. Estimated remaining: 19m 40s. Rate: 93.6 symbols/min [2025-09-28T02:08:10.177435] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:10.228695] [DEBUG] [LOCAL ] CRL: Loaded 43853 existing records from primary storage. [2025-09-28T02:08:10.229076] [INFO ] [MAIN ] CRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:10.229425] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRL took 0.2s. Estimated remaining: 19m 38s. Rate: 93.7 symbols/min [2025-09-28T02:08:10.426847] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:10.460827] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-28T02:08:10.472811] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-28T02:08:10.524351] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-09-28T02:08:10.524910] [INFO ] [MAIN ] CRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:10.525874] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRM took 0.3s. Estimated remaining: 19m 36s. Rate: 93.8 symbols/min [2025-09-28T02:08:10.705460] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:10.760731] [DEBUG] [LOCAL ] CRS: Loaded 43928 existing records from primary storage. [2025-09-28T02:08:10.761142] [INFO ] [MAIN ] CRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:10.761767] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRS took 0.2s. Estimated remaining: 19m 34s. Rate: 93.9 symbols/min [2025-09-28T02:08:10.951749] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:10.961246] [DEBUG] [LOCAL ] CRT: Loaded 5018 existing records from primary storage. [2025-09-28T02:08:10.961526] [INFO ] [MAIN ] CRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:10.961628] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRT took 0.2s. Estimated remaining: 19m 32s. Rate: 94.1 symbols/min [2025-09-28T02:08:11.145626] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:11.193420] [DEBUG] [LOCAL ] CSAN: Loaded 42951 existing records from primary storage. [2025-09-28T02:08:11.193904] [INFO ] [MAIN ] CSAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:11.194337] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CSAN took 0.2s. Estimated remaining: 19m 30s. Rate: 94.2 symbols/min [2025-09-28T02:08:11.394292] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-28T02:08:11.480707] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:11.482722] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-28T02:08:11.532084] [DEBUG] [LOCAL ] CSL: Loaded 32100 existing records from primary storage. [2025-09-28T02:08:11.532478] [INFO ] [MAIN ] CSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:11.532587] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CSL took 0.3s. Estimated remaining: 19m 28s. Rate: 94.3 symbols/min [2025-09-28T02:08:11.727324] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:11.758552] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-28T02:08:11.772369] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-28T02:08:11.780051] [DEBUG] [LOCAL ] CSR: Loaded 12808 existing records from primary storage. [2025-09-28T02:08:11.780344] [INFO ] [MAIN ] CSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:11.780452] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CSR took 0.2s. Estimated remaining: 19m 26s. Rate: 94.4 symbols/min [2025-09-28T02:08:11.975165] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:12.028747] [DEBUG] [LOCAL ] CSTM: Loaded 48360 existing records from primary storage. [2025-09-28T02:08:12.029131] [INFO ] [MAIN ] CSTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:12.029518] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSTM took 0.2s. Estimated remaining: 19m 24s. Rate: 94.5 symbols/min [2025-09-28T02:08:12.241838] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:12.276604] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-28T02:08:12.292623] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-28T02:08:12.300043] [DEBUG] [LOCAL ] CSV: Loaded 13198 existing records from primary storage. [2025-09-28T02:08:12.300405] [INFO ] [MAIN ] CSV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:12.300511] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSV took 0.3s. Estimated remaining: 19m 22s. Rate: 94.6 symbols/min [2025-09-28T02:08:12.493901] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:12.494167] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-28T02:08:12.494289] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-28T02:08:12.494452] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-28T02:08:12.494546] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-28T02:08:12.494690] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-28T02:08:12.494825] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-28T02:08:12.905401] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:12.905995] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-28T02:08:13.222692] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-28T02:08:13.234414] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-28T02:08:13.434491] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:08:13.434919] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-28T02:08:13.435024] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:08:13.435118] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-09-28T02:08:13.435198] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:08:13.435287] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-28T02:08:13.435404] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-28T02:08:13.435490] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-28T02:08:13.435606] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-28T02:08:13.435737] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSW took 1.1s. Estimated remaining: 19m 23s. Rate: 94.4 symbols/min [2025-09-28T02:08:13.672839] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:13.675904] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-28T02:08:13.686395] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-28T02:08:13.695114] [DEBUG] [LOCAL ] CTBB: Loaded 7168 existing records from primary storage. [2025-09-28T02:08:13.695381] [INFO ] [MAIN ] CTBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:13.695487] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CTBB took 0.3s. Estimated remaining: 19m 21s. Rate: 94.5 symbols/min [2025-09-28T02:08:13.906611] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:13.912298] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-28T02:08:13.929213] [DEBUG] [LOCAL ] CTDD: Loaded 5947 existing records from primary storage. [2025-09-28T02:08:13.929576] [INFO ] [MAIN ] CTDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:13.929741] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CTDD took 0.2s. Estimated remaining: 19m 19s. Rate: 94.7 symbols/min [2025-09-28T02:08:14.118498] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:14.118791] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-28T02:08:14.118875] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-28T02:08:14.119002] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-28T02:08:14.119088] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-28T02:08:14.119179] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-28T02:08:14.119256] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-28T02:08:14.267206] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-28T02:08:14.524740] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:15.055884] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-28T02:08:15.214506] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-28T02:08:15.308222] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:08:15.308822] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-28T02:08:15.310377] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-28T02:08:15.310488] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:08:15.320232] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-09-28T02:08:15.320779] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:08:15.321243] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-28T02:08:15.321351] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-28T02:08:15.321442] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-28T02:08:15.321563] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-28T02:08:15.321686] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTEST took 1.4s. Estimated remaining: 19m 21s. Rate: 94.4 symbols/min [2025-09-28T02:08:15.530145] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:15.530430] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-28T02:08:15.530517] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-28T02:08:15.530744] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-28T02:08:15.530822] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-28T02:08:15.530965] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-28T02:08:15.531043] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-28T02:08:15.860689] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-28T02:08:15.946193] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:15.979774] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-28T02:08:16.655746] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-28T02:08:17.455742] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-28T02:08:17.788692] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-28T02:08:18.096979] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-28T02:08:18.255765] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-28T02:08:19.055703] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-28T02:08:19.107175] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-28T02:08:19.855709] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-28T02:08:20.351283] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:08:20.351626] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-28T02:08:20.351737] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:08:20.351813] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-09-28T02:08:20.351884] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:08:20.351961] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-28T02:08:20.352060] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-28T02:08:20.352132] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-28T02:08:20.352214] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-28T02:08:20.352300] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTEV took 5.0s. Estimated remaining: 19m 35s. Rate: 93.3 symbols/min [2025-09-28T02:08:20.523839] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-28T02:08:20.629603] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:20.656822] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-28T02:08:20.672067] [DEBUG] [LOCAL ] CTO: Loaded 28661 existing records from primary storage. [2025-09-28T02:08:20.672608] [INFO ] [MAIN ] CTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:20.673008] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CTO took 0.3s. Estimated remaining: 19m 34s. Rate: 93.3 symbols/min [2025-09-28T02:08:20.856857] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:20.895572] [DEBUG] [LOCAL ] CTOS: Loaded 37246 existing records from primary storage. [2025-09-28T02:08:20.906869] [INFO ] [MAIN ] CTOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:20.926527] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTOS took 0.3s. Estimated remaining: 19m 32s. Rate: 93.4 symbols/min [2025-09-28T02:08:20.928477] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-28T02:08:21.136213] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:21.193814] [DEBUG] [LOCAL ] CTRA: Loaded 54428 existing records from primary storage. [2025-09-28T02:08:21.194191] [INFO ] [MAIN ] CTRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:21.194556] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTRA took 0.3s. Estimated remaining: 19m 30s. Rate: 93.5 symbols/min [2025-09-28T02:08:21.376239] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:21.431579] [DEBUG] [LOCAL ] CTRE: Loaded 49964 existing records from primary storage. [2025-09-28T02:08:21.432026] [INFO ] [MAIN ] CTRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:21.432439] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTRE took 0.2s. Estimated remaining: 19m 28s. Rate: 93.7 symbols/min [2025-09-28T02:08:21.466118] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-28T02:08:21.671494] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:21.712872] [DEBUG] [LOCAL ] CTRI: Loaded 38571 existing records from primary storage. [2025-09-28T02:08:21.713235] [INFO ] [MAIN ] CTRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:21.713661] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTRI took 0.3s. Estimated remaining: 19m 26s. Rate: 93.8 symbols/min [2025-09-28T02:08:21.906130] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:21.930176] [DEBUG] [LOCAL ] CTS: Loaded 19637 existing records from primary storage. [2025-09-28T02:08:21.930530] [INFO ] [MAIN ] CTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:21.930662] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTS took 0.2s. Estimated remaining: 19m 24s. Rate: 93.9 symbols/min [2025-09-28T02:08:22.140554] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:22.214210] [DEBUG] [LOCAL ] CTVA: Loaded 54002 existing records from primary storage. [2025-09-28T02:08:22.214771] [INFO ] [MAIN ] CTVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:22.215147] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTVA took 0.3s. Estimated remaining: 19m 22s. Rate: 94.0 symbols/min [2025-09-28T02:08:22.267238] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-28T02:08:22.409943] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:22.410206] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-28T02:08:22.410503] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-28T02:08:22.410694] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-28T02:08:22.410850] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-28T02:08:22.410988] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-28T02:08:22.411144] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-28T02:08:22.707045] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-28T02:08:22.860029] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:23.055694] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-28T02:08:23.391815] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-28T02:08:23.513312] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-28T02:08:23.855732] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-28T02:08:24.057221] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-28T02:08:24.655780] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-28T02:08:25.409993] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-28T02:08:25.455727] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-28T02:08:26.255752] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-28T02:08:26.594616] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-28T02:08:26.596273] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-28T02:08:27.055719] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-28T02:08:27.140861] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-28T02:08:27.855728] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-28T02:08:28.655725] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-28T02:08:29.001721] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-28T02:08:29.118382] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-28T02:08:29.455704] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-28T02:08:29.631536] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-28T02:08:30.255746] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-28T02:08:31.055700] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-28T02:08:31.215481] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-28T02:08:31.855704] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-28T02:08:32.259833] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-28T02:08:32.655746] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-28T02:08:32.804126] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-28T02:08:33.455691] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-28T02:08:33.557281] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-28T02:08:34.255698] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-28T02:08:34.595815] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-28T02:08:34.607035] [INFO ] [REMOTE ] CRH: Full fetch complete (77294 records). [2025-09-28T02:08:34.607245] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-28T02:08:35.075397] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-28T02:08:35.075740] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-28T02:08:35.074891] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-28T02:08:35.076779] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-28T02:08:35.077199] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-28T02:08:35.106193] [DEBUG] [LOCAL ] CRH: Trimmed 77294 records to 54243 (keeping 200 days of data) [2025-09-28T02:08:35.107754] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-28T02:08:35.119277] [INFO ] [REMOTE ] CRI: Full fetch complete (70987 records). [2025-09-28T02:08:35.119422] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-28T02:08:35.439763] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-28T02:08:35.667269] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-28T02:08:35.669876] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-28T02:08:35.671140] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-28T02:08:35.675553] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-28T02:08:35.687908] [DEBUG] [LOCAL ] CRI: Trimmed 70987 records to 50713 (keeping 200 days of data) [2025-09-28T02:08:35.877047] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-28T02:08:35.955301] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-28T02:08:35.976498] [INFO ] [REMOTE ] CRBG: Full fetch complete (75695 records). [2025-09-28T02:08:35.979727] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-28T02:08:36.183541] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-28T02:08:36.632966] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-28T02:08:36.635337] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-28T02:08:36.636587] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-28T02:08:36.637771] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-28T02:08:36.647747] [DEBUG] [LOCAL ] CRBG: Trimmed 75695 records to 53110 (keeping 200 days of data) [2025-09-28T02:08:36.656186] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-28T02:08:36.833367] [DEBUG] [LOCAL ] CRH: Primary data saved (54243 records). [2025-09-28T02:08:36.835196] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-28T02:08:36.836096] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CRH took 29.0s. Estimated remaining: 20m 8s. Rate: 90.4 symbols/min [2025-09-28T02:08:37.062518] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:37.065550] [DEBUG] [LOCAL ] CRI: Primary data saved (50713 records). [2025-09-28T02:08:37.067221] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-28T02:08:37.068518] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-28T02:08:37.071898] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CRI took 28.2s. Estimated remaining: 20m 6s. Rate: 90.5 symbols/min [2025-09-28T02:08:37.292432] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:37.323082] [DEBUG] [LOCAL ] CUBE: Loaded 51391 existing records from primary storage. [2025-09-28T02:08:37.333846] [INFO ] [MAIN ] CUBE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:37.337171] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CUBE took 0.5s. Estimated remaining: 20m 4s. Rate: 90.6 symbols/min [2025-09-28T02:08:37.479344] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-28T02:08:37.558259] [DEBUG] [LOCAL ] CUBI: Loaded 27667 existing records from primary storage. [2025-09-28T02:08:37.571617] [INFO ] [MAIN ] CUBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:37.635833] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CUBI took 0.6s. Estimated remaining: 20m 2s. Rate: 90.7 symbols/min [2025-09-28T02:08:37.640255] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:37.833946] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-28T02:08:37.858285] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:37.893032] [DEBUG] [LOCAL ] CULP: Loaded 3111 existing records from primary storage. [2025-09-28T02:08:37.895907] [INFO ] [MAIN ] CULP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:37.913933] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CULP took 0.3s. Estimated remaining: 19m 60s. Rate: 90.8 symbols/min [2025-09-28T02:08:37.915784] [DEBUG] [LOCAL ] CUK: Loaded 51762 existing records from primary storage. [2025-09-28T02:08:37.953034] [INFO ] [MAIN ] CUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:37.959482] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUK took 0.6s. Estimated remaining: 19m 57s. Rate: 90.9 symbols/min [2025-09-28T02:08:38.182164] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:38.202426] [DEBUG] [LOCAL ] CRBG: Primary data saved (53110 records). [2025-09-28T02:08:38.203112] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-28T02:08:38.203392] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CRBG took 31.6s. Estimated remaining: 19m 55s. Rate: 91.0 symbols/min [2025-09-28T02:08:38.227810] [DEBUG] [LOCAL ] CURB: Loaded 33350 existing records from primary storage. [2025-09-28T02:08:38.228199] [INFO ] [MAIN ] CURB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:38.228311] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CURB took 0.3s. Estimated remaining: 19m 52s. Rate: 91.2 symbols/min [2025-09-28T02:08:38.255733] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-28T02:08:38.521425] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-28T02:08:39.055852] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-28T02:08:39.413203] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-28T02:08:39.855820] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-28T02:08:40.218195] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-28T02:08:40.219270] [INFO ] [REMOTE ] CUBB: Full fetch complete (928 records). [2025-09-28T02:08:40.219371] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-28T02:08:40.416325] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-28T02:08:40.416697] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:08:40.416798] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:08:40.416884] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-28T02:08:40.417057] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-28T02:08:40.417173] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-28T02:08:40.417276] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-28T02:08:40.417456] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CUBB took 18.2s. Estimated remaining: 19m 57s. Rate: 90.8 symbols/min [2025-09-28T02:08:41.066381] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:41.133605] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:41.204400] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:41.238844] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:41.267778] [DEBUG] [LOCAL ] CVEO: Loaded 15402 existing records from primary storage. [2025-09-28T02:08:41.276331] [INFO ] [MAIN ] CVEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:41.279409] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CVEO took 0.9s. Estimated remaining: 19m 57s. Rate: 90.7 symbols/min [2025-09-28T02:08:41.280819] [DEBUG] [LOCAL ] CURV: Loaded 26933 existing records from primary storage. [2025-09-28T02:08:41.306626] [INFO ] [MAIN ] CURV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:41.327857] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CURV took 0.9s. Estimated remaining: 19m 54s. Rate: 90.9 symbols/min [2025-09-28T02:08:41.673900] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:41.675882] [DEBUG] [LOCAL ] CUZ: Loaded 50140 existing records from primary storage. [2025-09-28T02:08:41.677315] [DEBUG] [LOCAL ] CVE: Loaded 54336 existing records from primary storage. [2025-09-28T02:08:41.679404] [INFO ] [MAIN ] CUZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:41.685723] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CUZ took 1.2s. Estimated remaining: 19m 52s. Rate: 91.0 symbols/min [2025-09-28T02:08:41.686021] [INFO ] [MAIN ] CVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:41.709685] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CVE took 1.3s. Estimated remaining: 19m 50s. Rate: 91.1 symbols/min [2025-09-28T02:08:41.837171] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:42.172910] [DEBUG] [LOCAL ] CVLG: Loaded 15730 existing records from primary storage. [2025-09-28T02:08:42.184870] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:42.226698] [INFO ] [MAIN ] CVLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:42.232265] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:42.233121] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 0.9s. Estimated remaining: 19m 49s. Rate: 91.2 symbols/min [2025-09-28T02:08:42.234690] [DEBUG] [LOCAL ] CVI: Loaded 47160 existing records from primary storage. [2025-09-28T02:08:42.248244] [INFO ] [MAIN ] CVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:42.269175] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 1.0s. Estimated remaining: 19m 46s. Rate: 91.3 symbols/min [2025-09-28T02:08:42.661414] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:42.665998] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:42.700999] [DEBUG] [LOCAL ] CVS: Loaded 54476 existing records from primary storage. [2025-09-28T02:08:42.702078] [INFO ] [MAIN ] CVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:42.703345] [DEBUG] [LOCAL ] CVNA: Loaded 53766 existing records from primary storage. [2025-09-28T02:08:42.703756] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVS took 0.9s. Estimated remaining: 19m 45s. Rate: 91.4 symbols/min [2025-09-28T02:08:42.704827] [INFO ] [MAIN ] CVNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:42.711534] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVNA took 1.0s. Estimated remaining: 19m 42s. Rate: 91.5 symbols/min [2025-09-28T02:08:43.019422] [DEBUG] [LOCAL ] CW: Loaded 22705 existing records from primary storage. [2025-09-28T02:08:43.103333] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:43.121438] [INFO ] [MAIN ] CW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:43.125811] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:43.126014] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CW took 0.9s. Estimated remaining: 19m 41s. Rate: 91.6 symbols/min [2025-09-28T02:08:43.126536] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-09-28T02:08:43.126888] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-09-28T02:08:43.127020] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-28T02:08:43.127106] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-28T02:08:43.228981] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-28T02:08:43.241121] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-09-28T02:08:43.248159] [INFO ] [MAIN ] CVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:43.241439] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-28T02:08:43.292271] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CVX took 1.1s. Estimated remaining: 19m 38s. Rate: 91.7 symbols/min [2025-09-28T02:08:43.564217] [DEBUG] [LOCAL ] CWEN: Loaded 45717 existing records from primary storage. [2025-09-28T02:08:43.619409] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:43.625186] [INFO ] [MAIN ] CWEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:43.661881] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWEN took 0.9s. Estimated remaining: 19m 37s. Rate: 91.8 symbols/min [2025-09-28T02:08:43.982850] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:44.245604] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:44.355552] [DEBUG] [LOCAL ] CWH: Loaded 52151 existing records from primary storage. [2025-09-28T02:08:44.365390] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:44.379913] [INFO ] [MAIN ] CWH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:44.380963] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWH took 1.3s. Estimated remaining: 19m 36s. Rate: 91.8 symbols/min [2025-09-28T02:08:44.380639] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-28T02:08:44.504107] [DEBUG] [LOCAL ] CWK: Loaded 50158 existing records from primary storage. [2025-09-28T02:08:44.548236] [INFO ] [MAIN ] CWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:44.560453] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWK took 1.2s. Estimated remaining: 19m 34s. Rate: 91.9 symbols/min [2025-09-28T02:08:44.554852] [DEBUG] [LOCAL ] CWT: Loaded 28294 existing records from primary storage. [2025-09-28T02:08:44.599095] [INFO ] [MAIN ] CWT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:44.642552] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWT took 0.9s. Estimated remaining: 19m 32s. Rate: 92.0 symbols/min [2025-09-28T02:08:44.717616] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:44.972076] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:45.057265] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:45.063074] [DEBUG] [LOCAL ] CXE: Loaded 7247 existing records from primary storage. [2025-09-28T02:08:45.063525] [INFO ] [MAIN ] CXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:45.082216] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CXE took 0.5s. Estimated remaining: 19m 30s. Rate: 92.1 symbols/min [2025-09-28T02:08:45.109224] [DEBUG] [LOCAL ] CXH: Loaded 4436 existing records from primary storage. [2025-09-28T02:08:45.147967] [INFO ] [MAIN ] CXH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:45.176399] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CXH took 0.5s. Estimated remaining: 19m 28s. Rate: 92.2 symbols/min [2025-09-28T02:08:45.295943] [DEBUG] [LOCAL ] CX: Loaded 53603 existing records from primary storage. [2025-09-28T02:08:45.363852] [INFO ] [MAIN ] CX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:45.412302] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:45.412545] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CX took 1.0s. Estimated remaining: 19m 26s. Rate: 92.3 symbols/min [2025-09-28T02:08:45.530719] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:45.581437] [DEBUG] [LOCAL ] CXT: No existing data file found in primary storage. [2025-09-28T02:08:45.607894] [WARN ] [MAIN ] CXT: No existing data found, performing full refresh instead. [2025-09-28T02:08:45.614188] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-28T02:08:45.662668] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-28T02:08:45.678746] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-09-28T02:08:45.702073] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:45.702167] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-28T02:08:45.807453] [DEBUG] [LOCAL ] CXM: Loaded 48607 existing records from primary storage. [2025-09-28T02:08:45.835040] [INFO ] [MAIN ] CXM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:45.856039] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXM took 0.8s. Estimated remaining: 19m 25s. Rate: 92.4 symbols/min [2025-09-28T02:08:46.117451] [DEBUG] [LOCAL ] CXW: Loaded 44899 existing records from primary storage. [2025-09-28T02:08:46.173941] [INFO ] [MAIN ] CXW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:46.206296] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXW took 0.8s. Estimated remaining: 19m 23s. Rate: 92.4 symbols/min [2025-09-28T02:08:46.322683] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:46.365882] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-28T02:08:46.452566] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:46.560131] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-28T02:08:46.595070] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:46.606584] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-28T02:08:46.631922] [DEBUG] [LOCAL ] CYD: Loaded 27145 existing records from primary storage. [2025-09-28T02:08:46.632419] [INFO ] [MAIN ] CYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:46.632527] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CYD took 0.7s. Estimated remaining: 19m 22s. Rate: 92.5 symbols/min [2025-09-28T02:08:46.848894] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:46.850321] [DEBUG] [LOCAL ] CYH: Loaded 48352 existing records from primary storage. [2025-09-28T02:08:46.850778] [INFO ] [MAIN ] CYH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:46.851298] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CYH took 0.6s. Estimated remaining: 19m 20s. Rate: 92.6 symbols/min [2025-09-28T02:08:47.038082] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:47.052872] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-09-28T02:08:47.052971] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-09-28T02:08:47.053139] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-28T02:08:47.053235] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-28T02:08:47.053358] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-28T02:08:47.053461] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-28T02:08:47.207417] [DEBUG] [LOCAL ] D: Loaded 54426 existing records from primary storage. [2025-09-28T02:08:47.235241] [INFO ] [MAIN ] D: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:47.251261] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. D took 0.6s. Estimated remaining: 19m 19s. Rate: 92.7 symbols/min [2025-09-28T02:08:47.673247] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:47.698732] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:47.700324] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-28T02:08:47.769082] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-09-28T02:08:47.779872] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-28T02:08:47.780340] [INFO ] [MAIN ] DAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:47.786711] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-28T02:08:47.786988] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. DAL took 0.5s. Estimated remaining: 19m 18s. Rate: 92.7 symbols/min [2025-09-28T02:08:47.976523] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:48.028753] [DEBUG] [LOCAL ] DAN: Loaded 49753 existing records from primary storage. [2025-09-28T02:08:48.029147] [INFO ] [MAIN ] DAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:48.029256] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. DAN took 0.2s. Estimated remaining: 19m 16s. Rate: 92.8 symbols/min [2025-09-28T02:08:48.220409] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:48.243557] [DEBUG] [LOCAL ] DAO: Loaded 21546 existing records from primary storage. [2025-09-28T02:08:48.243910] [INFO ] [MAIN ] DAO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:48.244027] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. DAO took 0.2s. Estimated remaining: 19m 14s. Rate: 92.9 symbols/min [2025-09-28T02:08:48.450720] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:48.470884] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-28T02:08:48.494461] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-28T02:08:48.493943] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-28T02:08:48.499374] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-28T02:08:48.558977] [DEBUG] [LOCAL ] DAR: Loaded 52603 existing records from primary storage. [2025-09-28T02:08:48.559467] [INFO ] [MAIN ] DAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:48.559574] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAR took 0.3s. Estimated remaining: 19m 12s. Rate: 93.0 symbols/min [2025-09-28T02:08:48.738963] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:48.780449] [DEBUG] [LOCAL ] DAVA: Loaded 41308 existing records from primary storage. [2025-09-28T02:08:48.780921] [INFO ] [MAIN ] DAVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:48.781031] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAVA took 0.2s. Estimated remaining: 19m 10s. Rate: 93.1 symbols/min [2025-09-28T02:08:48.966206] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:49.020158] [DEBUG] [LOCAL ] DAY: Loaded 50491 existing records from primary storage. [2025-09-28T02:08:49.020581] [INFO ] [MAIN ] DAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:49.020720] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAY took 0.2s. Estimated remaining: 19m 8s. Rate: 93.2 symbols/min [2025-09-28T02:08:49.215204] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:49.236594] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-28T02:08:49.244486] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-28T02:08:49.292077] [DEBUG] [LOCAL ] DB: Loaded 53377 existing records from primary storage. [2025-09-28T02:08:49.292493] [INFO ] [MAIN ] DB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:08:49.292602] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DB took 0.3s. Estimated remaining: 19m 6s. Rate: 93.3 symbols/min [2025-09-28T02:08:49.481166] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:08:49.481724] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-28T02:08:49.492411] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-28T02:08:49.492956] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-28T02:08:49.493187] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-28T02:08:49.498224] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-28T02:08:49.498324] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-28T02:08:49.499526] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-28T02:08:49.499607] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-28T02:08:49.901084] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:08:49.901830] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-28T02:08:49.931069] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-28T02:08:49.942321] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-28T02:08:50.327739] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-28T02:08:50.335008] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-28T02:08:50.345804] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-28T02:08:50.349978] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-28T02:08:50.902090] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-28T02:08:51.055713] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-28T02:08:51.192404] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-28T02:08:51.317116] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-28T02:08:51.652596] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-28T02:08:51.785248] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-28T02:08:51.855686] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-28T02:08:52.624747] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-28T02:08:52.655674] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-28T02:08:53.455715] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-28T02:08:53.577260] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-28T02:08:54.255715] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-28T02:08:54.806445] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-28T02:08:55.055729] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-28T02:08:55.855700] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-28T02:08:55.991225] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-28T02:08:56.013670] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-28T02:08:56.655718] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-28T02:08:56.930210] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-28T02:08:57.455741] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-28T02:08:57.611435] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-28T02:08:58.255713] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-28T02:08:59.055707] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-28T02:08:59.201566] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-28T02:08:59.744009] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-28T02:08:59.855695] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-28T02:09:00.173050] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-28T02:09:00.655732] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-28T02:09:01.458938] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-28T02:09:01.463689] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-28T02:09:02.255690] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-28T02:09:02.452278] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-28T02:09:02.575138] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-28T02:09:03.055729] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-28T02:09:03.232876] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-28T02:09:03.855708] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-28T02:09:03.937273] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-28T02:09:04.655728] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-28T02:09:05.275257] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-28T02:09:05.282384] [INFO ] [REMOTE ] CXT: Full fetch complete (45184 records). [2025-09-28T02:09:05.282550] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-28T02:09:05.468337] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-28T02:09:05.696264] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-28T02:09:05.696413] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-28T02:09:05.697028] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-28T02:09:05.697114] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-28T02:09:05.698483] [DEBUG] [LOCAL ] CXT: Trimmed 45184 records to 31611 (keeping 200 days of data) [2025-09-28T02:09:05.812370] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-28T02:09:05.925348] [DEBUG] [LOCAL ] CXT: Primary data saved (31611 records). [2025-09-28T02:09:05.926230] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-28T02:09:05.926513] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. CXT took 20.7s. Estimated remaining: 19m 54s. Rate: 89.5 symbols/min [2025-09-28T02:09:06.117034] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:06.168789] [DEBUG] [LOCAL ] DBI: Loaded 45524 existing records from primary storage. [2025-09-28T02:09:06.169162] [INFO ] [MAIN ] DBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:06.170211] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DBI took 0.2s. Estimated remaining: 19m 52s. Rate: 89.6 symbols/min [2025-09-28T02:09:06.260824] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-28T02:09:06.261304] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-28T02:09:06.373579] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:06.387002] [DEBUG] [LOCAL ] DBL: Loaded 9259 existing records from primary storage. [2025-09-28T02:09:06.387309] [INFO ] [MAIN ] DBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:06.387431] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DBL took 0.2s. Estimated remaining: 19m 50s. Rate: 89.7 symbols/min [2025-09-28T02:09:06.567579] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:06.621581] [DEBUG] [LOCAL ] DBRG: Loaded 50526 existing records from primary storage. [2025-09-28T02:09:06.622002] [INFO ] [MAIN ] DBRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:06.622800] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DBRG took 0.2s. Estimated remaining: 19m 48s. Rate: 89.8 symbols/min [2025-09-28T02:09:06.807204] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:06.853037] [DEBUG] [LOCAL ] DCI: Loaded 38065 existing records from primary storage. [2025-09-28T02:09:06.853465] [INFO ] [MAIN ] DCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:06.854150] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DCI took 0.2s. Estimated remaining: 19m 46s. Rate: 89.9 symbols/min [2025-09-28T02:09:07.062691] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-28T02:09:07.082387] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:07.103168] [DEBUG] [LOCAL ] DCO: Loaded 14003 existing records from primary storage. [2025-09-28T02:09:07.103512] [INFO ] [MAIN ] DCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:07.103621] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DCO took 0.2s. Estimated remaining: 19m 44s. Rate: 90.0 symbols/min [2025-09-28T02:09:07.345268] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:07.432228] [DEBUG] [LOCAL ] DD: Loaded 53595 existing records from primary storage. [2025-09-28T02:09:07.432913] [INFO ] [MAIN ] DD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:07.433792] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DD took 0.3s. Estimated remaining: 19m 43s. Rate: 90.1 symbols/min [2025-09-28T02:09:07.716923] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:07.787624] [DEBUG] [LOCAL ] DDD: Loaded 51647 existing records from primary storage. [2025-09-28T02:09:07.788124] [INFO ] [MAIN ] DDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:07.788818] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DDD took 0.4s. Estimated remaining: 19m 41s. Rate: 90.1 symbols/min [2025-09-28T02:09:07.854945] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-28T02:09:07.858049] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-28T02:09:07.858436] [INFO ] [REMOTE ] DAC: Full fetch complete (19617 records). [2025-09-28T02:09:07.859580] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-28T02:09:08.368993] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-28T02:09:08.389453] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-28T02:09:08.390097] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-28T02:09:08.390926] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-28T02:09:08.392391] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-28T02:09:08.405798] [DEBUG] [LOCAL ] DAC: Trimmed 19617 records to 12769 (keeping 200 days of data) [2025-09-28T02:09:08.487156] [DEBUG] [LOCAL ] DAC: Primary data saved (12769 records). [2025-09-28T02:09:08.487348] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-28T02:09:08.487480] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DAC took 21.6s. Estimated remaining: 19m 40s. Rate: 90.1 symbols/min [2025-09-28T02:09:08.655767] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-28T02:09:08.986693] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-28T02:09:09.455726] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-28T02:09:10.441231] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-28T02:09:10.454037] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-28T02:09:10.737927] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-28T02:09:11.055719] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-28T02:09:12.115872] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-28T02:09:12.126770] [INFO ] [REMOTE ] CWAN: Full fetch complete (75103 records). [2025-09-28T02:09:12.127054] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-28T02:09:12.491983] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-28T02:09:12.515188] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-28T02:09:12.612184] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-28T02:09:12.612339] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-28T02:09:12.613309] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-28T02:09:12.613421] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-28T02:09:12.615164] [DEBUG] [LOCAL ] CWAN: Trimmed 75103 records to 53154 (keeping 200 days of data) [2025-09-28T02:09:12.928200] [DEBUG] [LOCAL ] CWAN: Primary data saved (53154 records). [2025-09-28T02:09:12.928418] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-28T02:09:12.928557] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. CWAN took 30.2s. Estimated remaining: 19m 51s. Rate: 89.3 symbols/min [2025-09-28T02:09:13.796119] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-28T02:09:13.801341] [INFO ] [REMOTE ] DBD: Full fetch complete (30778 records). [2025-09-28T02:09:13.801468] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-28T02:09:14.198340] [DEBUG] [VALIDATOR ] DBD: All expected trading days are present. [2025-09-28T02:09:14.198458] [DEBUG] [VALIDATOR ] DBD: Primary data validation passed. [2025-09-28T02:09:14.198943] [INFO ] [MAIN ] DBD: Fetched primary data is valid. [2025-09-28T02:09:14.199029] [DEBUG] [LOCAL ] DBD: Saving primary data. [2025-09-28T02:09:14.199987] [DEBUG] [LOCAL ] DBD: Trimmed 30778 records to 24109 (keeping 200 days of data) [2025-09-28T02:09:14.339709] [DEBUG] [LOCAL ] DBD: Primary data saved (24109 records). [2025-09-28T02:09:14.339917] [INFO ] [MAIN ] DBD: Full history saved. [2025-09-28T02:09:14.340042] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DBD took 25.0s. Estimated remaining: 19m 52s. Rate: 89.1 symbols/min [2025-09-28T02:09:14.983474] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:15.087954] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:15.139524] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:15.138684] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:15.152774] [DEBUG] [LOCAL ] DDT: Loaded 2117 existing records from primary storage. [2025-09-28T02:09:15.157120] [INFO ] [MAIN ] DDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:15.157361] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 0.8s. Estimated remaining: 19m 52s. Rate: 89.1 symbols/min [2025-09-28T02:09:15.231753] [DEBUG] [LOCAL ] DDS: Loaded 13374 existing records from primary storage. [2025-09-28T02:09:15.278223] [INFO ] [MAIN ] DDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:15.313558] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 1.0s. Estimated remaining: 19m 50s. Rate: 89.2 symbols/min [2025-09-28T02:09:15.376309] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:15.508483] [DEBUG] [LOCAL ] DDL: Loaded 37016 existing records from primary storage. [2025-09-28T02:09:15.523128] [INFO ] [MAIN ] DDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:15.528720] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 1.2s. Estimated remaining: 19m 48s. Rate: 89.3 symbols/min [2025-09-28T02:09:15.529450] [DEBUG] [LOCAL ] DE: Loaded 48397 existing records from primary storage. [2025-09-28T02:09:15.572673] [INFO ] [MAIN ] DE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:15.636195] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:15.650919] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 1.3s. Estimated remaining: 19m 46s. Rate: 89.4 symbols/min [2025-09-28T02:09:15.907947] [DEBUG] [LOCAL ] DEA: Loaded 41860 existing records from primary storage. [2025-09-28T02:09:15.981661] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:15.949100] [INFO ] [MAIN ] DEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:15.988019] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 0.8s. Estimated remaining: 19m 44s. Rate: 89.5 symbols/min [2025-09-28T02:09:16.177520] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:16.183267] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-09-28T02:09:16.182594] [DEBUG] [LOCAL ] DEC: Loaded 31121 existing records from primary storage. [2025-09-28T02:09:16.183378] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-09-28T02:09:16.183744] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-28T02:09:16.184777] [INFO ] [MAIN ] DEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:16.184579] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-28T02:09:16.201727] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-28T02:09:16.201940] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEC took 0.8s. Estimated remaining: 19m 42s. Rate: 89.6 symbols/min [2025-09-28T02:09:16.208269] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-28T02:09:16.416144] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:16.712957] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:16.748664] [DEBUG] [LOCAL ] DECK: Loaded 54078 existing records from primary storage. [2025-09-28T02:09:16.799007] [INFO ] [MAIN ] DECK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:16.822045] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DECK took 1.3s. Estimated remaining: 19m 41s. Rate: 89.6 symbols/min [2025-09-28T02:09:17.093488] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-09-28T02:09:17.158996] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:09:17.159270] [INFO ] [MAIN ] DELL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:17.199748] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-28T02:09:17.206525] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DELL took 1.2s. Estimated remaining: 19m 40s. Rate: 89.7 symbols/min [2025-09-28T02:09:17.296149] [DEBUG] [LOCAL ] DEO: Loaded 49777 existing records from primary storage. [2025-09-28T02:09:17.321906] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:17.327454] [INFO ] [MAIN ] DEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:17.365063] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DEO took 1.2s. Estimated remaining: 19m 38s. Rate: 89.8 symbols/min [2025-09-28T02:09:17.569337] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:17.574497] [DEBUG] [LOCAL ] DFIN: No existing data file found in primary storage. [2025-09-28T02:09:17.590806] [WARN ] [MAIN ] DFIN: No existing data found, performing full refresh instead. [2025-09-28T02:09:17.640413] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-28T02:09:17.665107] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:17.665538] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-28T02:09:17.665737] [DEBUG] [LOCAL ] DFP: No existing data file found in primary storage. [2025-09-28T02:09:17.665929] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-09-28T02:09:17.666084] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-28T02:09:17.671322] [WARN ] [MAIN ] DFP: No existing data found, performing full refresh instead. [2025-09-28T02:09:17.678138] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-28T02:09:17.728505] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-28T02:09:17.753272] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-28T02:09:17.767426] [DEBUG] [LOCAL ] DFH: Loaded 33106 existing records from primary storage. [2025-09-28T02:09:17.767550] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-28T02:09:17.792926] [INFO ] [MAIN ] DFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:17.799505] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DFH took 0.9s. Estimated remaining: 19m 36s. Rate: 89.8 symbols/min [2025-09-28T02:09:18.416041] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:18.597849] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:09:18.614466] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-28T02:09:18.722913] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:09:18.723424] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-28T02:09:18.766288] [DEBUG] [LOCAL ] DG: Loaded 54068 existing records from primary storage. [2025-09-28T02:09:18.766770] [INFO ] [MAIN ] DG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:18.766879] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DG took 0.9s. Estimated remaining: 19m 36s. Rate: 89.8 symbols/min [2025-09-28T02:09:18.959685] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:18.992129] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-28T02:09:19.002093] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-28T02:09:19.039480] [DEBUG] [LOCAL ] DGX: Loaded 45736 existing records from primary storage. [2025-09-28T02:09:19.039920] [INFO ] [MAIN ] DGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:19.040673] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DGX took 0.3s. Estimated remaining: 19m 35s. Rate: 89.8 symbols/min [2025-09-28T02:09:19.220022] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:19.220248] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-09-28T02:09:19.220321] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-09-28T02:09:19.220438] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-28T02:09:19.220510] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-28T02:09:19.220594] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-09-28T02:09:19.220687] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-28T02:09:19.626196] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:09:19.627779] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-28T02:09:19.643746] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-28T02:09:19.645013] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-28T02:09:19.646571] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-28T02:09:19.654496] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-28T02:09:20.425248] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-28T02:09:20.428378] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-28T02:09:20.509555] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-28T02:09:20.514456] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-28T02:09:20.690290] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-28T02:09:20.711306] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-28T02:09:20.716118] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-28T02:09:20.716951] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-28T02:09:21.160910] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-28T02:09:21.283671] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-28T02:09:21.455729] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-28T02:09:21.607970] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-28T02:09:22.070124] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-28T02:09:22.255738] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-28T02:09:22.468867] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-28T02:09:23.055724] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-28T02:09:23.484012] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-28T02:09:23.855772] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-28T02:09:24.031661] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-28T02:09:24.655716] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-28T02:09:24.688245] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-28T02:09:25.455734] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-28T02:09:25.911801] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-28T02:09:26.255746] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-28T02:09:26.599255] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-28T02:09:27.055803] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-28T02:09:27.855720] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-28T02:09:27.988688] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-28T02:09:28.009161] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-28T02:09:28.655743] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-28T02:09:29.144101] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-28T02:09:29.456621] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-28T02:09:29.458412] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-28T02:09:30.257461] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-28T02:09:30.261257] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-28T02:09:31.055758] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-28T02:09:31.855744] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-28T02:09:32.016153] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-28T02:09:32.144030] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-28T02:09:32.655790] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-28T02:09:32.743867] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-28T02:09:33.455810] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-28T02:09:34.256616] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-28T02:09:34.259931] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-28T02:09:34.300040] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-28T02:09:35.055755] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-28T02:09:35.409439] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-28T02:09:35.855742] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-28T02:09:36.658936] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-28T02:09:36.665084] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-28T02:09:36.885473] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-28T02:09:37.455717] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-28T02:09:37.516401] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-28T02:09:38.255735] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-28T02:09:38.523189] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-28T02:09:39.055786] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-28T02:09:39.855719] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-28T02:09:40.078215] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-28T02:09:40.252174] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-28T02:09:40.655706] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-28T02:09:40.738321] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-28T02:09:41.455726] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-28T02:09:41.936323] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-28T02:09:41.941245] [INFO ] [REMOTE ] DFIN: Full fetch complete (33624 records). [2025-09-28T02:09:41.941360] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-28T02:09:42.257677] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-28T02:09:42.319338] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-28T02:09:42.381700] [INFO ] [REMOTE ] DFP: Full fetch complete (16147 records). [2025-09-28T02:09:42.382014] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-28T02:09:42.382378] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-28T02:09:42.382248] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-28T02:09:42.383099] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-28T02:09:42.383508] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-28T02:09:42.499031] [DEBUG] [LOCAL ] DFIN: Trimmed 33624 records to 23650 (keeping 200 days of data) [2025-09-28T02:09:42.938983] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-28T02:09:42.944050] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-28T02:09:42.946392] [DEBUG] [LOCAL ] DFIN: Primary data saved (23650 records). [2025-09-28T02:09:42.946957] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-28T02:09:42.947190] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-28T02:09:42.947319] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-28T02:09:42.947536] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFIN took 25.7s. Estimated remaining: 20m 41s. Rate: 85.0 symbols/min [2025-09-28T02:09:42.988632] [DEBUG] [LOCAL ] DFP: Trimmed 16147 records to 11771 (keeping 200 days of data) [2025-09-28T02:09:43.064803] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-28T02:09:43.201949] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:43.206197] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-09-28T02:09:43.224861] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-09-28T02:09:43.226712] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-28T02:09:43.228529] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-28T02:09:43.229789] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-28T02:09:43.230176] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-28T02:09:43.228113] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-28T02:09:43.274986] [INFO ] [REMOTE ] DHF: Full fetch complete (29519 records). [2025-09-28T02:09:43.297194] [DEBUG] [LOCAL ] DFP: Primary data saved (11771 records). [2025-09-28T02:09:43.329324] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-28T02:09:43.329241] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-28T02:09:43.348002] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DFP took 26.0s. Estimated remaining: 20m 39s. Rate: 85.1 symbols/min [2025-09-28T02:09:44.001236] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:44.056467] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:09:44.093445] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-28T02:09:44.264603] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-28T02:09:44.264749] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-28T02:09:44.265117] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-28T02:09:44.265199] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-28T02:09:44.266199] [DEBUG] [LOCAL ] DHF: Trimmed 29519 records to 20835 (keeping 200 days of data) [2025-09-28T02:09:44.412077] [DEBUG] [LOCAL ] DHR: Loaded 54139 existing records from primary storage. [2025-09-28T02:09:44.422214] [INFO ] [MAIN ] DHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:44.422038] [DEBUG] [LOCAL ] DHF: Primary data saved (20835 records). [2025-09-28T02:09:44.422992] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DHR took 1.1s. Estimated remaining: 20m 39s. Rate: 85.0 symbols/min [2025-09-28T02:09:44.457562] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-28T02:09:44.493416] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DHF took 25.5s. Estimated remaining: 20m 37s. Rate: 85.1 symbols/min [2025-09-28T02:09:44.748114] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:44.813356] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:44.833575] [DEBUG] [LOCAL ] DHX: Loaded 13404 existing records from primary storage. [2025-09-28T02:09:44.834210] [INFO ] [MAIN ] DHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:44.834362] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHX took 0.3s. Estimated remaining: 20m 35s. Rate: 85.2 symbols/min [2025-09-28T02:09:45.047447] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:45.064097] [DEBUG] [LOCAL ] DHT: Loaded 48583 existing records from primary storage. [2025-09-28T02:09:45.065007] [INFO ] [MAIN ] DHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:45.065140] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHT took 0.6s. Estimated remaining: 20m 33s. Rate: 85.3 symbols/min [2025-09-28T02:09:45.215502] [DEBUG] [LOCAL ] DIAX: Loaded 12780 existing records from primary storage. [2025-09-28T02:09:45.234533] [INFO ] [MAIN ] DIAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:45.261395] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DIAX took 0.4s. Estimated remaining: 20m 31s. Rate: 85.4 symbols/min [2025-09-28T02:09:45.275843] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-28T02:09:45.321870] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:45.399446] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-28T02:09:45.504608] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:45.531389] [DEBUG] [LOCAL ] DIN: Loaded 37823 existing records from primary storage. [2025-09-28T02:09:45.531882] [INFO ] [MAIN ] DIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:45.531988] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DIN took 0.5s. Estimated remaining: 20m 29s. Rate: 85.5 symbols/min [2025-09-28T02:09:45.759468] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:45.780219] [DEBUG] [LOCAL ] DINO: Loaded 53729 existing records from primary storage. [2025-09-28T02:09:45.780723] [INFO ] [MAIN ] DINO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:45.781584] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DINO took 0.5s. Estimated remaining: 20m 27s. Rate: 85.6 symbols/min [2025-09-28T02:09:45.997917] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:45.998289] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-28T02:09:45.998714] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-28T02:09:45.998937] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-28T02:09:45.999172] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-28T02:09:45.999344] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-28T02:09:45.999597] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-28T02:09:46.131789] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-09-28T02:09:46.148408] [INFO ] [MAIN ] DIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:09:46.179579] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIS took 0.6s. Estimated remaining: 20m 25s. Rate: 85.6 symbols/min [2025-09-28T02:09:46.506302] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-28T02:09:46.580981] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-28T02:09:46.641312] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:09:46.654083] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-28T02:09:46.678725] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:46.680404] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-09-28T02:09:46.680606] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-09-28T02:09:46.680791] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-28T02:09:46.680916] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-28T02:09:46.681028] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-28T02:09:46.681108] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-28T02:09:47.068806] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-28T02:09:47.084203] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-28T02:09:47.139204] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:09:47.142149] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-28T02:09:47.151955] [INFO ] [REMOTE ] DEI: Full fetch complete (69642 records). [2025-09-28T02:09:47.152145] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-28T02:09:47.568537] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-28T02:09:47.593080] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-28T02:09:47.593200] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-28T02:09:47.593982] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-28T02:09:47.594068] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-28T02:09:47.595517] [DEBUG] [LOCAL ] DEI: Trimmed 69642 records to 49204 (keeping 200 days of data) [2025-09-28T02:09:47.876290] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-28T02:09:47.911456] [DEBUG] [LOCAL ] DEI: Primary data saved (49204 records). [2025-09-28T02:09:47.911680] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-28T02:09:47.911806] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DEI took 32.2s. Estimated remaining: 20m 28s. Rate: 85.4 symbols/min [2025-09-28T02:09:48.113471] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:09:48.113700] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-09-28T02:09:48.113776] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-09-28T02:09:48.113894] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-28T02:09:48.113968] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-28T02:09:48.114051] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-09-28T02:09:48.114121] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-28T02:09:48.510421] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:09:48.546608] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-28T02:09:48.655758] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-28T02:09:49.156367] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-28T02:09:49.455712] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-28T02:09:49.652983] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-28T02:09:49.895141] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-28T02:09:50.255716] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-28T02:09:51.055736] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-28T02:09:51.107568] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-28T02:09:51.855783] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-28T02:09:52.655726] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-28T02:09:52.914534] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-28T02:09:52.980936] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-28T02:09:53.455771] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-28T02:09:54.197746] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-28T02:09:54.255736] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-28T02:09:54.790812] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-28T02:09:55.055729] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-28T02:09:55.362520] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-28T02:09:55.806007] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-28T02:09:55.855717] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-28T02:09:56.655742] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-28T02:09:57.455741] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-28T02:09:57.537308] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-28T02:09:58.005104] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-28T02:09:58.028122] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-28T02:09:58.255720] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-28T02:09:59.055698] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-28T02:09:59.354034] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-28T02:09:59.426055] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-28T02:09:59.855775] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-28T02:10:00.128288] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-28T02:10:00.655785] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-28T02:10:01.455749] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-28T02:10:02.255772] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-28T02:10:02.486156] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-28T02:10:02.541287] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-28T02:10:03.055807] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-28T02:10:03.209598] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-28T02:10:03.502041] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-28T02:10:03.855742] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-28T02:10:04.655732] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-28T02:10:05.461485] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-28T02:10:05.489088] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-28T02:10:05.856275] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-28T02:10:05.857779] [INFO ] [REMOTE ] DIVY: Full fetch complete (1720 records). [2025-09-28T02:10:05.858142] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-28T02:10:06.098999] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:10:06.100225] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:10:06.100310] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:10:06.100412] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-28T02:10:06.100527] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-28T02:10:06.100604] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-28T02:10:06.100872] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-28T02:10:06.101002] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIVY took 20.3s. Estimated remaining: 21m 16s. Rate: 82.2 symbols/min [2025-09-28T02:10:06.258921] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-28T02:10:06.295706] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:06.374528] [DEBUG] [LOCAL ] DKS: Loaded 50579 existing records from primary storage. [2025-09-28T02:10:06.375031] [INFO ] [MAIN ] DKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:06.376239] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DKS took 0.3s. Estimated remaining: 21m 14s. Rate: 82.2 symbols/min [2025-09-28T02:10:06.530151] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-28T02:10:06.614010] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:06.657700] [DEBUG] [LOCAL ] DLB: Loaded 32601 existing records from primary storage. [2025-09-28T02:10:06.658023] [INFO ] [MAIN ] DLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:06.658124] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DLB took 0.3s. Estimated remaining: 21m 12s. Rate: 82.3 symbols/min [2025-09-28T02:10:06.850092] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:06.850309] [DEBUG] [LOCAL ] DLNG: No existing data file found in primary storage. [2025-09-28T02:10:06.850392] [WARN ] [MAIN ] DLNG: No existing data found, performing full refresh instead. [2025-09-28T02:10:06.850545] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-28T02:10:06.850664] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-28T02:10:06.850771] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-09-28T02:10:06.850854] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-28T02:10:07.060970] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-28T02:10:07.244762] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:10:07.272560] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-28T02:10:07.855725] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-28T02:10:08.568698] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-28T02:10:08.655695] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-28T02:10:08.764210] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-28T02:10:09.455721] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-28T02:10:09.737059] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-28T02:10:10.255738] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-28T02:10:11.055724] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-28T02:10:11.072867] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-28T02:10:11.442399] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-28T02:10:11.855752] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-28T02:10:11.941974] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-28T02:10:12.655764] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-28T02:10:13.455748] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-28T02:10:13.721658] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-28T02:10:14.255713] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-28T02:10:14.469392] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-28T02:10:14.528826] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-28T02:10:15.055779] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-28T02:10:15.855694] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-28T02:10:15.953962] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-28T02:10:15.957632] [INFO ] [REMOTE ] DKL: Full fetch complete (29061 records). [2025-09-28T02:10:15.957828] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-28T02:10:16.353035] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-28T02:10:16.404997] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-28T02:10:16.405535] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-28T02:10:16.406101] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-28T02:10:16.406541] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-28T02:10:16.407495] [DEBUG] [LOCAL ] DKL: Trimmed 29061 records to 19229 (keeping 200 days of data) [2025-09-28T02:10:16.536434] [DEBUG] [LOCAL ] DKL: Primary data saved (19229 records). [2025-09-28T02:10:16.536630] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-28T02:10:16.540666] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKL took 28.6s. Estimated remaining: 21m 37s. Rate: 80.7 symbols/min [2025-09-28T02:10:16.660839] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-28T02:10:16.734959] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:16.735179] [DEBUG] [LOCAL ] DLR: No existing data file found in primary storage. [2025-09-28T02:10:16.735259] [WARN ] [MAIN ] DLR: No existing data found, performing full refresh instead. [2025-09-28T02:10:16.735397] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-28T02:10:16.735471] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-28T02:10:16.735557] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-09-28T02:10:16.735666] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-28T02:10:17.129561] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:10:17.306291] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-28T02:10:17.316596] [INFO ] [REMOTE ] DK: Full fetch complete (70726 records). [2025-09-28T02:10:17.316859] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-28T02:10:17.456255] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-28T02:10:17.536294] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-28T02:10:17.763621] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-28T02:10:17.763777] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-28T02:10:17.764922] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-28T02:10:17.765015] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-28T02:10:17.766618] [DEBUG] [LOCAL ] DK: Trimmed 70726 records to 50093 (keeping 200 days of data) [2025-09-28T02:10:18.084084] [DEBUG] [LOCAL ] DK: Primary data saved (50093 records). [2025-09-28T02:10:18.084281] [INFO ] [MAIN ] DK: Full history saved. [2025-09-28T02:10:18.084431] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DK took 31.9s. Estimated remaining: 21m 38s. Rate: 80.6 symbols/min [2025-09-28T02:10:18.259203] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-28T02:10:18.280677] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:18.318734] [DEBUG] [LOCAL ] DLX: Loaded 29284 existing records from primary storage. [2025-09-28T02:10:18.319157] [INFO ] [MAIN ] DLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:18.319668] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DLX took 0.2s. Estimated remaining: 21m 36s. Rate: 80.6 symbols/min [2025-09-28T02:10:18.563146] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:18.588438] [DEBUG] [LOCAL ] DLY: Loaded 19800 existing records from primary storage. [2025-09-28T02:10:18.588784] [INFO ] [MAIN ] DLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:18.588892] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLY took 0.3s. Estimated remaining: 21m 34s. Rate: 80.7 symbols/min [2025-09-28T02:10:18.774021] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:18.774320] [DEBUG] [LOCAL ] DMA: No existing data file found in primary storage. [2025-09-28T02:10:18.774400] [WARN ] [MAIN ] DMA: No existing data found, performing full refresh instead. [2025-09-28T02:10:18.774523] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-28T02:10:18.774599] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-28T02:10:18.774738] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-09-28T02:10:18.774824] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-28T02:10:19.067343] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-28T02:10:19.164680] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:10:19.760231] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-28T02:10:19.778552] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-28T02:10:19.855709] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-28T02:10:20.163992] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-28T02:10:20.647938] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-28T02:10:20.655685] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-28T02:10:21.333314] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-28T02:10:21.455736] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-28T02:10:22.255731] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-28T02:10:23.055710] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-28T02:10:23.529588] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-28T02:10:23.720771] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-28T02:10:23.855685] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-28T02:10:24.197827] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-28T02:10:24.655764] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-28T02:10:25.265841] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-28T02:10:25.455780] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-28T02:10:25.800370] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-28T02:10:25.811579] [INFO ] [REMOTE ] DHI: Full fetch complete (77226 records). [2025-09-28T02:10:25.811790] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-28T02:10:26.256905] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-28T02:10:26.257541] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-28T02:10:26.258329] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-28T02:10:26.259241] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-28T02:10:26.259510] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-28T02:10:26.261493] [DEBUG] [LOCAL ] DHI: Trimmed 77226 records to 54147 (keeping 200 days of data) [2025-09-28T02:10:26.621365] [DEBUG] [LOCAL ] DHI: Primary data saved (54147 records). [2025-09-28T02:10:26.621607] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-28T02:10:26.621789] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DHI took 43.7s. Estimated remaining: 21m 53s. Rate: 79.5 symbols/min [2025-09-28T02:10:26.818232] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:26.852541] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-28T02:10:26.868159] [DEBUG] [LOCAL ] DMB: Loaded 10254 existing records from primary storage. [2025-09-28T02:10:26.869332] [INFO ] [MAIN ] DMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:26.869462] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DMB took 0.2s. Estimated remaining: 21m 51s. Rate: 79.6 symbols/min [2025-09-28T02:10:26.990232] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-28T02:10:27.056214] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-28T02:10:27.076887] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:27.090530] [DEBUG] [LOCAL ] DMO: Loaded 9981 existing records from primary storage. [2025-09-28T02:10:27.091295] [INFO ] [MAIN ] DMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:27.091399] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DMO took 0.2s. Estimated remaining: 21m 49s. Rate: 79.7 symbols/min [2025-09-28T02:10:27.277917] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:27.278176] [DEBUG] [LOCAL ] DNA: No existing data file found in primary storage. [2025-09-28T02:10:27.278253] [WARN ] [MAIN ] DNA: No existing data found, performing full refresh instead. [2025-09-28T02:10:27.278373] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-28T02:10:27.278446] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-28T02:10:27.278531] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-09-28T02:10:27.278602] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-28T02:10:27.689739] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:10:27.825777] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-28T02:10:27.855687] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-28T02:10:28.503209] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-28T02:10:28.655790] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-28T02:10:29.257760] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-28T02:10:29.259494] [INFO ] [REMOTE ] DLNG: Full fetch complete (11982 records). [2025-09-28T02:10:29.259595] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-28T02:10:29.465617] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-28T02:10:29.651179] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-28T02:10:29.651309] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-28T02:10:29.651617] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-28T02:10:29.651730] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-28T02:10:29.652399] [DEBUG] [LOCAL ] DLNG: Trimmed 11982 records to 6276 (keeping 200 days of data) [2025-09-28T02:10:29.693743] [DEBUG] [LOCAL ] DLNG: Primary data saved (6276 records). [2025-09-28T02:10:29.693933] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-28T02:10:29.694119] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLNG took 23.0s. Estimated remaining: 21m 53s. Rate: 79.4 symbols/min [2025-09-28T02:10:29.874115] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:29.927250] [DEBUG] [LOCAL ] DNOW: Loaded 44205 existing records from primary storage. [2025-09-28T02:10:29.927763] [INFO ] [MAIN ] DNOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:29.928502] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DNOW took 0.2s. Estimated remaining: 21m 51s. Rate: 79.4 symbols/min [2025-09-28T02:10:30.123679] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:30.168027] [DEBUG] [LOCAL ] DNP: Loaded 33786 existing records from primary storage. [2025-09-28T02:10:30.168377] [INFO ] [MAIN ] DNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:30.169014] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DNP took 0.2s. Estimated remaining: 21m 49s. Rate: 79.5 symbols/min [2025-09-28T02:10:30.260931] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-28T02:10:30.374947] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:30.434331] [DEBUG] [LOCAL ] DOC: Loaded 54317 existing records from primary storage. [2025-09-28T02:10:30.434825] [INFO ] [MAIN ] DOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:30.435519] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DOC took 0.3s. Estimated remaining: 21m 47s. Rate: 79.6 symbols/min [2025-09-28T02:10:31.055803] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-28T02:10:31.315943] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-28T02:10:31.372405] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-28T02:10:31.855735] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-28T02:10:32.090004] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-28T02:10:32.655734] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-28T02:10:33.455763] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-28T02:10:33.572359] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-28T02:10:34.025263] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-28T02:10:34.179729] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-28T02:10:34.255757] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-28T02:10:35.055773] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-28T02:10:35.855709] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-28T02:10:35.986215] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-28T02:10:36.550923] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-28T02:10:36.655751] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-28T02:10:36.965463] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-28T02:10:37.143373] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-28T02:10:37.455740] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-28T02:10:38.255759] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-28T02:10:39.055739] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-28T02:10:39.198210] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-28T02:10:39.681022] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-28T02:10:39.855785] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-28T02:10:40.131616] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-28T02:10:40.524105] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-28T02:10:40.655730] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-28T02:10:41.455751] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-28T02:10:42.255707] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-28T02:10:42.447115] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-28T02:10:42.854675] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-28T02:10:42.856706] [INFO ] [REMOTE ] DMA: Full fetch complete (6612 records). [2025-09-28T02:10:42.856859] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-28T02:10:43.063150] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-28T02:10:43.268468] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-28T02:10:43.268774] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-28T02:10:43.269056] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-28T02:10:43.269424] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-28T02:10:43.270096] [DEBUG] [LOCAL ] DMA: Trimmed 6612 records to 4604 (keeping 200 days of data) [2025-09-28T02:10:43.300354] [DEBUG] [LOCAL ] DMA: Primary data saved (4604 records). [2025-09-28T02:10:43.300616] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-28T02:10:43.300796] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DMA took 24.7s. Estimated remaining: 22m 19s. Rate: 77.7 symbols/min [2025-09-28T02:10:43.371997] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-28T02:10:43.855752] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-28T02:10:44.655433] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-28T02:10:44.666923] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-28T02:10:45.649189] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-28T02:10:45.660186] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-28T02:10:46.499810] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-28T02:10:46.510121] [INFO ] [REMOTE ] DLR: Full fetch complete (74158 records). [2025-09-28T02:10:46.510341] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-28T02:10:46.950915] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-28T02:10:46.951056] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-28T02:10:46.951968] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-28T02:10:46.952063] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-28T02:10:46.953799] [DEBUG] [LOCAL ] DLR: Trimmed 74158 records to 51825 (keeping 200 days of data) [2025-09-28T02:10:47.311478] [DEBUG] [LOCAL ] DLR: Primary data saved (51825 records). [2025-09-28T02:10:47.311757] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-28T02:10:47.311914] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DLR took 30.8s. Estimated remaining: 22m 27s. Rate: 77.1 symbols/min [2025-09-28T02:10:47.351148] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-28T02:10:47.361924] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-28T02:10:49.495777] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-28T02:10:49.507789] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-28T02:10:51.525801] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-28T02:10:51.536936] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-28T02:10:53.405072] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-28T02:10:53.415510] [INFO ] [REMOTE ] DNA: Full fetch complete (70848 records). [2025-09-28T02:10:53.415724] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-28T02:10:53.974609] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-28T02:10:53.974818] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-28T02:10:53.976557] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-28T02:10:53.976772] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-28T02:10:53.979063] [DEBUG] [LOCAL ] DNA: Trimmed 70848 records to 48990 (keeping 200 days of data) [2025-09-28T02:10:54.337437] [DEBUG] [LOCAL ] DNA: Primary data saved (48990 records). [2025-09-28T02:10:54.337756] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-28T02:10:54.337882] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DNA took 27.2s. Estimated remaining: 22m 43s. Rate: 76.2 symbols/min [2025-09-28T02:10:55.128917] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:55.140829] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:55.190350] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:55.194716] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:55.247479] [DEBUG] [LOCAL ] DOUG: Loaded 35254 existing records from primary storage. [2025-09-28T02:10:55.249733] [INFO ] [MAIN ] DOUG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:55.250162] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOUG took 0.9s. Estimated remaining: 22m 43s. Rate: 76.2 symbols/min [2025-09-28T02:10:55.429330] [DEBUG] [LOCAL ] DOCS: Loaded 51956 existing records from primary storage. [2025-09-28T02:10:55.441623] [DEBUG] [LOCAL ] DOCN: Loaded 51245 existing records from primary storage. [2025-09-28T02:10:55.468271] [INFO ] [MAIN ] DOCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:55.468983] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOCS took 1.1s. Estimated remaining: 22m 40s. Rate: 76.3 symbols/min [2025-09-28T02:10:55.469325] [INFO ] [MAIN ] DOCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:55.476156] [DEBUG] [LOCAL ] DOLE: Loaded 38568 existing records from primary storage. [2025-09-28T02:10:55.505367] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOCN took 1.2s. Estimated remaining: 22m 38s. Rate: 76.4 symbols/min [2025-09-28T02:10:55.601412] [INFO ] [MAIN ] DOLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:55.636381] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:55.661809] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOLE took 1.3s. Estimated remaining: 22m 35s. Rate: 76.5 symbols/min [2025-09-28T02:10:55.991170] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:56.179497] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:56.153679] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:56.210414] [DEBUG] [LOCAL ] DOV: Loaded 46376 existing records from primary storage. [2025-09-28T02:10:56.211196] [INFO ] [MAIN ] DOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:56.211373] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DOV took 0.9s. Estimated remaining: 22m 34s. Rate: 76.5 symbols/min [2025-09-28T02:10:56.252403] [DEBUG] [LOCAL ] DPG: Loaded 13683 existing records from primary storage. [2025-09-28T02:10:56.269062] [INFO ] [MAIN ] DPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:56.275115] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DPG took 0.6s. Estimated remaining: 22m 31s. Rate: 76.6 symbols/min [2025-09-28T02:10:56.625733] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:56.593455] [DEBUG] [LOCAL ] DQ: Loaded 43880 existing records from primary storage. [2025-09-28T02:10:56.642705] [INFO ] [MAIN ] DQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:56.650696] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-09-28T02:10:56.651734] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DQ took 0.9s. Estimated remaining: 22m 29s. Rate: 76.7 symbols/min [2025-09-28T02:10:56.684036] [INFO ] [MAIN ] DOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:56.684698] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DOW took 1.2s. Estimated remaining: 22m 26s. Rate: 76.8 symbols/min [2025-09-28T02:10:56.786008] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:57.168608] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:57.185365] [DEBUG] [LOCAL ] DRD: Loaded 37397 existing records from primary storage. [2025-09-28T02:10:57.209107] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:57.209695] [INFO ] [MAIN ] DRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:57.210137] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 1.0s. Estimated remaining: 22m 25s. Rate: 76.8 symbols/min [2025-09-28T02:10:57.313945] [DEBUG] [LOCAL ] DRH: Loaded 51205 existing records from primary storage. [2025-09-28T02:10:57.345794] [INFO ] [MAIN ] DRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:57.346631] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRH took 1.1s. Estimated remaining: 22m 22s. Rate: 76.9 symbols/min [2025-09-28T02:10:57.352526] [DEBUG] [LOCAL ] DRLL: Loaded 9737 existing records from primary storage. [2025-09-28T02:10:57.390383] [INFO ] [MAIN ] DRLL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:57.428131] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRLL took 0.7s. Estimated remaining: 22m 20s. Rate: 77.0 symbols/min [2025-09-28T02:10:57.500722] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:57.683839] [DEBUG] [LOCAL ] DRI: Loaded 48554 existing records from primary storage. [2025-09-28T02:10:57.758090] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:57.754358] [INFO ] [MAIN ] DRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:57.765028] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 1.1s. Estimated remaining: 22m 18s. Rate: 77.1 symbols/min [2025-09-28T02:10:57.956767] [DEBUG] [LOCAL ] DSM: Loaded 15895 existing records from primary storage. [2025-09-28T02:10:57.988721] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:58.008900] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-09-28T02:10:58.010418] [INFO ] [MAIN ] DSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:58.016127] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSM took 0.7s. Estimated remaining: 22m 16s. Rate: 77.2 symbols/min [2025-09-28T02:10:58.055179] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-09-28T02:10:58.033002] [DEBUG] [LOCAL ] DSL: Loaded 28651 existing records from primary storage. [2025-09-28T02:10:58.077252] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-28T02:10:58.130467] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:58.135994] [INFO ] [MAIN ] DSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:58.146471] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-28T02:10:58.185985] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-09-28T02:10:58.191556] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-28T02:10:58.174238] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSL took 1.0s. Estimated remaining: 22m 13s. Rate: 77.3 symbols/min [2025-09-28T02:10:58.534988] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:58.536170] [DEBUG] [LOCAL ] DSU: Loaded 22684 existing records from primary storage. [2025-09-28T02:10:58.554599] [INFO ] [MAIN ] DSU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:58.591597] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSU took 0.8s. Estimated remaining: 22m 12s. Rate: 77.3 symbols/min [2025-09-28T02:10:58.753187] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:58.799138] [DEBUG] [LOCAL ] DT: No existing data file found in primary storage. [2025-09-28T02:10:58.863987] [WARN ] [MAIN ] DT: No existing data found, performing full refresh instead. [2025-09-28T02:10:58.933445] [DEBUG] [LOCAL ] DSX: Loaded 24642 existing records from primary storage. [2025-09-28T02:10:58.933817] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-28T02:10:58.964355] [INFO ] [MAIN ] DSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:58.990369] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSX took 0.9s. Estimated remaining: 22m 10s. Rate: 77.4 symbols/min [2025-09-28T02:10:59.001002] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-28T02:10:59.066290] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:59.103265] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-09-28T02:10:59.130628] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-28T02:10:59.354569] [DEBUG] [LOCAL ] DTB: Loaded 4817 existing records from primary storage. [2025-09-28T02:10:59.381780] [INFO ] [MAIN ] DTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:10:59.365219] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:10:59.397496] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DTB took 0.7s. Estimated remaining: 22m 8s. Rate: 77.4 symbols/min [2025-09-28T02:10:59.398032] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-28T02:10:59.591307] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:59.946345] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:10:59.974298] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-28T02:10:59.997942] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:10:59.998400] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-28T02:10:59.999537] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-28T02:10:59.999903] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-28T02:11:00.002701] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-28T02:11:00.003114] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-28T02:11:00.003264] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-28T02:11:00.159452] [DEBUG] [LOCAL ] DTE: Loaded 48557 existing records from primary storage. [2025-09-28T02:11:00.174850] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-28T02:11:00.187818] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-28T02:11:00.198740] [INFO ] [MAIN ] DTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:00.253027] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTE took 1.2s. Estimated remaining: 22m 7s. Rate: 77.4 symbols/min [2025-09-28T02:11:00.635927] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:11:00.666308] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:00.667293] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-28T02:11:00.676914] [DEBUG] [LOCAL ] DTG: Loaded 5952 existing records from primary storage. [2025-09-28T02:11:00.677196] [INFO ] [MAIN ] DTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:00.677327] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DTG took 0.4s. Estimated remaining: 22m 6s. Rate: 77.5 symbols/min [2025-09-28T02:11:00.786263] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-28T02:11:00.801508] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-28T02:11:00.884215] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:00.884509] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-28T02:11:00.884590] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-28T02:11:00.884793] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-28T02:11:00.884871] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-28T02:11:00.884960] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-28T02:11:00.885047] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-28T02:11:01.321068] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:11:01.321504] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-28T02:11:01.363566] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-28T02:11:01.365150] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-28T02:11:01.405592] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-28T02:11:01.407439] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-28T02:11:01.536112] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:11:01.536537] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-28T02:11:01.537148] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:11:01.537233] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-09-28T02:11:01.537307] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:11:01.537386] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-28T02:11:01.537488] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-28T02:11:01.537703] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-28T02:11:01.537814] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-28T02:11:01.537907] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTK took 0.9s. Estimated remaining: 22m 5s. Rate: 77.5 symbols/min [2025-09-28T02:11:01.738311] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:01.774674] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-28T02:11:01.787057] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-28T02:11:01.839067] [DEBUG] [LOCAL ] DTM: Loaded 45043 existing records from primary storage. [2025-09-28T02:11:01.839549] [INFO ] [MAIN ] DTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:01.840295] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTM took 0.3s. Estimated remaining: 22m 3s. Rate: 77.5 symbols/min [2025-09-28T02:11:01.913831] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-28T02:11:01.956082] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-28T02:11:02.065737] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-28T02:11:02.091364] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:02.093081] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-28T02:11:02.104392] [DEBUG] [LOCAL ] DTW: Loaded 4923 existing records from primary storage. [2025-09-28T02:11:02.105123] [INFO ] [MAIN ] DTW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:02.105233] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTW took 0.3s. Estimated remaining: 22m 1s. Rate: 77.6 symbols/min [2025-09-28T02:11:02.346837] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:02.349444] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-28T02:11:02.350949] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-28T02:11:02.413610] [DEBUG] [LOCAL ] DUK: Loaded 54238 existing records from primary storage. [2025-09-28T02:11:02.414117] [INFO ] [MAIN ] DUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:02.414821] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DUK took 0.3s. Estimated remaining: 21m 59s. Rate: 77.7 symbols/min [2025-09-28T02:11:02.608605] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:02.618917] [DEBUG] [LOCAL ] DUKB: Loaded 6414 existing records from primary storage. [2025-09-28T02:11:02.619222] [INFO ] [MAIN ] DUKB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:02.619327] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DUKB took 0.2s. Estimated remaining: 21m 57s. Rate: 77.8 symbols/min [2025-09-28T02:11:02.718839] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-28T02:11:02.738282] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-28T02:11:02.816698] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:02.822801] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-28T02:11:02.824070] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-28T02:11:02.879084] [DEBUG] [LOCAL ] DV: Loaded 52038 existing records from primary storage. [2025-09-28T02:11:02.879587] [INFO ] [MAIN ] DV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:02.880367] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DV took 0.3s. Estimated remaining: 21m 55s. Rate: 77.8 symbols/min [2025-09-28T02:11:03.074840] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:03.123807] [DEBUG] [LOCAL ] DVA: Loaded 41877 existing records from primary storage. [2025-09-28T02:11:03.124190] [INFO ] [MAIN ] DVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:03.125011] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DVA took 0.2s. Estimated remaining: 21m 53s. Rate: 77.9 symbols/min [2025-09-28T02:11:03.311402] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:03.314876] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-28T02:11:03.316555] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-28T02:11:03.385971] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-28T02:11:03.385741] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-09-28T02:11:03.387870] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-28T02:11:03.388330] [INFO ] [MAIN ] DVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:03.390402] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DVN took 0.3s. Estimated remaining: 21m 51s. Rate: 78.0 symbols/min [2025-09-28T02:11:03.580033] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:03.612102] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-28T02:11:03.623581] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-28T02:11:03.678839] [DEBUG] [LOCAL ] DX: Loaded 53228 existing records from primary storage. [2025-09-28T02:11:03.679255] [INFO ] [MAIN ] DX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:03.680047] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DX took 0.3s. Estimated remaining: 21m 49s. Rate: 78.1 symbols/min [2025-09-28T02:11:03.851745] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-28T02:11:03.873243] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-28T02:11:03.871874] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:03.877587] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-28T02:11:03.879051] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-28T02:11:03.936833] [DEBUG] [LOCAL ] DXC: Loaded 50456 existing records from primary storage. [2025-09-28T02:11:03.937282] [INFO ] [MAIN ] DXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:03.938407] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DXC took 0.3s. Estimated remaining: 21m 47s. Rate: 78.2 symbols/min [2025-09-28T02:11:04.128327] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:04.169115] [DEBUG] [LOCAL ] DXYZ: Loaded 37246 existing records from primary storage. [2025-09-28T02:11:04.169491] [INFO ] [MAIN ] DXYZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:04.170275] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DXYZ took 0.2s. Estimated remaining: 21m 44s. Rate: 78.2 symbols/min [2025-09-28T02:11:04.273455] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-28T02:11:04.286864] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-28T02:11:04.365171] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:04.367935] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-28T02:11:04.403126] [DEBUG] [LOCAL ] DY: Loaded 30160 existing records from primary storage. [2025-09-28T02:11:04.403520] [INFO ] [MAIN ] DY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:04.403665] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DY took 0.2s. Estimated remaining: 21m 42s. Rate: 78.3 symbols/min [2025-09-28T02:11:04.597699] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:04.640782] [DEBUG] [LOCAL ] E: Loaded 33848 existing records from primary storage. [2025-09-28T02:11:04.641196] [INFO ] [MAIN ] E: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:04.643260] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. E took 0.2s. Estimated remaining: 21m 40s. Rate: 78.4 symbols/min [2025-09-28T02:11:04.679341] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-28T02:11:04.718422] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-28T02:11:04.844916] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:04.889014] [DEBUG] [LOCAL ] EAF: Loaded 44158 existing records from primary storage. [2025-09-28T02:11:04.889442] [INFO ] [MAIN ] EAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:04.889568] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. EAF took 0.2s. Estimated remaining: 21m 38s. Rate: 78.5 symbols/min [2025-09-28T02:11:05.077288] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:05.083226] [DEBUG] [LOCAL ] EAI: Loaded 4008 existing records from primary storage. [2025-09-28T02:11:05.083493] [INFO ] [MAIN ] EAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:05.083615] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. EAI took 0.2s. Estimated remaining: 21m 36s. Rate: 78.6 symbols/min [2025-09-28T02:11:05.245997] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-28T02:11:05.276682] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:05.306297] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-28T02:11:05.345128] [DEBUG] [LOCAL ] EARN: Loaded 30576 existing records from primary storage. [2025-09-28T02:11:05.345619] [INFO ] [MAIN ] EARN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:05.346519] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. EARN took 0.3s. Estimated remaining: 21m 34s. Rate: 78.6 symbols/min [2025-09-28T02:11:05.456323] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-28T02:11:05.534849] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:05.593207] [DEBUG] [LOCAL ] EAT: Loaded 50542 existing records from primary storage. [2025-09-28T02:11:05.593728] [INFO ] [MAIN ] EAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:05.594458] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAT took 0.2s. Estimated remaining: 21m 32s. Rate: 78.7 symbols/min [2025-09-28T02:11:05.786274] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:05.786553] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-09-28T02:11:05.786631] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-09-28T02:11:05.786872] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-28T02:11:05.786954] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-28T02:11:05.787060] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-09-28T02:11:05.787158] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-28T02:11:05.873112] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-28T02:11:05.894578] [INFO ] [REMOTE ] DSMC: Full fetch complete (2888 records). [2025-09-28T02:11:05.909406] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-28T02:11:06.260823] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-28T02:11:06.553338] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:11:06.641432] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-28T02:11:06.641551] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-28T02:11:06.641723] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-28T02:11:06.641805] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-28T02:11:06.642197] [DEBUG] [LOCAL ] DSMC: Trimmed 2888 records to 1974 (keeping 200 days of data) [2025-09-28T02:11:06.655123] [DEBUG] [LOCAL ] DSMC: Primary data saved (1974 records). [2025-09-28T02:11:06.655213] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-28T02:11:06.655317] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. DSMC took 9.1s. Estimated remaining: 21m 32s. Rate: 78.7 symbols/min [2025-09-28T02:11:06.842277] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-28T02:11:07.055726] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-28T02:11:07.656243] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-28T02:11:07.657370] [INFO ] [REMOTE ] DTF: Full fetch complete (2111 records). [2025-09-28T02:11:07.658345] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-28T02:11:07.851896] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:11:07.852183] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:11:07.852304] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:11:07.852420] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-28T02:11:07.852592] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-28T02:11:07.852708] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-28T02:11:07.852869] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-28T02:11:07.852999] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. DTF took 8.5s. Estimated remaining: 21m 32s. Rate: 78.6 symbols/min [2025-09-28T02:11:07.855669] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-28T02:11:08.655745] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-28T02:11:09.662107] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-28T02:11:09.674274] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-28T02:11:10.254935] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-28T02:11:10.264935] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-28T02:11:11.342548] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-28T02:11:11.355105] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-28T02:11:11.406622] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-28T02:11:11.855778] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-28T02:11:13.151972] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-28T02:11:13.164513] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-28T02:11:13.237572] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-28T02:11:13.455781] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-28T02:11:14.793604] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-28T02:11:14.804899] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-28T02:11:14.947330] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-28T02:11:15.055791] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-28T02:11:16.701596] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-28T02:11:16.714268] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-28T02:11:16.841768] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-28T02:11:16.851354] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-28T02:11:18.239242] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-28T02:11:18.252166] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-28T02:11:18.513470] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-28T02:11:18.525483] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-28T02:11:19.573126] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-28T02:11:19.581263] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-28T02:11:19.903114] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-28T02:11:19.914049] [INFO ] [REMOTE ] DT: Full fetch complete (76631 records). [2025-09-28T02:11:19.914240] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-28T02:11:20.333302] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-28T02:11:20.333429] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-28T02:11:20.334243] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-28T02:11:20.334330] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-28T02:11:20.336081] [DEBUG] [LOCAL ] DT: Trimmed 76631 records to 53708 (keeping 200 days of data) [2025-09-28T02:11:20.649179] [DEBUG] [LOCAL ] DT: Primary data saved (53708 records). [2025-09-28T02:11:20.649374] [INFO ] [MAIN ] DT: Full history saved. [2025-09-28T02:11:20.649493] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. DT took 22.4s. Estimated remaining: 22m 1s. Rate: 76.8 symbols/min [2025-09-28T02:11:21.070299] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-28T02:11:21.080413] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-28T02:11:22.557608] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-28T02:11:22.566141] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-28T02:11:23.864568] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-28T02:11:23.874777] [INFO ] [REMOTE ] EB: Full fetch complete (56499 records). [2025-09-28T02:11:23.874959] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-28T02:11:24.375011] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-28T02:11:24.375137] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-28T02:11:24.375795] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-28T02:11:24.375884] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-28T02:11:24.377174] [DEBUG] [LOCAL ] EB: Trimmed 56499 records to 38017 (keeping 200 days of data) [2025-09-28T02:11:24.585908] [DEBUG] [LOCAL ] EB: Primary data saved (38017 records). [2025-09-28T02:11:24.586081] [INFO ] [MAIN ] EB: Full history saved. [2025-09-28T02:11:24.586197] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EB took 19.0s. Estimated remaining: 22m 9s. Rate: 76.4 symbols/min [2025-09-28T02:11:25.260898] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:25.236096] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:25.294819] [DEBUG] [LOCAL ] EC: No existing data file found in primary storage. [2025-09-28T02:11:25.284017] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:25.300840] [WARN ] [MAIN ] EC: No existing data found, performing full refresh instead. [2025-09-28T02:11:25.306080] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-09-28T02:11:25.328719] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-09-28T02:11:25.311594] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-28T02:11:25.366692] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:25.362574] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-28T02:11:25.362491] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-28T02:11:25.367759] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-09-28T02:11:25.367680] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-28T02:11:25.367867] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-28T02:11:25.368054] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-09-28T02:11:25.391584] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-28T02:11:25.844061] [DEBUG] [LOCAL ] EBS: Loaded 47455 existing records from primary storage. [2025-09-28T02:11:25.908089] [DEBUG] [LOCAL ] EBR: Loaded 43731 existing records from primary storage. [2025-09-28T02:11:25.920331] [INFO ] [MAIN ] EBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:25.909089] [INFO ] [MAIN ] EBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:25.921719] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBR took 1.3s. Estimated remaining: 22m 9s. Rate: 76.3 symbols/min [2025-09-28T02:11:25.943696] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EBS took 1.4s. Estimated remaining: 22m 6s. Rate: 76.4 symbols/min [2025-09-28T02:11:26.238038] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:11:26.279535] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-28T02:11:26.524147] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:26.638358] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:11:26.671218] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:26.672640] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-28T02:11:26.702598] [DEBUG] [LOCAL ] ECAT: Loaded 30092 existing records from primary storage. [2025-09-28T02:11:26.703017] [INFO ] [MAIN ] ECAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:26.703199] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. ECAT took 0.8s. Estimated remaining: 22m 6s. Rate: 76.4 symbols/min [2025-09-28T02:11:26.922893] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:26.924837] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-28T02:11:26.924528] [DEBUG] [LOCAL ] ECC: Loaded 44025 existing records from primary storage. [2025-09-28T02:11:26.925033] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-28T02:11:26.925226] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-28T02:11:26.925499] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-28T02:11:26.925778] [INFO ] [MAIN ] ECC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:11:26.925977] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-28T02:11:26.926116] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. ECC took 0.9s. Estimated remaining: 22m 3s. Rate: 76.5 symbols/min [2025-09-28T02:11:26.926252] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-28T02:11:27.325486] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:27.385961] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-28T02:11:27.419746] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-28T02:11:27.464217] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-28T02:11:27.482540] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-28T02:11:27.482770] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-28T02:11:27.483180] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-28T02:11:27.658422] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:11:27.690767] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-28T02:11:27.773497] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-28T02:11:27.815277] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-28T02:11:28.016392] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:11:28.035745] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-28T02:11:28.038718] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-28T02:11:28.050632] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-28T02:11:28.128501] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-28T02:11:28.129506] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-28T02:11:28.462460] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-28T02:11:28.463548] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-28T02:11:28.649484] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-28T02:11:28.650747] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-28T02:11:28.873058] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-28T02:11:28.877079] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-28T02:11:29.002480] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-28T02:11:29.258578] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-28T02:11:29.455696] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-28T02:11:29.799549] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-28T02:11:29.801526] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-28T02:11:29.850465] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-28T02:11:30.255746] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-28T02:11:30.608286] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-28T02:11:31.055769] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-28T02:11:31.855759] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-28T02:11:32.287818] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-28T02:11:32.655721] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-28T02:11:33.068591] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-28T02:11:33.455727] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-28T02:11:33.702749] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-28T02:11:34.008853] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-28T02:11:34.255753] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-28T02:11:34.855003] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-28T02:11:35.055738] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-28T02:11:35.709623] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-28T02:11:35.855714] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-28T02:11:36.304144] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-28T02:11:36.655771] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-28T02:11:37.455742] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-28T02:11:37.686956] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-28T02:11:37.907066] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-28T02:11:38.255764] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-28T02:11:39.055767] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-28T02:11:39.238982] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-28T02:11:39.394973] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-28T02:11:39.855739] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-28T02:11:40.655771] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-28T02:11:40.999814] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-28T02:11:41.455734] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-28T02:11:41.662094] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-28T02:11:41.792426] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-28T02:11:42.255734] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-28T02:11:42.730793] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-28T02:11:43.055731] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-28T02:11:43.855701] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-28T02:11:44.170198] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-28T02:11:44.212917] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-28T02:11:44.213758] [INFO ] [REMOTE ] ECCC: Full fetch complete (1284 records). [2025-09-28T02:11:44.213871] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-28T02:11:44.406185] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-28T02:11:44.406428] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:11:44.406545] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:11:44.406669] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-28T02:11:44.406847] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-28T02:11:44.406946] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-28T02:11:44.407095] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-28T02:11:44.407239] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECCC took 17.7s. Estimated remaining: 22m 44s. Rate: 74.2 symbols/min [2025-09-28T02:11:44.586777] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:44.587045] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-28T02:11:44.587149] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-28T02:11:44.587319] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-28T02:11:44.587415] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-28T02:11:44.587546] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-28T02:11:44.587639] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-28T02:11:44.660825] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-28T02:11:44.968967] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:11:45.455733] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-28T02:11:45.881551] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-28T02:11:46.255805] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-28T02:11:46.675222] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-28T02:11:47.055801] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-28T02:11:47.404231] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-28T02:11:47.497730] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-28T02:11:47.855816] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-28T02:11:48.207864] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-28T02:11:48.655826] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-28T02:11:48.991118] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-28T02:11:49.455743] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-28T02:11:49.898735] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-28T02:11:49.899866] [INFO ] [REMOTE ] ECCU: Full fetch complete (4460 records). [2025-09-28T02:11:49.899964] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-28T02:11:50.103159] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:11:50.103406] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:11:50.103486] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:11:50.103575] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-28T02:11:50.103706] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-28T02:11:50.103787] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-28T02:11:50.103871] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-28T02:11:50.103968] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECCU took 23.2s. Estimated remaining: 22m 55s. Rate: 73.5 symbols/min [2025-09-28T02:11:50.262748] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-28T02:11:50.301402] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:11:50.301619] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-28T02:11:50.301712] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-28T02:11:50.301979] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-28T02:11:50.302108] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-28T02:11:50.302198] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-28T02:11:50.302271] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-28T02:11:50.702255] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:11:51.055787] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-28T02:11:51.417457] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-28T02:11:51.855703] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-28T02:11:52.068970] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-28T02:11:52.176784] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-28T02:11:52.655723] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-28T02:11:53.017815] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-28T02:11:53.455729] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-28T02:11:54.255719] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-28T02:11:54.392579] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-28T02:11:54.689531] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-28T02:11:55.055727] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-28T02:11:55.855727] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-28T02:11:56.211394] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-28T02:11:56.655693] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-28T02:11:56.811385] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-28T02:11:57.020293] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-28T02:11:57.455730] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-28T02:11:57.803836] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-28T02:11:58.255722] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-28T02:11:58.703793] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-28T02:11:59.055735] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-28T02:11:59.392965] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-28T02:11:59.855724] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-28T02:12:00.655741] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-28T02:12:00.902807] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-28T02:12:00.908210] [INFO ] [REMOTE ] EBF: Full fetch complete (27371 records). [2025-09-28T02:12:00.908409] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-28T02:12:01.333677] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-28T02:12:01.333823] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-28T02:12:01.334280] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-28T02:12:01.334372] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-28T02:12:01.335444] [DEBUG] [LOCAL ] EBF: Trimmed 27371 records to 19635 (keeping 200 days of data) [2025-09-28T02:12:01.455718] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-28T02:12:01.467558] [DEBUG] [LOCAL ] EBF: Primary data saved (19635 records). [2025-09-28T02:12:01.467797] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-28T02:12:01.467926] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. EBF took 36.9s. Estimated remaining: 23m 20s. Rate: 72.2 symbols/min [2025-09-28T02:12:01.596374] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-28T02:12:01.623470] [INFO ] [REMOTE ] ECCW: Full fetch complete (1420 records). [2025-09-28T02:12:01.623669] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-28T02:12:01.845826] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:01.927737] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-28T02:12:01.928061] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:12:01.928137] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:12:01.928214] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-28T02:12:01.928318] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-28T02:12:01.928401] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-28T02:12:01.928603] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-28T02:12:01.928736] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCW took 17.5s. Estimated remaining: 23m 18s. Rate: 72.2 symbols/min [2025-09-28T02:12:02.130197] [DEBUG] [LOCAL ] ECG: Loaded 34619 existing records from primary storage. [2025-09-28T02:12:02.132604] [INFO ] [MAIN ] ECG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:02.152333] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:02.152668] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECG took 0.7s. Estimated remaining: 23m 16s. Rate: 72.3 symbols/min [2025-09-28T02:12:02.263120] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-28T02:12:02.347416] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:02.347810] [DEBUG] [LOCAL ] ECO: No existing data file found in primary storage. [2025-09-28T02:12:02.347888] [WARN ] [MAIN ] ECO: No existing data found, performing full refresh instead. [2025-09-28T02:12:02.348012] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-28T02:12:02.348091] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-28T02:12:02.348173] [DEBUG] [LOCAL ] ECO: No primary data file found to delete. [2025-09-28T02:12:02.348242] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-28T02:12:02.591775] [DEBUG] [LOCAL ] ECL: Loaded 47489 existing records from primary storage. [2025-09-28T02:12:02.660472] [INFO ] [MAIN ] ECL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:02.678830] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECL took 0.7s. Estimated remaining: 23m 14s. Rate: 72.3 symbols/min [2025-09-28T02:12:02.850549] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-28T02:12:02.919406] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:12:02.997459] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:03.037243] [DEBUG] [LOCAL ] ECVT: Loaded 43587 existing records from primary storage. [2025-09-28T02:12:03.037610] [INFO ] [MAIN ] ECVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:03.037766] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECVT took 0.3s. Estimated remaining: 23m 12s. Rate: 72.4 symbols/min [2025-09-28T02:12:03.060930] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-28T02:12:03.232210] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:03.262865] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-28T02:12:03.329229] [DEBUG] [LOCAL ] ED: Loaded 53539 existing records from primary storage. [2025-09-28T02:12:03.329639] [INFO ] [MAIN ] ED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:03.330344] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ED took 0.3s. Estimated remaining: 23m 10s. Rate: 72.5 symbols/min [2025-09-28T02:12:03.528836] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:03.563081] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-28T02:12:03.564782] [DEBUG] [LOCAL ] EDD: Loaded 27470 existing records from primary storage. [2025-09-28T02:12:03.567337] [INFO ] [MAIN ] EDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:03.567543] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. EDD took 0.2s. Estimated remaining: 23m 8s. Rate: 72.5 symbols/min [2025-09-28T02:12:03.760714] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:03.775577] [DEBUG] [LOCAL ] EDF: Loaded 13627 existing records from primary storage. [2025-09-28T02:12:03.775905] [INFO ] [MAIN ] EDF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:03.776011] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. EDF took 0.2s. Estimated remaining: 23m 6s. Rate: 72.6 symbols/min [2025-09-28T02:12:03.860812] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-28T02:12:03.966046] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:03.984499] [DEBUG] [LOCAL ] EDN: Loaded 18501 existing records from primary storage. [2025-09-28T02:12:03.984840] [INFO ] [MAIN ] EDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:03.984943] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. EDN took 0.2s. Estimated remaining: 23m 3s. Rate: 72.7 symbols/min [2025-09-28T02:12:04.173745] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:04.219588] [DEBUG] [LOCAL ] EDU: Loaded 45666 existing records from primary storage. [2025-09-28T02:12:04.220023] [INFO ] [MAIN ] EDU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:04.220694] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EDU took 0.2s. Estimated remaining: 23m 1s. Rate: 72.8 symbols/min [2025-09-28T02:12:04.420072] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:04.456566] [DEBUG] [LOCAL ] EE: Loaded 32973 existing records from primary storage. [2025-09-28T02:12:04.456968] [INFO ] [MAIN ] EE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:04.457527] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EE took 0.2s. Estimated remaining: 22m 59s. Rate: 72.8 symbols/min [2025-09-28T02:12:04.652918] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:04.653208] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-09-28T02:12:04.653295] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-09-28T02:12:04.653427] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-28T02:12:04.653526] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-28T02:12:04.653639] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-28T02:12:04.653752] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-28T02:12:04.660866] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-28T02:12:05.045787] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:12:05.086428] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-28T02:12:05.247675] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-28T02:12:05.455730] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-28T02:12:05.801398] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-28T02:12:06.255774] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-28T02:12:06.630823] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-28T02:12:07.055802] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-28T02:12:07.528507] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-28T02:12:07.855729] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-28T02:12:08.199113] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-28T02:12:08.655733] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-28T02:12:09.135610] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-28T02:12:09.455739] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-28T02:12:10.255717] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-28T02:12:11.055718] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-28T02:12:11.200392] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-28T02:12:11.212593] [INFO ] [REMOTE ] EC: Full fetch complete (71989 records). [2025-09-28T02:12:11.212883] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-28T02:12:11.628345] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-28T02:12:11.673810] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-28T02:12:11.675712] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-28T02:12:11.675840] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-28T02:12:11.683972] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-28T02:12:11.684181] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-28T02:12:11.686742] [DEBUG] [LOCAL ] EC: Trimmed 71989 records to 50056 (keeping 200 days of data) [2025-09-28T02:12:11.895588] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-28T02:12:12.030917] [DEBUG] [LOCAL ] EC: Primary data saved (50056 records). [2025-09-28T02:12:12.031104] [INFO ] [MAIN ] EC: Full history saved. [2025-09-28T02:12:12.031265] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EC took 47.4s. Estimated remaining: 23m 14s. Rate: 72.0 symbols/min [2025-09-28T02:12:12.211595] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:12.224687] [DEBUG] [LOCAL ] EEX: Loaded 12042 existing records from primary storage. [2025-09-28T02:12:12.224948] [INFO ] [MAIN ] EEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:12.225071] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EEX took 0.2s. Estimated remaining: 23m 12s. Rate: 72.1 symbols/min [2025-09-28T02:12:12.411222] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:12.463987] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-28T02:12:12.464923] [DEBUG] [LOCAL ] EFC: Loaded 46944 existing records from primary storage. [2025-09-28T02:12:12.467335] [INFO ] [MAIN ] EFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:12.467981] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EFC took 0.2s. Estimated remaining: 23m 10s. Rate: 72.2 symbols/min [2025-09-28T02:12:12.650015] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:12.650262] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-09-28T02:12:12.650347] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-09-28T02:12:12.650472] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-28T02:12:12.650569] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-28T02:12:12.650688] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-28T02:12:12.650777] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-28T02:12:12.661353] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-28T02:12:13.042554] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:12:13.455724] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-28T02:12:14.102062] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-28T02:12:14.255746] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-28T02:12:14.405697] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-28T02:12:14.901062] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-28T02:12:15.055782] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-28T02:12:15.572913] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-28T02:12:15.855767] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-28T02:12:16.225139] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-28T02:12:16.226250] [INFO ] [REMOTE ] ECCX: Full fetch complete (1503 records). [2025-09-28T02:12:16.226348] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-28T02:12:16.420067] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-28T02:12:16.420338] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:12:16.420414] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:12:16.420498] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-28T02:12:16.420629] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-28T02:12:16.420731] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-28T02:12:16.420817] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-28T02:12:16.420947] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. ECCX took 26.3s. Estimated remaining: 23m 16s. Rate: 71.8 symbols/min [2025-09-28T02:12:16.600501] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:16.600866] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-09-28T02:12:16.600945] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-09-28T02:12:16.601079] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-28T02:12:16.601153] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-28T02:12:16.601242] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-28T02:12:16.601316] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-28T02:12:16.664406] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-28T02:12:16.978877] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:12:17.246999] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-28T02:12:17.455787] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-28T02:12:18.245197] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-28T02:12:18.255669] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-28T02:12:19.004534] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-28T02:12:19.055732] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-28T02:12:19.861292] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-28T02:12:19.860101] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-28T02:12:20.655754] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-28T02:12:21.058747] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-28T02:12:21.231033] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-28T02:12:21.455791] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-28T02:12:21.948157] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-28T02:12:22.255763] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-28T02:12:23.055767] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-28T02:12:23.072517] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-28T02:12:23.674137] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-28T02:12:23.675555] [INFO ] [REMOTE ] EEA: Full fetch complete (3967 records). [2025-09-28T02:12:23.675699] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-28T02:12:23.865941] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-28T02:12:23.875057] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:12:23.876145] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:12:23.876222] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:12:23.876281] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-28T02:12:23.876373] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-28T02:12:23.876449] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-09-28T02:12:23.876536] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-09-28T02:12:23.876637] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EEA took 19.4s. Estimated remaining: 23m 31s. Rate: 71.0 symbols/min [2025-09-28T02:12:24.070495] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:24.128488] [DEBUG] [LOCAL ] EFX: Loaded 45419 existing records from primary storage. [2025-09-28T02:12:24.128913] [INFO ] [MAIN ] EFX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:24.129511] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFX took 0.2s. Estimated remaining: 23m 29s. Rate: 71.0 symbols/min [2025-09-28T02:12:24.314488] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:24.352877] [DEBUG] [LOCAL ] EFXT: Loaded 29755 existing records from primary storage. [2025-09-28T02:12:24.353199] [INFO ] [MAIN ] EFXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:24.353778] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFXT took 0.2s. Estimated remaining: 23m 27s. Rate: 71.1 symbols/min [2025-09-28T02:12:24.531856] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:24.563851] [DEBUG] [LOCAL ] EG: Loaded 29024 existing records from primary storage. [2025-09-28T02:12:24.564202] [INFO ] [MAIN ] EG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:24.564338] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EG took 0.2s. Estimated remaining: 23m 24s. Rate: 71.2 symbols/min [2025-09-28T02:12:24.664766] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-28T02:12:24.758436] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:24.813799] [DEBUG] [LOCAL ] EGO: Loaded 52295 existing records from primary storage. [2025-09-28T02:12:24.814252] [INFO ] [MAIN ] EGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:24.814842] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EGO took 0.3s. Estimated remaining: 23m 22s. Rate: 71.3 symbols/min [2025-09-28T02:12:24.963209] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-28T02:12:25.020883] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:25.056802] [DEBUG] [LOCAL ] EGP: Loaded 31536 existing records from primary storage. [2025-09-28T02:12:25.057172] [INFO ] [MAIN ] EGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:25.057616] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EGP took 0.2s. Estimated remaining: 23m 20s. Rate: 71.3 symbols/min [2025-09-28T02:12:25.241457] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:25.284297] [DEBUG] [LOCAL ] EGY: Loaded 42824 existing records from primary storage. [2025-09-28T02:12:25.284687] [INFO ] [MAIN ] EGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:25.285268] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EGY took 0.2s. Estimated remaining: 23m 17s. Rate: 71.4 symbols/min [2025-09-28T02:12:25.462277] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-28T02:12:25.470891] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:25.514485] [DEBUG] [LOCAL ] EHAB: Loaded 30257 existing records from primary storage. [2025-09-28T02:12:25.514973] [INFO ] [MAIN ] EHAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:25.515085] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EHAB took 0.2s. Estimated remaining: 23m 15s. Rate: 71.5 symbols/min [2025-09-28T02:12:25.705019] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:25.746453] [DEBUG] [LOCAL ] EHC: Loaded 41849 existing records from primary storage. [2025-09-28T02:12:25.746973] [INFO ] [MAIN ] EHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:25.747537] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EHC took 0.2s. Estimated remaining: 23m 13s. Rate: 71.5 symbols/min [2025-09-28T02:12:25.951250] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-28T02:12:25.955132] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:25.974535] [DEBUG] [LOCAL ] EHI: Loaded 10472 existing records from primary storage. [2025-09-28T02:12:25.974893] [INFO ] [MAIN ] EHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:25.975002] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EHI took 0.2s. Estimated remaining: 23m 11s. Rate: 71.6 symbols/min [2025-09-28T02:12:26.159805] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:26.185004] [DEBUG] [LOCAL ] EIC: Loaded 24238 existing records from primary storage. [2025-09-28T02:12:26.185335] [INFO ] [MAIN ] EIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:26.185440] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EIC took 0.2s. Estimated remaining: 23m 8s. Rate: 71.7 symbols/min [2025-09-28T02:12:26.260803] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-28T02:12:26.382856] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:26.383397] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-28T02:12:26.383509] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-28T02:12:26.383690] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-28T02:12:26.383769] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-28T02:12:26.383853] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-28T02:12:26.383939] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-28T02:12:26.692874] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-28T02:12:26.794156] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:12:27.055691] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-28T02:12:27.067956] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-28T02:12:27.592918] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-28T02:12:27.855737] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-28T02:12:28.277566] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-28T02:12:28.655722] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-28T02:12:29.455590] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-28T02:12:29.455682] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-28T02:12:30.250536] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-28T02:12:30.255711] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-28T02:12:31.055759] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-28T02:12:31.305827] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-28T02:12:31.737524] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-28T02:12:31.855789] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-28T02:12:32.655733] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-28T02:12:32.802287] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-28T02:12:33.455723] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-28T02:12:33.632940] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-28T02:12:34.255705] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-28T02:12:34.517316] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-28T02:12:35.055724] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-28T02:12:35.179861] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-28T02:12:35.855783] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-28T02:12:36.187245] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-28T02:12:36.655756] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-28T02:12:36.840774] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-28T02:12:36.983555] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-28T02:12:37.455744] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-28T02:12:38.255719] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-28T02:12:38.397975] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-28T02:12:38.401364] [INFO ] [REMOTE ] EFR: Full fetch complete (18603 records). [2025-09-28T02:12:38.401494] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-28T02:12:38.786982] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-28T02:12:38.787144] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-28T02:12:38.787566] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-28T02:12:38.787674] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-28T02:12:38.788848] [DEBUG] [LOCAL ] EFR: Trimmed 18603 records to 14474 (keeping 200 days of data) [2025-09-28T02:12:38.892842] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-28T02:12:38.895348] [DEBUG] [LOCAL ] EFR: Primary data saved (14474 records). [2025-09-28T02:12:38.899035] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-28T02:12:38.899742] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EFR took 26.4s. Estimated remaining: 23m 35s. Rate: 70.3 symbols/min [2025-09-28T02:12:39.060900] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-28T02:12:39.094320] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:39.094683] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-28T02:12:39.094759] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-28T02:12:39.094892] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-28T02:12:39.094969] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-28T02:12:39.095068] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-28T02:12:39.095141] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-28T02:12:39.486140] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:12:39.855701] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-28T02:12:40.213688] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-28T02:12:40.655725] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-28T02:12:40.792948] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-28T02:12:41.094457] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-28T02:12:41.455736] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-28T02:12:41.884493] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-28T02:12:42.255714] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-28T02:12:42.603280] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-28T02:12:43.055728] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-28T02:12:43.855708] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-28T02:12:43.989976] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-28T02:12:44.655723] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-28T02:12:45.007336] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-28T02:12:45.101099] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-28T02:12:45.455828] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-28T02:12:45.890386] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-28T02:12:46.255714] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-28T02:12:46.690279] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-28T02:12:47.055721] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-28T02:12:47.391995] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-28T02:12:47.855721] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-28T02:12:48.655728] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-28T02:12:48.821566] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-28T02:12:48.825870] [INFO ] [REMOTE ] ECO: Full fetch complete (29201 records). [2025-09-28T02:12:48.826026] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-28T02:12:48.994986] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-28T02:12:49.225434] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-28T02:12:49.225553] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-28T02:12:49.226014] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-28T02:12:49.226138] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-28T02:12:49.227096] [DEBUG] [LOCAL ] ECO: Trimmed 29201 records to 18768 (keeping 200 days of data) [2025-09-28T02:12:49.359464] [DEBUG] [LOCAL ] ECO: Primary data saved (18768 records). [2025-09-28T02:12:49.359668] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-28T02:12:49.359799] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. ECO took 47.2s. Estimated remaining: 23m 57s. Rate: 69.2 symbols/min [2025-09-28T02:12:49.460852] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-28T02:12:49.551233] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:49.551477] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-28T02:12:49.551557] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-28T02:12:49.551697] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-28T02:12:49.551784] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-28T02:12:49.551868] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-28T02:12:49.551947] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-28T02:12:49.931927] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:12:50.255704] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-28T02:12:50.297299] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-28T02:12:50.301400] [INFO ] [REMOTE ] EFT: Full fetch complete (17466 records). [2025-09-28T02:12:50.301508] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-28T02:12:50.590837] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-28T02:12:50.707609] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-28T02:12:50.707744] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-28T02:12:50.708203] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-28T02:12:50.708300] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-28T02:12:50.708966] [DEBUG] [LOCAL ] EFT: Trimmed 17466 records to 12857 (keeping 200 days of data) [2025-09-28T02:12:50.799908] [DEBUG] [LOCAL ] EFT: Primary data saved (12857 records). [2025-09-28T02:12:50.800091] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-28T02:12:50.800240] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EFT took 34.4s. Estimated remaining: 23m 57s. Rate: 69.1 symbols/min [2025-09-28T02:12:50.982791] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:51.005293] [DEBUG] [LOCAL ] EIG: Loaded 20519 existing records from primary storage. [2025-09-28T02:12:51.005625] [INFO ] [MAIN ] EIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:12:51.005774] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EIG took 0.2s. Estimated remaining: 23m 55s. Rate: 69.2 symbols/min [2025-09-28T02:12:51.061823] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-28T02:12:51.206795] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:12:51.207033] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-09-28T02:12:51.207127] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-09-28T02:12:51.207244] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-28T02:12:51.207319] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-28T02:12:51.207400] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-28T02:12:51.207469] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-28T02:12:51.582176] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-28T02:12:51.670828] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:12:51.855733] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-28T02:12:52.197574] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-28T02:12:52.655727] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-28T02:12:53.089343] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-28T02:12:53.455744] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-28T02:12:53.796379] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-28T02:12:54.255747] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-28T02:12:54.703883] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-28T02:12:55.055736] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-28T02:12:55.376070] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-28T02:12:55.376986] [INFO ] [REMOTE ] EICA: Full fetch complete (1269 records). [2025-09-28T02:12:55.377086] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-28T02:12:55.582752] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:12:55.582971] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:12:55.583047] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:12:55.583126] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-28T02:12:55.583227] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-28T02:12:55.583306] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-28T02:12:55.583424] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-28T02:12:55.583565] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EICA took 29.4s. Estimated remaining: 24m 2s. Rate: 68.8 symbols/min [2025-09-28T02:12:55.855728] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-28T02:12:56.655735] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-28T02:12:57.223341] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-28T02:12:57.455729] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-28T02:12:57.571446] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-28T02:12:57.967520] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-28T02:12:58.255709] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-28T02:12:59.055721] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-28T02:12:59.607765] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-28T02:12:59.855726] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-28T02:13:00.304472] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-28T02:13:00.397817] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-28T02:13:00.399134] [INFO ] [REMOTE ] EICB: Full fetch complete (2692 records). [2025-09-28T02:13:00.399233] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-28T02:13:00.602588] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:13:00.602996] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:13:00.603078] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:13:00.603164] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-28T02:13:00.603289] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-28T02:13:00.603371] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-28T02:13:00.603455] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-28T02:13:00.603587] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICB took 21.7s. Estimated remaining: 24m 11s. Rate: 68.4 symbols/min [2025-09-28T02:13:00.655716] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-28T02:13:01.455799] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-28T02:13:02.007993] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-28T02:13:02.255731] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-28T02:13:02.495141] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-28T02:13:02.787153] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-28T02:13:03.055737] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-28T02:13:03.855725] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-28T02:13:04.517092] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-28T02:13:04.655779] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-28T02:13:04.969928] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-28T02:13:05.254375] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-28T02:13:05.455781] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-28T02:13:06.255732] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-28T02:13:06.863915] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-28T02:13:07.055695] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-28T02:13:07.202764] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-28T02:13:07.785793] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-28T02:13:07.855679] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-28T02:13:08.463000] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-28T02:13:08.655778] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-28T02:13:09.396382] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-28T02:13:09.403550] [INFO ] [REMOTE ] EICC: Full fetch complete (8083 records). [2025-09-28T02:13:09.403752] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-28T02:13:09.465943] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-28T02:13:09.798664] [DEBUG] [VALIDATOR ] EICC: All expected trading days are present. [2025-09-28T02:13:09.798786] [DEBUG] [VALIDATOR ] EICC: Primary data validation passed. [2025-09-28T02:13:09.799041] [INFO ] [MAIN ] EICC: Fetched primary data is valid. [2025-09-28T02:13:09.799123] [DEBUG] [LOCAL ] EICC: Saving primary data. [2025-09-28T02:13:09.799694] [DEBUG] [LOCAL ] EICC: Trimmed 8083 records to 6245 (keeping 200 days of data) [2025-09-28T02:13:09.840244] [DEBUG] [LOCAL ] EICC: Primary data saved (6245 records). [2025-09-28T02:13:09.840427] [INFO ] [MAIN ] EICC: Full history saved. [2025-09-28T02:13:09.840563] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EICC took 20.5s. Estimated remaining: 24m 29s. Rate: 67.5 symbols/min [2025-09-28T02:13:11.122452] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-28T02:13:11.134530] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-28T02:13:12.857894] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-28T02:13:12.869399] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-28T02:13:14.895332] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-28T02:13:14.907609] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-28T02:13:16.706478] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-28T02:13:16.718451] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-28T02:13:18.340870] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-28T02:13:18.351499] [INFO ] [REMOTE ] EIX: Full fetch complete (76962 records). [2025-09-28T02:13:18.351710] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-28T02:13:18.778139] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-28T02:13:18.778301] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-28T02:13:18.779210] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-28T02:13:18.779315] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-28T02:13:18.781095] [DEBUG] [LOCAL ] EIX: Trimmed 76962 records to 54113 (keeping 200 days of data) [2025-09-28T02:13:19.120935] [DEBUG] [LOCAL ] EIX: Primary data saved (54113 records). [2025-09-28T02:13:19.121119] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-28T02:13:19.121248] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 28.1s. Estimated remaining: 24m 48s. Rate: 66.6 symbols/min [2025-09-28T02:13:19.870985] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:19.858507] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:19.837715] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:19.895233] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:19.892771] [DEBUG] [LOCAL ] ELC: No existing data file found in primary storage. [2025-09-28T02:13:19.898144] [WARN ] [MAIN ] ELC: No existing data found, performing full refresh instead. [2025-09-28T02:13:19.898298] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-28T02:13:19.898363] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-28T02:13:19.898442] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-09-28T02:13:19.898483] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-28T02:13:20.285464] [DEBUG] [LOCAL ] EL: Loaded 54177 existing records from primary storage. [2025-09-28T02:13:20.301882] [DEBUG] [LOCAL ] ELAN: Loaded 53985 existing records from primary storage. [2025-09-28T02:13:20.317285] [DEBUG] [LOCAL ] ELF: Loaded 53037 existing records from primary storage. [2025-09-28T02:13:20.322580] [INFO ] [MAIN ] ELAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:20.322973] [INFO ] [MAIN ] EL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:20.323460] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELAN took 1.2s. Estimated remaining: 24m 47s. Rate: 66.6 symbols/min [2025-09-28T02:13:20.329187] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. EL took 1.2s. Estimated remaining: 24m 44s. Rate: 66.6 symbols/min [2025-09-28T02:13:20.329286] [INFO ] [MAIN ] ELF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:20.378617] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELF took 1.2s. Estimated remaining: 24m 42s. Rate: 66.7 symbols/min [2025-09-28T02:13:20.674592] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:13:20.788248] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-28T02:13:20.896517] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:20.965083] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-28T02:13:21.036115] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-28T02:13:21.057812] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-28T02:13:21.057940] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-28T02:13:21.036027] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:21.058166] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-28T02:13:21.057525] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:21.058828] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-28T02:13:21.299341] [DEBUG] [LOCAL ] ELP: Loaded 26107 existing records from primary storage. [2025-09-28T02:13:21.322975] [INFO ] [MAIN ] ELP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:21.361600] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. ELP took 1.0s. Estimated remaining: 24m 41s. Rate: 66.7 symbols/min [2025-09-28T02:13:21.398238] [DEBUG] [LOCAL ] ELME: Loaded 39817 existing records from primary storage. [2025-09-28T02:13:21.432191] [INFO ] [MAIN ] ELME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:21.443096] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELME took 1.1s. Estimated remaining: 24m 38s. Rate: 66.8 symbols/min [2025-09-28T02:13:21.809713] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-28T02:13:21.808469] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:13:21.825876] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-28T02:13:21.859630] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:21.874963] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-28T02:13:21.926415] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:21.988950] [DEBUG] [LOCAL ] ELS: Loaded 50110 existing records from primary storage. [2025-09-28T02:13:21.989531] [INFO ] [MAIN ] ELS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:21.989664] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELS took 0.6s. Estimated remaining: 24m 36s. Rate: 66.8 symbols/min [2025-09-28T02:13:22.124504] [DEBUG] [LOCAL ] ELV: Loaded 51334 existing records from primary storage. [2025-09-28T02:13:22.146787] [INFO ] [MAIN ] ELV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:22.178153] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. ELV took 0.7s. Estimated remaining: 24m 34s. Rate: 66.9 symbols/min [2025-09-28T02:13:22.238536] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:22.293883] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-28T02:13:22.304314] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-28T02:13:22.325089] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-28T02:13:22.325302] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-28T02:13:22.325880] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-28T02:13:22.348478] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-28T02:13:22.407967] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:22.413422] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-28T02:13:22.412423] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-28T02:13:22.416321] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-28T02:13:22.414181] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-28T02:13:22.627168] [DEBUG] [LOCAL ] EMD: Loaded 21338 existing records from primary storage. [2025-09-28T02:13:22.666379] [INFO ] [MAIN ] EMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:22.713376] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. EMD took 0.5s. Estimated remaining: 24m 32s. Rate: 67.0 symbols/min [2025-09-28T02:13:22.857510] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-28T02:13:22.883199] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-28T02:13:22.946283] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:13:23.000076] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-28T02:13:22.993154] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-28T02:13:23.035446] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-28T02:13:23.040400] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:23.076281] [DEBUG] [LOCAL ] EME: Loaded 32035 existing records from primary storage. [2025-09-28T02:13:23.076639] [INFO ] [MAIN ] EME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:23.076794] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. EME took 0.3s. Estimated remaining: 24m 30s. Rate: 67.0 symbols/min [2025-09-28T02:13:23.242138] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:13:23.266117] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:23.270249] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-28T02:13:23.267217] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-28T02:13:23.271518] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-28T02:13:23.271619] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:13:23.272362] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-09-28T02:13:23.273567] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:13:23.273663] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-28T02:13:23.273752] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-28T02:13:23.273954] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-28T02:13:23.274056] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-28T02:13:23.274151] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. EMA took 1.3s. Estimated remaining: 24m 28s. Rate: 67.1 symbols/min [2025-09-28T02:13:23.342983] [DEBUG] [LOCAL ] EMF: Loaded 3575 existing records from primary storage. [2025-09-28T02:13:23.367245] [INFO ] [MAIN ] EMF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:23.386234] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMF took 0.3s. Estimated remaining: 24m 25s. Rate: 67.2 symbols/min [2025-09-28T02:13:23.591177] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:23.680399] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:23.696581] [DEBUG] [LOCAL ] EMO: Loaded 12656 existing records from primary storage. [2025-09-28T02:13:23.697074] [INFO ] [MAIN ] EMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:23.697179] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EMO took 0.3s. Estimated remaining: 24m 23s. Rate: 67.2 symbols/min [2025-09-28T02:13:23.772603] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-28T02:13:23.757421] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-28T02:13:23.821847] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-28T02:13:23.814734] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-28T02:13:23.940202] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:23.943606] [DEBUG] [LOCAL ] EMN: Loaded 51117 existing records from primary storage. [2025-09-28T02:13:23.944208] [INFO ] [MAIN ] EMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:23.944324] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMN took 0.7s. Estimated remaining: 24m 21s. Rate: 67.3 symbols/min [2025-09-28T02:13:24.035484] [DEBUG] [LOCAL ] EMP: Loaded 3062 existing records from primary storage. [2025-09-28T02:13:24.065221] [INFO ] [MAIN ] EMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:24.065489] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMP took 0.4s. Estimated remaining: 24m 18s. Rate: 67.4 symbols/min [2025-09-28T02:13:24.273884] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:24.347683] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:24.347919] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-28T02:13:24.350060] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-28T02:13:24.386589] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-28T02:13:24.388797] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-28T02:13:24.411251] [DEBUG] [LOCAL ] EMR: Loaded 54027 existing records from primary storage. [2025-09-28T02:13:24.426436] [INFO ] [MAIN ] EMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:24.426578] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMR took 0.5s. Estimated remaining: 24m 16s. Rate: 67.4 symbols/min [2025-09-28T02:13:24.576599] [DEBUG] [LOCAL ] ENB: Loaded 54295 existing records from primary storage. [2025-09-28T02:13:24.614432] [INFO ] [MAIN ] ENB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:24.639984] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. ENB took 0.6s. Estimated remaining: 24m 13s. Rate: 67.5 symbols/min [2025-09-28T02:13:24.647104] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:24.656828] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-28T02:13:24.698621] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-28T02:13:24.762763] [DEBUG] [LOCAL ] ENFY: Loaded 3106 existing records from primary storage. [2025-09-28T02:13:24.774066] [INFO ] [MAIN ] ENFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:24.784523] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. ENFY took 0.4s. Estimated remaining: 24m 11s. Rate: 67.6 symbols/min [2025-09-28T02:13:24.856033] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:25.013612] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-28T02:13:25.037020] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-28T02:13:25.060842] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:25.077531] [DEBUG] [LOCAL ] ENO: Loaded 1952 existing records from primary storage. [2025-09-28T02:13:25.079562] [INFO ] [MAIN ] ENO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:25.079737] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. ENO took 0.3s. Estimated remaining: 24m 9s. Rate: 67.6 symbols/min [2025-09-28T02:13:25.080438] [DEBUG] [LOCAL ] ENIC: Loaded 36910 existing records from primary storage. [2025-09-28T02:13:25.083224] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-28T02:13:25.111000] [INFO ] [MAIN ] ENIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:25.132523] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENIC took 0.5s. Estimated remaining: 24m 6s. Rate: 67.7 symbols/min [2025-09-28T02:13:25.464357] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-28T02:13:25.431148] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:25.468360] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:25.470007] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-09-28T02:13:25.470181] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-09-28T02:13:25.470299] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-28T02:13:25.471491] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-28T02:13:25.471779] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-28T02:13:25.471858] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-28T02:13:25.540629] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-28T02:13:25.810134] [DEBUG] [LOCAL ] ENOV: Loaded 45799 existing records from primary storage. [2025-09-28T02:13:25.854275] [INFO ] [MAIN ] ENOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:25.843593] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-28T02:13:25.887968] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENOV took 0.8s. Estimated remaining: 24m 5s. Rate: 67.7 symbols/min [2025-09-28T02:13:25.990184] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:13:26.131599] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:26.165719] [DEBUG] [LOCAL ] ENS: Loaded 29869 existing records from primary storage. [2025-09-28T02:13:26.166111] [INFO ] [MAIN ] ENS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:26.167432] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENS took 0.3s. Estimated remaining: 24m 3s. Rate: 67.8 symbols/min [2025-09-28T02:13:26.260898] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-28T02:13:26.352766] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:26.381593] [DEBUG] [LOCAL ] ENVA: Loaded 25914 existing records from primary storage. [2025-09-28T02:13:26.382042] [INFO ] [MAIN ] ENVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:26.382148] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENVA took 0.2s. Estimated remaining: 24m 0s. Rate: 67.9 symbols/min [2025-09-28T02:13:26.571543] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:26.586492] [DEBUG] [LOCAL ] EOD: Loaded 14232 existing records from primary storage. [2025-09-28T02:13:26.586851] [INFO ] [MAIN ] EOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:26.586968] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. EOD took 0.2s. Estimated remaining: 23m 58s. Rate: 67.9 symbols/min [2025-09-28T02:13:26.676865] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-28T02:13:26.776898] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:26.833301] [DEBUG] [LOCAL ] EOG: Loaded 54121 existing records from primary storage. [2025-09-28T02:13:26.833745] [INFO ] [MAIN ] EOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:26.835231] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. EOG took 0.2s. Estimated remaining: 23m 56s. Rate: 68.0 symbols/min [2025-09-28T02:13:27.016611] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:27.029903] [DEBUG] [LOCAL ] EOI: Loaded 10783 existing records from primary storage. [2025-09-28T02:13:27.030216] [INFO ] [MAIN ] EOI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:27.030326] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. EOI took 0.2s. Estimated remaining: 23m 53s. Rate: 68.1 symbols/min [2025-09-28T02:13:27.055770] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-28T02:13:27.214781] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:27.215071] [DEBUG] [LOCAL ] EOS: No existing data file found in primary storage. [2025-09-28T02:13:27.215181] [WARN ] [MAIN ] EOS: No existing data found, performing full refresh instead. [2025-09-28T02:13:27.215346] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-28T02:13:27.215441] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-28T02:13:27.215577] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-09-28T02:13:27.215694] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-28T02:13:27.598265] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:13:27.672564] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-28T02:13:27.855771] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-28T02:13:28.655726] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-28T02:13:28.927413] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-28T02:13:29.077064] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-28T02:13:29.077860] [INFO ] [REMOTE ] ELPC: Full fetch complete (1481 records). [2025-09-28T02:13:29.077956] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-28T02:13:29.278606] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:13:29.278861] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:13:29.278944] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:13:29.279027] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-28T02:13:29.279133] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-28T02:13:29.279277] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-28T02:13:29.279380] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-28T02:13:29.279515] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. ELPC took 8.9s. Estimated remaining: 23m 55s. Rate: 67.9 symbols/min [2025-09-28T02:13:29.464100] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-28T02:13:29.468234] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:29.480601] [DEBUG] [LOCAL ] EOT: Loaded 6916 existing records from primary storage. [2025-09-28T02:13:29.480955] [INFO ] [MAIN ] EOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:29.481081] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOT took 0.2s. Estimated remaining: 23m 53s. Rate: 68.0 symbols/min [2025-09-28T02:13:29.660245] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:29.688854] [DEBUG] [LOCAL ] EPAC: Loaded 27416 existing records from primary storage. [2025-09-28T02:13:29.689225] [INFO ] [MAIN ] EPAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:29.689331] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EPAC took 0.2s. Estimated remaining: 23m 51s. Rate: 68.1 symbols/min [2025-09-28T02:13:29.877559] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:29.877793] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-09-28T02:13:29.877869] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-09-28T02:13:29.877987] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-28T02:13:29.878061] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-28T02:13:29.878145] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-09-28T02:13:29.878218] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-28T02:13:30.266758] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-28T02:13:30.274376] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:13:30.770449] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-28T02:13:31.055740] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-28T02:13:31.463732] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-28T02:13:31.855717] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-28T02:13:32.318490] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-28T02:13:32.655781] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-28T02:13:33.146902] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-28T02:13:33.455749] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-28T02:13:34.022162] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-28T02:13:34.067427] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-28T02:13:34.255752] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-28T02:13:35.055734] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-28T02:13:35.715547] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-28T02:13:35.855723] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-28T02:13:36.509812] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-28T02:13:36.655691] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-28T02:13:36.863127] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-28T02:13:37.455726] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-28T02:13:38.066805] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-28T02:13:38.255791] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-28T02:13:38.846058] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-28T02:13:39.055727] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-28T02:13:39.482835] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-28T02:13:39.503275] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-28T02:13:39.504667] [INFO ] [REMOTE ] ELC: Full fetch complete (5087 records). [2025-09-28T02:13:39.504763] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-28T02:13:39.861197] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-28T02:13:39.905594] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-28T02:13:39.906596] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-28T02:13:39.906921] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-28T02:13:39.907017] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-28T02:13:39.907863] [DEBUG] [LOCAL ] ELC: Trimmed 5087 records to 3512 (keeping 200 days of data) [2025-09-28T02:13:39.932220] [DEBUG] [LOCAL ] ELC: Primary data saved (3512 records). [2025-09-28T02:13:39.932368] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-28T02:13:39.932484] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. ELC took 20.8s. Estimated remaining: 24m 10s. Rate: 67.1 symbols/min [2025-09-28T02:13:40.115736] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:40.166401] [DEBUG] [LOCAL ] EPC: Loaded 40383 existing records from primary storage. [2025-09-28T02:13:40.166829] [INFO ] [MAIN ] EPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:40.170087] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EPC took 0.2s. Estimated remaining: 24m 8s. Rate: 67.2 symbols/min [2025-09-28T02:13:40.387953] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:40.388197] [DEBUG] [LOCAL ] EPD: No existing data file found in primary storage. [2025-09-28T02:13:40.388271] [WARN ] [MAIN ] EPD: No existing data found, performing full refresh instead. [2025-09-28T02:13:40.388389] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-28T02:13:40.388461] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-28T02:13:40.388545] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-09-28T02:13:40.388618] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-28T02:13:40.662232] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-28T02:13:40.782813] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:13:41.025934] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-28T02:13:41.455746] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-28T02:13:42.229026] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-28T02:13:42.255675] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-28T02:13:42.579512] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-28T02:13:43.055731] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-28T02:13:43.861682] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-28T02:13:43.867634] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-28T02:13:43.941510] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-28T02:13:44.655760] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-28T02:13:45.455691] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-28T02:13:45.804430] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-28T02:13:46.133056] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-28T02:13:46.243334] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-28T02:13:46.255681] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-28T02:13:47.055745] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-28T02:13:47.855695] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-28T02:13:48.118738] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-28T02:13:48.532742] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-28T02:13:48.565807] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-28T02:13:48.655770] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-28T02:13:49.455784] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-28T02:13:50.255700] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-28T02:13:50.385176] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-28T02:13:50.386332] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-28T02:13:51.055729] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-28T02:13:51.758515] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-28T02:13:51.855723] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-28T02:13:52.655700] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-28T02:13:52.708057] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-28T02:13:52.711868] [INFO ] [REMOTE ] EOS: Full fetch complete (23110 records). [2025-09-28T02:13:52.712058] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-28T02:13:53.078827] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-28T02:13:53.166161] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-28T02:13:53.166285] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-28T02:13:53.166767] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-28T02:13:53.166876] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-28T02:13:53.167690] [DEBUG] [LOCAL ] EOS: Trimmed 23110 records to 15589 (keeping 200 days of data) [2025-09-28T02:13:53.270210] [DEBUG] [LOCAL ] EOS: Primary data saved (15589 records). [2025-09-28T02:13:53.270393] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-28T02:13:53.270509] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EOS took 26.2s. Estimated remaining: 24m 33s. Rate: 66.0 symbols/min [2025-09-28T02:13:53.454778] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:53.455746] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-28T02:13:53.507912] [DEBUG] [LOCAL ] EPR: Loaded 44722 existing records from primary storage. [2025-09-28T02:13:53.508364] [INFO ] [MAIN ] EPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:53.509183] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPR took 0.2s. Estimated remaining: 24m 31s. Rate: 66.0 symbols/min [2025-09-28T02:13:53.702597] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:53.754540] [DEBUG] [LOCAL ] EPRT: Loaded 49306 existing records from primary storage. [2025-09-28T02:13:53.755002] [INFO ] [MAIN ] EPRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:53.755606] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPRT took 0.2s. Estimated remaining: 24m 28s. Rate: 66.1 symbols/min [2025-09-28T02:13:53.942799] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:53.956826] [DEBUG] [LOCAL ] EQBK: Loaded 11050 existing records from primary storage. [2025-09-28T02:13:53.957127] [INFO ] [MAIN ] EQBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:53.957230] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EQBK took 0.2s. Estimated remaining: 24m 26s. Rate: 66.2 symbols/min [2025-09-28T02:13:54.114894] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-28T02:13:54.183694] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:54.249227] [DEBUG] [LOCAL ] EQH: Loaded 53435 existing records from primary storage. [2025-09-28T02:13:54.249726] [INFO ] [MAIN ] EQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:54.251963] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EQH took 0.3s. Estimated remaining: 24m 24s. Rate: 66.2 symbols/min [2025-09-28T02:13:54.263425] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-28T02:13:54.443538] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:54.507002] [DEBUG] [LOCAL ] EQNR: Loaded 53809 existing records from primary storage. [2025-09-28T02:13:54.507419] [INFO ] [MAIN ] EQNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:54.508222] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EQNR took 0.3s. Estimated remaining: 24m 22s. Rate: 66.3 symbols/min [2025-09-28T02:13:54.702619] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:13:54.766831] [DEBUG] [LOCAL ] EQR: Loaded 52190 existing records from primary storage. [2025-09-28T02:13:54.767283] [INFO ] [MAIN ] EQR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:13:54.768123] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EQR took 0.3s. Estimated remaining: 24m 19s. Rate: 66.4 symbols/min [2025-09-28T02:13:55.055710] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-28T02:13:55.119075] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-28T02:13:55.811854] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-28T02:13:55.855761] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-28T02:13:56.655731] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-28T02:13:56.999754] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-28T02:13:57.345129] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-28T02:13:57.455731] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-28T02:13:58.003005] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-28T02:13:58.012029] [INFO ] [REMOTE ] ENR: Full fetch complete (58360 records). [2025-09-28T02:13:58.012252] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-28T02:13:58.267409] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-28T02:13:58.442504] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-28T02:13:58.442663] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-28T02:13:58.443391] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-28T02:13:58.443497] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-28T02:13:58.445083] [DEBUG] [LOCAL ] ENR: Trimmed 58360 records to 43336 (keeping 200 days of data) [2025-09-28T02:13:58.703554] [DEBUG] [LOCAL ] ENR: Primary data saved (43336 records). [2025-09-28T02:13:58.703775] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-28T02:13:58.703920] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. ENR took 33.5s. Estimated remaining: 24m 25s. Rate: 66.1 symbols/min [2025-09-28T02:13:59.281362] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-28T02:13:59.293205] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-28T02:13:59.728288] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-28T02:13:59.737076] [INFO ] [REMOTE ] EPAM: Full fetch complete (56283 records). [2025-09-28T02:13:59.737242] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-28T02:14:00.154367] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-28T02:14:00.154506] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-28T02:14:00.155214] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-28T02:14:00.155303] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-28T02:14:00.157139] [DEBUG] [LOCAL ] EPAM: Trimmed 56283 records to 40450 (keeping 200 days of data) [2025-09-28T02:14:00.412361] [DEBUG] [LOCAL ] EPAM: Primary data saved (40450 records). [2025-09-28T02:14:00.412536] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-28T02:14:00.412671] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EPAM took 30.7s. Estimated remaining: 24m 26s. Rate: 66.0 symbols/min [2025-09-28T02:14:01.276058] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-28T02:14:01.288255] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-28T02:14:03.150702] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-28T02:14:03.163322] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-28T02:14:05.034876] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-28T02:14:05.046974] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-28T02:14:06.798055] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-28T02:14:06.808692] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-09-28T02:14:06.808868] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-28T02:14:07.237317] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-28T02:14:07.237618] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-28T02:14:07.238711] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-28T02:14:07.238806] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-28T02:14:07.241304] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 54389 (keeping 200 days of data) [2025-09-28T02:14:07.610718] [DEBUG] [LOCAL ] EPD: Primary data saved (54389 records). [2025-09-28T02:14:07.610944] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-28T02:14:07.611094] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EPD took 27.4s. Estimated remaining: 24m 38s. Rate: 65.4 symbols/min [2025-09-28T02:14:08.365997] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:08.406755] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:08.375275] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:08.428219] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:08.428419] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-28T02:14:08.430122] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-28T02:14:08.429785] [DEBUG] [LOCAL ] EQT: No existing data file found in primary storage. [2025-09-28T02:14:08.430516] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-28T02:14:08.430571] [WARN ] [MAIN ] EQT: No existing data found, performing full refresh instead. [2025-09-28T02:14:08.430687] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-28T02:14:08.441692] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-28T02:14:08.441831] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-28T02:14:08.441971] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-28T02:14:08.442065] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-28T02:14:08.442132] [DEBUG] [LOCAL ] EQT: No primary data file found to delete. [2025-09-28T02:14:08.442319] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-28T02:14:08.538398] [DEBUG] [LOCAL ] EQV: Loaded 2840 existing records from primary storage. [2025-09-28T02:14:08.601533] [INFO ] [MAIN ] EQV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:08.676329] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQV took 1.1s. Estimated remaining: 24m 37s. Rate: 65.4 symbols/min [2025-09-28T02:14:09.167030] [DEBUG] [LOCAL ] ERJ: Loaded 51477 existing records from primary storage. [2025-09-28T02:14:09.282356] [INFO ] [MAIN ] ERJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:09.356335] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. ERJ took 1.7s. Estimated remaining: 24m 36s. Rate: 65.4 symbols/min [2025-09-28T02:14:09.494809] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:14:09.491452] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:09.513275] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-28T02:14:09.516534] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:14:09.519885] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-28T02:14:09.720586] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:09.741343] [DEBUG] [LOCAL ] ERO: Loaded 41901 existing records from primary storage. [2025-09-28T02:14:09.741800] [INFO ] [MAIN ] ERO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:09.741995] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. ERO took 1.0s. Estimated remaining: 24m 34s. Rate: 65.5 symbols/min [2025-09-28T02:14:09.949384] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:09.966233] [DEBUG] [LOCAL ] ES: Loaded 53309 existing records from primary storage. [2025-09-28T02:14:09.966684] [INFO ] [MAIN ] ES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:09.967378] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. ES took 0.5s. Estimated remaining: 24m 32s. Rate: 65.5 symbols/min [2025-09-28T02:14:10.107983] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-28T02:14:10.130363] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-28T02:14:10.163455] [DEBUG] [LOCAL ] ESAB: Loaded 26683 existing records from primary storage. [2025-09-28T02:14:10.202022] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:10.202731] [INFO ] [MAIN ] ESAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:10.203072] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ESAB took 0.5s. Estimated remaining: 24m 29s. Rate: 65.6 symbols/min [2025-09-28T02:14:10.356552] [DEBUG] [LOCAL ] ESE: Loaded 16878 existing records from primary storage. [2025-09-28T02:14:10.374347] [INFO ] [MAIN ] ESE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:10.374688] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ESE took 0.4s. Estimated remaining: 24m 27s. Rate: 65.7 symbols/min [2025-09-28T02:14:10.583472] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-28T02:14:10.593053] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-28T02:14:10.583310] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:10.682216] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:10.682562] [DEBUG] [LOCAL ] ESNT: No existing data file found in primary storage. [2025-09-28T02:14:10.682667] [WARN ] [MAIN ] ESNT: No existing data found, performing full refresh instead. [2025-09-28T02:14:10.682888] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-28T02:14:10.682971] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-28T02:14:10.683086] [DEBUG] [LOCAL ] ESNT: No primary data file found to delete. [2025-09-28T02:14:10.683164] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-28T02:14:11.030230] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-28T02:14:11.047357] [DEBUG] [LOCAL ] ESI: Loaded 51566 existing records from primary storage. [2025-09-28T02:14:11.054900] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-28T02:14:11.077507] [INFO ] [MAIN ] ESI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:11.102869] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESI took 0.9s. Estimated remaining: 24m 25s. Rate: 65.7 symbols/min [2025-09-28T02:14:11.195012] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:14:11.235632] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-28T02:14:11.340321] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:11.409538] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-28T02:14:11.421598] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-28T02:14:11.437249] [DEBUG] [LOCAL ] ESRT: Loaded 47104 existing records from primary storage. [2025-09-28T02:14:11.437624] [INFO ] [MAIN ] ESRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:11.437752] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESRT took 0.3s. Estimated remaining: 24m 23s. Rate: 65.7 symbols/min [2025-09-28T02:14:11.474801] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-28T02:14:11.528338] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-28T02:14:11.633204] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:11.662906] [DEBUG] [LOCAL ] ESS: Loaded 30441 existing records from primary storage. [2025-09-28T02:14:11.663264] [INFO ] [MAIN ] ESS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:11.663366] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESS took 0.2s. Estimated remaining: 24m 21s. Rate: 65.8 symbols/min [2025-09-28T02:14:11.852631] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:11.903607] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-28T02:14:11.904770] [DEBUG] [LOCAL ] ESTC: Loaded 50744 existing records from primary storage. [2025-09-28T02:14:11.905939] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-28T02:14:11.907041] [INFO ] [MAIN ] ESTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:11.907141] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESTC took 0.2s. Estimated remaining: 24m 19s. Rate: 65.9 symbols/min [2025-09-28T02:14:12.097973] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:12.152926] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-09-28T02:14:12.153322] [INFO ] [MAIN ] ET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:12.153426] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ET took 0.2s. Estimated remaining: 24m 16s. Rate: 65.9 symbols/min [2025-09-28T02:14:12.261553] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-28T02:14:12.268452] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-28T02:14:12.338419] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:12.351535] [DEBUG] [LOCAL ] ETB: Loaded 12181 existing records from primary storage. [2025-09-28T02:14:12.351832] [INFO ] [MAIN ] ETB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:12.351951] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ETB took 0.2s. Estimated remaining: 24m 14s. Rate: 66.0 symbols/min [2025-09-28T02:14:12.534285] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:12.561112] [DEBUG] [LOCAL ] ETD: Loaded 27661 existing records from primary storage. [2025-09-28T02:14:12.561448] [INFO ] [MAIN ] ETD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:12.561550] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ETD took 0.2s. Estimated remaining: 24m 12s. Rate: 66.0 symbols/min [2025-09-28T02:14:12.747022] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:12.764822] [DEBUG] [LOCAL ] ETG: Loaded 16710 existing records from primary storage. [2025-09-28T02:14:12.765119] [INFO ] [MAIN ] ETG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:12.765222] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ETG took 0.2s. Estimated remaining: 24m 9s. Rate: 66.1 symbols/min [2025-09-28T02:14:12.829018] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-28T02:14:12.855565] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-28T02:14:12.971681] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:12.997783] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-28T02:14:13.006919] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-28T02:14:13.022050] [DEBUG] [LOCAL ] ETJ: Loaded 16938 existing records from primary storage. [2025-09-28T02:14:13.022397] [INFO ] [MAIN ] ETJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:13.022515] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ETJ took 0.3s. Estimated remaining: 24m 7s. Rate: 66.2 symbols/min [2025-09-28T02:14:13.224979] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:13.281311] [DEBUG] [LOCAL ] ETN: Loaded 53593 existing records from primary storage. [2025-09-28T02:14:13.281794] [INFO ] [MAIN ] ETN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:13.283206] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETN took 0.3s. Estimated remaining: 24m 5s. Rate: 66.2 symbols/min [2025-09-28T02:14:13.322923] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-28T02:14:13.352331] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-28T02:14:13.499741] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:13.540168] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-28T02:14:13.544100] [DEBUG] [LOCAL ] ETO: Loaded 6600 existing records from primary storage. [2025-09-28T02:14:13.556031] [INFO ] [MAIN ] ETO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:13.556447] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-28T02:14:13.556754] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETO took 0.3s. Estimated remaining: 24m 3s. Rate: 66.3 symbols/min [2025-09-28T02:14:13.754256] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:13.810150] [DEBUG] [LOCAL ] ETR: Loaded 54001 existing records from primary storage. [2025-09-28T02:14:13.810602] [INFO ] [MAIN ] ETR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:13.810731] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETR took 0.3s. Estimated remaining: 24m 0s. Rate: 66.4 symbols/min [2025-09-28T02:14:14.003706] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:14.027018] [DEBUG] [LOCAL ] ETV: Loaded 21729 existing records from primary storage. [2025-09-28T02:14:14.027367] [INFO ] [MAIN ] ETV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:14.027474] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETV took 0.2s. Estimated remaining: 23m 58s. Rate: 66.4 symbols/min [2025-09-28T02:14:14.232185] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:14.239430] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-28T02:14:14.242064] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-28T02:14:14.266273] [DEBUG] [LOCAL ] ETW: Loaded 25463 existing records from primary storage. [2025-09-28T02:14:14.266617] [INFO ] [MAIN ] ETW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:14.266783] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETW took 0.2s. Estimated remaining: 23m 56s. Rate: 66.5 symbols/min [2025-09-28T02:14:14.471774] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:14.498560] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-28T02:14:14.510379] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-28T02:14:14.510615] [DEBUG] [LOCAL ] ETX: Loaded 5028 existing records from primary storage. [2025-09-28T02:14:14.511682] [INFO ] [MAIN ] ETX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:14.511789] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETX took 0.2s. Estimated remaining: 23m 54s. Rate: 66.5 symbols/min [2025-09-28T02:14:14.702506] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:14.730283] [DEBUG] [LOCAL ] ETY: Loaded 23078 existing records from primary storage. [2025-09-28T02:14:14.730695] [INFO ] [MAIN ] ETY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:14.730802] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETY took 0.2s. Estimated remaining: 23m 51s. Rate: 66.6 symbols/min [2025-09-28T02:14:14.846477] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-28T02:14:14.857317] [INFO ] [REMOTE ] EQS: Full fetch complete (2522 records). [2025-09-28T02:14:14.867786] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-28T02:14:15.032531] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:15.163035] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-28T02:14:15.170902] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:14:15.170508] [DEBUG] [LOCAL ] EVC: Loaded 19415 existing records from primary storage. [2025-09-28T02:14:15.171314] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:14:15.171742] [INFO ] [MAIN ] EVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:15.171975] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-28T02:14:15.172361] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-28T02:14:15.172147] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. EVC took 0.4s. Estimated remaining: 23m 49s. Rate: 66.7 symbols/min [2025-09-28T02:14:15.220281] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-28T02:14:15.256202] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-28T02:14:15.283347] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. EQS took 7.7s. Estimated remaining: 23m 47s. Rate: 66.7 symbols/min [2025-09-28T02:14:15.520302] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:15.584787] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:15.642860] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-28T02:14:15.659785] [DEBUG] [LOCAL ] EVF: Loaded 9501 existing records from primary storage. [2025-09-28T02:14:15.660257] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-28T02:14:15.671534] [INFO ] [MAIN ] EVF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:15.673621] [DEBUG] [LOCAL ] EVEX: Loaded 30549 existing records from primary storage. [2025-09-28T02:14:15.672904] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. EVF took 0.4s. Estimated remaining: 23m 45s. Rate: 66.8 symbols/min [2025-09-28T02:14:15.674235] [INFO ] [MAIN ] EVEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:15.679721] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVEX took 0.5s. Estimated remaining: 23m 42s. Rate: 66.9 symbols/min [2025-09-28T02:14:16.017607] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:16.078038] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:16.085336] [DEBUG] [LOCAL ] EVG: Loaded 5862 existing records from primary storage. [2025-09-28T02:14:16.085585] [INFO ] [MAIN ] EVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:16.085792] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVG took 0.4s. Estimated remaining: 23m 40s. Rate: 66.9 symbols/min [2025-09-28T02:14:16.308329] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:16.351457] [DEBUG] [LOCAL ] EVH: Loaded 50111 existing records from primary storage. [2025-09-28T02:14:16.350125] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-28T02:14:16.360474] [INFO ] [MAIN ] EVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:16.364290] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVH took 0.6s. Estimated remaining: 23m 38s. Rate: 67.0 symbols/min [2025-09-28T02:14:16.370716] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-28T02:14:16.484308] [DEBUG] [LOCAL ] EVN: Loaded 11217 existing records from primary storage. [2025-09-28T02:14:16.490398] [INFO ] [MAIN ] EVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:16.500862] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVN took 0.4s. Estimated remaining: 23m 36s. Rate: 67.0 symbols/min [2025-09-28T02:14:16.644952] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:16.759631] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:16.808795] [DEBUG] [LOCAL ] EVT: Loaded 17270 existing records from primary storage. [2025-09-28T02:14:16.809796] [DEBUG] [LOCAL ] EVR: Loaded 35882 existing records from primary storage. [2025-09-28T02:14:16.810240] [INFO ] [MAIN ] EVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:16.810811] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVT took 0.3s. Estimated remaining: 23m 34s. Rate: 67.1 symbols/min [2025-09-28T02:14:16.810933] [INFO ] [MAIN ] EVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:16.823451] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVR took 0.5s. Estimated remaining: 23m 31s. Rate: 67.2 symbols/min [2025-09-28T02:14:17.145085] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:17.210506] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:17.210767] [DEBUG] [LOCAL ] EVTC: No existing data file found in primary storage. [2025-09-28T02:14:17.211101] [DEBUG] [LOCAL ] EVTL: No existing data file found in primary storage. [2025-09-28T02:14:17.211440] [WARN ] [MAIN ] EVTC: No existing data found, performing full refresh instead. [2025-09-28T02:14:17.211365] [WARN ] [MAIN ] EVTL: No existing data found, performing full refresh instead. [2025-09-28T02:14:17.211714] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-28T02:14:17.211848] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-28T02:14:17.212020] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-28T02:14:17.212227] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-28T02:14:17.212375] [DEBUG] [LOCAL ] EVTL: No primary data file found to delete. [2025-09-28T02:14:17.212526] [DEBUG] [LOCAL ] EVTC: No primary data file found to delete. [2025-09-28T02:14:17.212571] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-28T02:14:17.212734] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-28T02:14:17.979636] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:14:18.014993] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-28T02:14:18.061931] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:14:18.063714] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-28T02:14:18.100675] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-28T02:14:18.141266] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-28T02:14:18.255706] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-28T02:14:19.055780] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-28T02:14:19.335944] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-28T02:14:19.417853] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-28T02:14:19.860786] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-28T02:14:19.878710] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-28T02:14:20.655698] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-28T02:14:20.906302] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-28T02:14:21.021741] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-28T02:14:21.455804] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-28T02:14:22.018748] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-28T02:14:22.255736] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-28T02:14:22.913297] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-28T02:14:23.055810] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-28T02:14:23.566465] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-28T02:14:23.855725] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-28T02:14:24.173457] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-28T02:14:24.655750] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-28T02:14:25.289079] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-28T02:14:25.455746] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-28T02:14:26.260832] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-28T02:14:26.276746] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-28T02:14:26.752301] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-28T02:14:27.055764] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-28T02:14:27.486832] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-28T02:14:27.855753] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-28T02:14:28.325315] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-28T02:14:28.655749] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-28T02:14:29.169540] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-28T02:14:29.455734] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-28T02:14:30.255751] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-28T02:14:30.646282] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-28T02:14:31.017810] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-28T02:14:31.025100] [INFO ] [REMOTE ] ESNT: Full fetch complete (57157 records). [2025-09-28T02:14:31.025288] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-28T02:14:31.059673] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-28T02:14:31.472348] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-28T02:14:31.472590] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-28T02:14:31.473385] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-28T02:14:31.473545] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-28T02:14:31.475198] [DEBUG] [LOCAL ] ESNT: Trimmed 57157 records to 39065 (keeping 200 days of data) [2025-09-28T02:14:31.589786] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-28T02:14:31.757562] [DEBUG] [LOCAL ] ESNT: Primary data saved (39065 records). [2025-09-28T02:14:31.757873] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-28T02:14:31.758024] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. ESNT took 21.4s. Estimated remaining: 23m 58s. Rate: 65.9 symbols/min [2025-09-28T02:14:31.862404] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-28T02:14:31.953126] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:31.976498] [DEBUG] [LOCAL ] EVTR: Loaded 23675 existing records from primary storage. [2025-09-28T02:14:31.976905] [INFO ] [MAIN ] EVTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:31.977012] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVTR took 0.2s. Estimated remaining: 23m 56s. Rate: 65.9 symbols/min [2025-09-28T02:14:32.159784] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:32.214445] [DEBUG] [LOCAL ] EW: Loaded 54176 existing records from primary storage. [2025-09-28T02:14:32.214853] [INFO ] [MAIN ] EW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:32.215293] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EW took 0.2s. Estimated remaining: 23m 54s. Rate: 66.0 symbols/min [2025-09-28T02:14:32.405445] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:32.443141] [DEBUG] [LOCAL ] EXG: Loaded 34725 existing records from primary storage. [2025-09-28T02:14:32.443588] [INFO ] [MAIN ] EXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:32.443985] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EXG took 0.2s. Estimated remaining: 23m 51s. Rate: 66.1 symbols/min [2025-09-28T02:14:32.629826] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:32.660885] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-28T02:14:32.685551] [DEBUG] [LOCAL ] EXK: Loaded 53904 existing records from primary storage. [2025-09-28T02:14:32.686049] [INFO ] [MAIN ] EXK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:32.686395] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EXK took 0.2s. Estimated remaining: 23m 49s. Rate: 66.1 symbols/min [2025-09-28T02:14:32.870880] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:32.910414] [DEBUG] [LOCAL ] EXP: Loaded 30275 existing records from primary storage. [2025-09-28T02:14:32.911245] [INFO ] [MAIN ] EXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:32.912000] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EXP took 0.2s. Estimated remaining: 23m 47s. Rate: 66.2 symbols/min [2025-09-28T02:14:33.001602] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-28T02:14:33.039178] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-28T02:14:33.455736] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-28T02:14:33.772430] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-28T02:14:34.255732] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-28T02:14:35.055688] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-28T02:14:35.634261] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-28T02:14:35.634839] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-28T02:14:35.855728] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-28T02:14:36.633013] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-28T02:14:36.655712] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-28T02:14:37.455778] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-28T02:14:37.649578] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-28T02:14:37.860245] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-28T02:14:38.255717] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-28T02:14:38.699259] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-28T02:14:39.055699] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-28T02:14:39.296508] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-28T02:14:39.302560] [INFO ] [REMOTE ] EVTC: Full fetch complete (37882 records). [2025-09-28T02:14:39.302760] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-28T02:14:39.718038] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-28T02:14:39.718181] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-28T02:14:39.718805] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-28T02:14:39.718928] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-28T02:14:39.720162] [DEBUG] [LOCAL ] EVTC: Trimmed 37882 records to 26745 (keeping 200 days of data) [2025-09-28T02:14:39.861238] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-28T02:14:39.891240] [DEBUG] [LOCAL ] EVTC: Primary data saved (26745 records). [2025-09-28T02:14:39.891440] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-28T02:14:39.891565] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EVTC took 23.1s. Estimated remaining: 23m 58s. Rate: 65.6 symbols/min [2025-09-28T02:14:41.141798] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-28T02:14:41.153268] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-28T02:14:41.414998] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-28T02:14:41.426165] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-28T02:14:41.426407] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-28T02:14:41.887244] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-28T02:14:41.887390] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-28T02:14:41.888292] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-28T02:14:41.888396] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-28T02:14:41.891134] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 54462 (keeping 200 days of data) [2025-09-28T02:14:42.249787] [DEBUG] [LOCAL ] EQT: Primary data saved (54462 records). [2025-09-28T02:14:42.250072] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-28T02:14:42.250269] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EQT took 34.6s. Estimated remaining: 23m 60s. Rate: 65.5 symbols/min [2025-09-28T02:14:42.938391] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-28T02:14:42.955241] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-28T02:14:44.812438] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-28T02:14:44.822050] [INFO ] [REMOTE ] EVTL: Full fetch complete (51057 records). [2025-09-28T02:14:44.822198] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-28T02:14:45.245588] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-28T02:14:45.245785] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-28T02:14:45.246683] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-28T02:14:45.246805] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-28T02:14:45.248500] [DEBUG] [LOCAL ] EVTL: Trimmed 51057 records to 38140 (keeping 200 days of data) [2025-09-28T02:14:45.483097] [DEBUG] [LOCAL ] EVTL: Primary data saved (38140 records). [2025-09-28T02:14:45.483416] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-28T02:14:45.483567] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EVTL took 28.6s. Estimated remaining: 24m 4s. Rate: 65.3 symbols/min [2025-09-28T02:14:46.234447] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:46.210891] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:46.239598] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:46.326945] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:46.416681] [DEBUG] [LOCAL ] EXR: Loaded 46080 existing records from primary storage. [2025-09-28T02:14:46.419979] [INFO ] [MAIN ] EXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:46.420822] [DEBUG] [LOCAL ] FAF: Loaded 42474 existing records from primary storage. [2025-09-28T02:14:46.436573] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. EXR took 1.0s. Estimated remaining: 24m 3s. Rate: 65.3 symbols/min [2025-09-28T02:14:46.436958] [INFO ] [MAIN ] FAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:46.470189] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. FAF took 1.0s. Estimated remaining: 24m 0s. Rate: 65.4 symbols/min [2025-09-28T02:14:46.476523] [DEBUG] [LOCAL ] EXPD: Loaded 48786 existing records from primary storage. [2025-09-28T02:14:46.573863] [INFO ] [MAIN ] EXPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:46.625865] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXPD took 1.1s. Estimated remaining: 23m 58s. Rate: 65.4 symbols/min [2025-09-28T02:14:46.830051] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-09-28T02:14:46.828177] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:46.851919] [INFO ] [MAIN ] F: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:46.911965] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 1.4s. Estimated remaining: 23m 56s. Rate: 65.5 symbols/min [2025-09-28T02:14:46.984966] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:47.256320] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:47.331463] [DEBUG] [LOCAL ] FBK: Loaded 26066 existing records from primary storage. [2025-09-28T02:14:47.359543] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:47.373773] [INFO ] [MAIN ] FBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:47.376378] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBK took 0.9s. Estimated remaining: 23m 54s. Rate: 65.5 symbols/min [2025-09-28T02:14:47.378210] [DEBUG] [LOCAL ] FBIN: Loaded 51061 existing records from primary storage. [2025-09-28T02:14:47.422331] [INFO ] [MAIN ] FBIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:47.434242] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBIN took 1.0s. Estimated remaining: 23m 51s. Rate: 65.6 symbols/min [2025-09-28T02:14:47.808177] [DEBUG] [LOCAL ] FBP: Loaded 46874 existing records from primary storage. [2025-09-28T02:14:47.797776] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:47.835958] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:47.813216] [DEBUG] [LOCAL ] FBRT: Loaded 34985 existing records from primary storage. [2025-09-28T02:14:47.836987] [INFO ] [MAIN ] FBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:47.837674] [INFO ] [MAIN ] FBRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:47.837788] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBP took 1.1s. Estimated remaining: 23m 49s. Rate: 65.7 symbols/min [2025-09-28T02:14:47.843961] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 0.9s. Estimated remaining: 23m 47s. Rate: 65.7 symbols/min [2025-09-28T02:14:48.076819] [DEBUG] [LOCAL ] FC: Loaded 15634 existing records from primary storage. [2025-09-28T02:14:48.086529] [INFO ] [MAIN ] FC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:48.087620] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 0.7s. Estimated remaining: 23m 44s. Rate: 65.8 symbols/min [2025-09-28T02:14:48.217001] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:48.360315] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:48.432287] [DEBUG] [LOCAL ] FCF: Loaded 40237 existing records from primary storage. [2025-09-28T02:14:48.449311] [INFO ] [MAIN ] FCF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:48.449817] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCF took 1.0s. Estimated remaining: 23m 42s. Rate: 65.8 symbols/min [2025-09-28T02:14:48.470038] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:48.515236] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-28T02:14:48.553305] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-28T02:14:48.599259] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-28T02:14:48.631391] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-28T02:14:48.637974] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-28T02:14:48.667380] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-28T02:14:48.659861] [DEBUG] [LOCAL ] FCN: Loaded 26559 existing records from primary storage. [2025-09-28T02:14:48.710788] [INFO ] [MAIN ] FCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:48.728940] [DEBUG] [LOCAL ] FCPT: Loaded 37955 existing records from primary storage. [2025-09-28T02:14:48.708756] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:48.749733] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCN took 0.9s. Estimated remaining: 23m 40s. Rate: 65.9 symbols/min [2025-09-28T02:14:48.787075] [INFO ] [MAIN ] FCPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:48.810223] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCPT took 0.9s. Estimated remaining: 23m 38s. Rate: 66.0 symbols/min [2025-09-28T02:14:48.968246] [DEBUG] [LOCAL ] FCT: Loaded 14613 existing records from primary storage. [2025-09-28T02:14:49.027809] [INFO ] [MAIN ] FCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:49.144920] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCT took 0.7s. Estimated remaining: 23m 36s. Rate: 66.0 symbols/min [2025-09-28T02:14:49.268056] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:49.583407] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:49.710576] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:14:49.732843] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-28T02:14:49.785342] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:49.825024] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-09-28T02:14:49.833569] [INFO ] [MAIN ] FCX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:49.840230] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCX took 1.1s. Estimated remaining: 23m 34s. Rate: 66.0 symbols/min [2025-09-28T02:14:49.957082] [DEBUG] [LOCAL ] FDS: Loaded 26759 existing records from primary storage. [2025-09-28T02:14:49.969037] [DEBUG] [LOCAL ] FDP: Loaded 30760 existing records from primary storage. [2025-09-28T02:14:49.989887] [INFO ] [MAIN ] FDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:49.991237] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDS took 0.7s. Estimated remaining: 23m 32s. Rate: 66.1 symbols/min [2025-09-28T02:14:49.991054] [INFO ] [MAIN ] FDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:50.108411] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:50.038202] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FDP took 1.2s. Estimated remaining: 23m 30s. Rate: 66.2 symbols/min [2025-09-28T02:14:50.350737] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-28T02:14:50.398952] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-28T02:14:50.464180] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:50.463270] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:50.481331] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-28T02:14:50.481448] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-28T02:14:50.481605] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-28T02:14:50.481759] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-28T02:14:50.481862] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-28T02:14:50.481933] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-28T02:14:50.612195] [DEBUG] [LOCAL ] FDX: Loaded 52362 existing records from primary storage. [2025-09-28T02:14:50.634795] [INFO ] [MAIN ] FDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:50.669673] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FDX took 0.8s. Estimated remaining: 23m 28s. Rate: 66.2 symbols/min [2025-09-28T02:14:50.947700] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-28T02:14:50.974541] [DEBUG] [LOCAL ] FE: Loaded 54208 existing records from primary storage. [2025-09-28T02:14:50.976561] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-28T02:14:50.983199] [INFO ] [MAIN ] FE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:50.993925] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FE took 1.0s. Estimated remaining: 23m 26s. Rate: 66.3 symbols/min [2025-09-28T02:14:51.194721] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:51.206385] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:14:51.248188] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-28T02:14:51.348211] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:51.364220] [DEBUG] [LOCAL ] FET: Loaded 12984 existing records from primary storage. [2025-09-28T02:14:51.364532] [INFO ] [MAIN ] FET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:51.364639] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FET took 0.3s. Estimated remaining: 23m 24s. Rate: 66.3 symbols/min [2025-09-28T02:14:51.553952] [DEBUG] [LOCAL ] FERG: Loaded 49691 existing records from primary storage. [2025-09-28T02:14:51.590677] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:51.591028] [INFO ] [MAIN ] FERG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:51.591206] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FERG took 0.9s. Estimated remaining: 23m 22s. Rate: 66.4 symbols/min [2025-09-28T02:14:51.647321] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-28T02:14:51.673064] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-28T02:14:51.700049] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-28T02:14:51.720519] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-28T02:14:51.805853] [DEBUG] [LOCAL ] FF: Loaded 25768 existing records from primary storage. [2025-09-28T02:14:51.829143] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:51.829308] [INFO ] [MAIN ] FF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:51.829636] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FF took 0.5s. Estimated remaining: 23m 20s. Rate: 66.4 symbols/min [2025-09-28T02:14:51.943993] [DEBUG] [LOCAL ] FFA: Loaded 5800 existing records from primary storage. [2025-09-28T02:14:51.962848] [INFO ] [MAIN ] FFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:51.963038] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FFA took 0.4s. Estimated remaining: 23m 18s. Rate: 66.5 symbols/min [2025-09-28T02:14:52.166373] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:52.193135] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-28T02:14:52.197312] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-28T02:14:52.230346] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-28T02:14:52.304184] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:52.285073] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-28T02:14:52.305431] [DEBUG] [LOCAL ] FFWM: No existing data file found in primary storage. [2025-09-28T02:14:52.305615] [WARN ] [MAIN ] FFWM: No existing data found, performing full refresh instead. [2025-09-28T02:14:52.305773] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-28T02:14:52.305854] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-28T02:14:52.305917] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-09-28T02:14:52.305963] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-28T02:14:52.365463] [DEBUG] [LOCAL ] FFC: Loaded 16899 existing records from primary storage. [2025-09-28T02:14:52.400970] [INFO ] [MAIN ] FFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:52.430929] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFC took 0.6s. Estimated remaining: 23m 16s. Rate: 66.5 symbols/min [2025-09-28T02:14:52.767859] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:52.855916] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-28T02:14:52.857869] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-28T02:14:52.873891] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-28T02:14:52.886014] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-28T02:14:52.960727] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:14:52.961333] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-28T02:14:52.972477] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-09-28T02:14:52.972852] [INFO ] [MAIN ] FG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:52.972960] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FG took 0.5s. Estimated remaining: 23m 14s. Rate: 66.6 symbols/min [2025-09-28T02:14:53.162925] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:53.168907] [DEBUG] [LOCAL ] FGN: Loaded 3915 existing records from primary storage. [2025-09-28T02:14:53.169154] [INFO ] [MAIN ] FGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:53.169260] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FGN took 0.2s. Estimated remaining: 23m 12s. Rate: 66.6 symbols/min [2025-09-28T02:14:53.273984] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-28T02:14:53.288254] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-28T02:14:53.372510] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:53.372761] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-28T02:14:53.372834] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-28T02:14:53.372950] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-28T02:14:53.373021] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-28T02:14:53.373102] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-28T02:14:53.373173] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-28T02:14:53.464723] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-28T02:14:53.489802] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-28T02:14:53.776476] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:14:53.776901] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-28T02:14:53.794227] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-28T02:14:53.795351] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-28T02:14:53.989269] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:14:53.989723] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-28T02:14:53.989844] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:14:53.989947] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-09-28T02:14:53.990036] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:14:53.990141] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-28T02:14:53.990262] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-28T02:14:53.990386] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-28T02:14:53.990525] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-28T02:14:53.990629] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGSN took 0.8s. Estimated remaining: 23m 11s. Rate: 66.6 symbols/min [2025-09-28T02:14:54.096601] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-28T02:14:54.178497] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-28T02:14:54.209432] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:54.251807] [DEBUG] [LOCAL ] FHI: Loaded 41203 existing records from primary storage. [2025-09-28T02:14:54.252231] [INFO ] [MAIN ] FHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:54.252992] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FHI took 0.3s. Estimated remaining: 23m 9s. Rate: 66.7 symbols/min [2025-09-28T02:14:54.265787] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-28T02:14:54.389337] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-28T02:14:54.475124] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:54.530763] [DEBUG] [LOCAL ] FHN: Loaded 54148 existing records from primary storage. [2025-09-28T02:14:54.531146] [INFO ] [MAIN ] FHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:54.531272] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FHN took 0.3s. Estimated remaining: 23m 7s. Rate: 66.8 symbols/min [2025-09-28T02:14:54.720877] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:54.757249] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-28T02:14:54.779736] [DEBUG] [LOCAL ] FI: Loaded 54281 existing records from primary storage. [2025-09-28T02:14:54.780142] [INFO ] [MAIN ] FI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:54.780806] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FI took 0.2s. Estimated remaining: 23m 5s. Rate: 66.8 symbols/min [2025-09-28T02:14:54.968268] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:54.995066] [DEBUG] [LOCAL ] FICO: Loaded 20674 existing records from primary storage. [2025-09-28T02:14:54.995393] [INFO ] [MAIN ] FICO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:54.995497] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FICO took 0.2s. Estimated remaining: 23m 3s. Rate: 66.9 symbols/min [2025-09-28T02:14:55.063139] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-28T02:14:55.226162] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:55.226439] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-28T02:14:55.226515] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-28T02:14:55.226853] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-28T02:14:55.226931] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-28T02:14:55.227052] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-28T02:14:55.227128] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-28T02:14:55.489806] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-28T02:14:55.619403] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:14:55.855729] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-28T02:14:56.290841] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-28T02:14:56.291954] [INFO ] [REMOTE ] FCRX: Full fetch complete (1674 records). [2025-09-28T02:14:56.292052] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-28T02:14:56.493874] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-28T02:14:56.494153] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:14:56.494232] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:14:56.494312] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-28T02:14:56.494429] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-28T02:14:56.494509] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-28T02:14:56.494600] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-28T02:14:56.494727] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FCRX took 8.4s. Estimated remaining: 23m 3s. Rate: 66.8 symbols/min [2025-09-28T02:14:56.662868] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-28T02:14:56.691595] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:56.745066] [DEBUG] [LOCAL ] FIGS: Loaded 49651 existing records from primary storage. [2025-09-28T02:14:56.745454] [INFO ] [MAIN ] FIGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:56.745561] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FIGS took 0.3s. Estimated remaining: 23m 1s. Rate: 66.9 symbols/min [2025-09-28T02:14:56.939149] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:56.980625] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-28T02:14:56.981027] [INFO ] [MAIN ] FIHL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:56.981133] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FIHL took 0.2s. Estimated remaining: 22m 59s. Rate: 66.9 symbols/min [2025-09-28T02:14:57.059520] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-28T02:14:57.170437] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:57.180182] [DEBUG] [LOCAL ] FINS: Loaded 8309 existing records from primary storage. [2025-09-28T02:14:57.180440] [INFO ] [MAIN ] FINS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:57.180539] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FINS took 0.2s. Estimated remaining: 22m 56s. Rate: 67.0 symbols/min [2025-09-28T02:14:57.367632] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:57.410088] [DEBUG] [LOCAL ] FINV: Loaded 45772 existing records from primary storage. [2025-09-28T02:14:57.410462] [INFO ] [MAIN ] FINV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:57.410568] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FINV took 0.2s. Estimated remaining: 22m 54s. Rate: 67.1 symbols/min [2025-09-28T02:14:57.460852] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-28T02:14:57.609683] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:57.663735] [DEBUG] [LOCAL ] FIS: Loaded 54144 existing records from primary storage. [2025-09-28T02:14:57.664160] [INFO ] [MAIN ] FIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:57.664268] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FIS took 0.3s. Estimated remaining: 22m 52s. Rate: 67.1 symbols/min [2025-09-28T02:14:57.808723] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-28T02:14:57.857167] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:14:57.892421] [DEBUG] [LOCAL ] FIX: Loaded 30763 existing records from primary storage. [2025-09-28T02:14:57.892853] [INFO ] [MAIN ] FIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:14:57.895002] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIX took 0.2s. Estimated remaining: 22m 50s. Rate: 67.2 symbols/min [2025-09-28T02:14:58.255708] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-28T02:14:58.588867] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-28T02:14:59.055729] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-28T02:14:59.415077] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-28T02:14:59.855771] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-28T02:15:00.097251] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-28T02:15:00.655775] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-28T02:15:00.991279] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-28T02:15:01.455748] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-28T02:15:01.885875] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-28T02:15:02.255720] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-28T02:15:02.493602] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:15:02.494071] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-28T02:15:02.494184] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:15:02.494331] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-09-28T02:15:02.494426] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:15:02.494547] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-28T02:15:02.494718] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-28T02:15:02.494825] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-28T02:15:02.494958] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-28T02:15:02.495072] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIG took 7.5s. Estimated remaining: 22m 56s. Rate: 66.8 symbols/min [2025-09-28T02:15:03.055763] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-28T02:15:03.855776] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-28T02:15:04.246842] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-28T02:15:04.542565] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-28T02:15:04.655757] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-28T02:15:05.455796] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-28T02:15:05.812991] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-28T02:15:06.049934] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-28T02:15:06.255711] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-28T02:15:06.722884] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-28T02:15:06.724196] [INFO ] [REMOTE ] FENG: Full fetch complete (2245 records). [2025-09-28T02:15:06.724296] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-28T02:15:06.925271] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:15:06.925504] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:15:06.925582] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:15:06.925686] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-28T02:15:06.925815] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-28T02:15:06.925895] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-28T02:15:06.925982] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-28T02:15:06.926082] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FENG took 16.8s. Estimated remaining: 23m 1s. Rate: 66.5 symbols/min [2025-09-28T02:15:07.055800] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-28T02:15:08.399593] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-28T02:15:08.408226] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-28T02:15:10.052823] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-28T02:15:10.063754] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-28T02:15:11.601356] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-28T02:15:11.609916] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-28T02:15:12.846268] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-28T02:15:12.853914] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-28T02:15:14.313085] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-28T02:15:14.322886] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-28T02:15:15.806414] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-28T02:15:15.815071] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-28T02:15:17.087347] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-28T02:15:17.094682] [INFO ] [REMOTE ] FFWM: Full fetch complete (51691 records). [2025-09-28T02:15:17.094870] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-28T02:15:17.529759] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-28T02:15:17.529900] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-28T02:15:17.530541] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-28T02:15:17.530625] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-28T02:15:17.532319] [DEBUG] [LOCAL ] FFWM: Trimmed 51691 records to 36532 (keeping 200 days of data) [2025-09-28T02:15:17.739731] [DEBUG] [LOCAL ] FFWM: Primary data saved (36532 records). [2025-09-28T02:15:17.739925] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-28T02:15:17.740094] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FFWM took 25.8s. Estimated remaining: 23m 19s. Rate: 65.7 symbols/min [2025-09-28T02:15:18.446105] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:18.467799] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:18.530384] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:18.552334] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:18.550780] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-28T02:15:18.553110] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-28T02:15:18.553467] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-28T02:15:18.553694] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-28T02:15:18.553870] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-28T02:15:18.554490] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-28T02:15:18.652377] [DEBUG] [LOCAL ] FLC: Loaded 5559 existing records from primary storage. [2025-09-28T02:15:18.680267] [INFO ] [MAIN ] FLC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:18.680552] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FLC took 0.9s. Estimated remaining: 23m 18s. Rate: 65.7 symbols/min [2025-09-28T02:15:18.837027] [DEBUG] [LOCAL ] FLNG: Loaded 34431 existing records from primary storage. [2025-09-28T02:15:18.914221] [INFO ] [MAIN ] FLNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:19.004630] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLNG took 1.2s. Estimated remaining: 23m 16s. Rate: 65.7 symbols/min [2025-09-28T02:15:19.093470] [DEBUG] [LOCAL ] FLG: Loaded 54105 existing records from primary storage. [2025-09-28T02:15:19.132718] [INFO ] [MAIN ] FLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:19.232129] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:19.251111] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLG took 1.5s. Estimated remaining: 23m 14s. Rate: 65.8 symbols/min [2025-09-28T02:15:19.597636] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:15:19.617522] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-28T02:15:19.644052] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:19.669339] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-28T02:15:19.669482] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-28T02:15:19.716799] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-28T02:15:19.722193] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:19.724175] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-28T02:15:19.740950] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-28T02:15:19.741768] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-28T02:15:19.749013] [DEBUG] [LOCAL ] FLO: Loaded 52656 existing records from primary storage. [2025-09-28T02:15:19.778898] [INFO ] [MAIN ] FLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:19.785785] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLO took 1.1s. Estimated remaining: 23m 12s. Rate: 65.8 symbols/min [2025-09-28T02:15:19.941315] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:15:19.977710] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-28T02:15:20.007700] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:15:20.019377] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-09-28T02:15:20.076301] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:15:20.206085] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-28T02:15:20.239488] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:20.239712] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-28T02:15:20.257613] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-28T02:15:20.342249] [DEBUG] [LOCAL ] FLR: Loaded 53892 existing records from primary storage. [2025-09-28T02:15:20.348745] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-28T02:15:20.359400] [INFO ] [MAIN ] FLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:20.381223] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLR took 1.1s. Estimated remaining: 23m 11s. Rate: 65.8 symbols/min [2025-09-28T02:15:20.414233] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FIXT took 2.6s. Estimated remaining: 23m 8s. Rate: 65.9 symbols/min [2025-09-28T02:15:20.511283] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:15:20.578922] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-28T02:15:20.808713] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:20.815609] [DEBUG] [LOCAL ] FLS: Loaded 50934 existing records from primary storage. [2025-09-28T02:15:20.838185] [INFO ] [MAIN ] FLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:20.849428] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLS took 1.1s. Estimated remaining: 23m 6s. Rate: 66.0 symbols/min [2025-09-28T02:15:20.969273] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:20.933670] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:15:20.997510] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-28T02:15:21.009569] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:15:21.038549] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-09-28T02:15:21.064162] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:15:21.080062] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-28T02:15:21.135979] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:21.140585] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-28T02:15:21.154897] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-28T02:15:21.155307] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-28T02:15:21.155445] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLOC took 2.1s. Estimated remaining: 23m 4s. Rate: 66.0 symbols/min [2025-09-28T02:15:21.164142] [DEBUG] [LOCAL ] FLXR: Loaded 20315 existing records from primary storage. [2025-09-28T02:15:21.198295] [DEBUG] [LOCAL ] FLUT: Loaded 51580 existing records from primary storage. [2025-09-28T02:15:21.215244] [INFO ] [MAIN ] FLUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:21.215382] [INFO ] [MAIN ] FLXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:21.247879] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLUT took 0.8s. Estimated remaining: 23m 2s. Rate: 66.1 symbols/min [2025-09-28T02:15:21.287957] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLXR took 0.7s. Estimated remaining: 22m 60s. Rate: 66.2 symbols/min [2025-09-28T02:15:21.536038] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:21.704784] [DEBUG] [LOCAL ] FMC: Loaded 52560 existing records from primary storage. [2025-09-28T02:15:21.742619] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:21.742939] [DEBUG] [LOCAL ] FMN: Loaded 6097 existing records from primary storage. [2025-09-28T02:15:21.764820] [INFO ] [MAIN ] FMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:21.777350] [INFO ] [MAIN ] FMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:21.794774] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMC took 0.9s. Estimated remaining: 22m 58s. Rate: 66.2 symbols/min [2025-09-28T02:15:21.818483] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:21.819127] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMN took 0.6s. Estimated remaining: 22m 55s. Rate: 66.3 symbols/min [2025-09-28T02:15:22.046317] [DEBUG] [LOCAL ] FMS: Loaded 30771 existing records from primary storage. [2025-09-28T02:15:22.077623] [INFO ] [MAIN ] FMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:22.130022] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMS took 0.8s. Estimated remaining: 22m 53s. Rate: 66.3 symbols/min [2025-09-28T02:15:22.164833] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:22.183685] [DEBUG] [LOCAL ] FMY: No existing data file found in primary storage. [2025-09-28T02:15:22.232265] [WARN ] [MAIN ] FMY: No existing data found, performing full refresh instead. [2025-09-28T02:15:22.317383] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-28T02:15:22.337407] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-28T02:15:22.350194] [DEBUG] [LOCAL ] FMY: No primary data file found to delete. [2025-09-28T02:15:22.369678] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-28T02:15:22.411687] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:22.407974] [DEBUG] [LOCAL ] FMX: Loaded 41276 existing records from primary storage. [2025-09-28T02:15:22.428230] [INFO ] [MAIN ] FMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:22.502264] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMX took 1.2s. Estimated remaining: 22m 52s. Rate: 66.4 symbols/min [2025-09-28T02:15:22.586311] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:23.018347] [DEBUG] [LOCAL ] FN: Loaded 39795 existing records from primary storage. [2025-09-28T02:15:23.000586] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:23.025998] [INFO ] [MAIN ] FN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:23.052272] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FN took 1.2s. Estimated remaining: 22m 50s. Rate: 66.4 symbols/min [2025-09-28T02:15:23.290404] [DEBUG] [LOCAL ] FNB: Loaded 53226 existing records from primary storage. [2025-09-28T02:15:23.322564] [INFO ] [MAIN ] FNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:23.311228] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:15:23.348065] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FNB took 1.2s. Estimated remaining: 22m 48s. Rate: 66.4 symbols/min [2025-09-28T02:15:23.350783] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-28T02:15:23.483586] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:23.561995] [DEBUG] [LOCAL ] FND: Loaded 52871 existing records from primary storage. [2025-09-28T02:15:23.594053] [INFO ] [MAIN ] FND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:23.608340] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FND took 1.1s. Estimated remaining: 22m 46s. Rate: 66.5 symbols/min [2025-09-28T02:15:23.751310] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:23.783699] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-28T02:15:23.801101] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-28T02:15:23.924040] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:23.940757] [DEBUG] [LOCAL ] FNF: Loaded 49871 existing records from primary storage. [2025-09-28T02:15:23.941515] [INFO ] [MAIN ] FNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:23.941625] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNF took 0.8s. Estimated remaining: 22m 44s. Rate: 66.5 symbols/min [2025-09-28T02:15:24.064207] [DEBUG] [LOCAL ] FOA: Loaded 13484 existing records from primary storage. [2025-09-28T02:15:24.083480] [INFO ] [MAIN ] FOA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:24.088910] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FOA took 0.5s. Estimated remaining: 22m 42s. Rate: 66.6 symbols/min [2025-09-28T02:15:24.215006] [DEBUG] [LOCAL ] FNV: Loaded 47028 existing records from primary storage. [2025-09-28T02:15:24.276808] [INFO ] [MAIN ] FNV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:24.299248] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:24.297997] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FNV took 0.9s. Estimated remaining: 22m 40s. Rate: 66.7 symbols/min [2025-09-28T02:15:24.414273] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-28T02:15:24.480870] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:24.471222] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-28T02:15:24.497004] [DEBUG] [LOCAL ] FOF: Loaded 8510 existing records from primary storage. [2025-09-28T02:15:24.518361] [INFO ] [MAIN ] FOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:24.588620] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:24.588795] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOF took 0.6s. Estimated remaining: 22m 38s. Rate: 66.7 symbols/min [2025-09-28T02:15:24.725562] [DEBUG] [LOCAL ] FOR: Loaded 20362 existing records from primary storage. [2025-09-28T02:15:24.737415] [INFO ] [MAIN ] FOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:24.754106] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOR took 0.7s. Estimated remaining: 22m 36s. Rate: 66.8 symbols/min [2025-09-28T02:15:24.806063] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:25.010389] [DEBUG] [LOCAL ] FOUR: Loaded 50306 existing records from primary storage. [2025-09-28T02:15:25.042069] [DEBUG] [LOCAL ] FPF: Loaded 17998 existing records from primary storage. [2025-09-28T02:15:25.049767] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-28T02:15:25.049590] [INFO ] [MAIN ] FOUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:25.050238] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOUR took 0.7s. Estimated remaining: 22m 34s. Rate: 66.8 symbols/min [2025-09-28T02:15:25.050506] [INFO ] [MAIN ] FPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:25.049458] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:25.063154] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-28T02:15:25.075896] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPF took 0.5s. Estimated remaining: 22m 31s. Rate: 66.9 symbols/min [2025-09-28T02:15:25.318227] [DEBUG] [LOCAL ] FPH: Loaded 19890 existing records from primary storage. [2025-09-28T02:15:25.423159] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:25.412770] [INFO ] [MAIN ] FPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:25.449435] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:25.449718] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FPH took 0.6s. Estimated remaining: 22m 29s. Rate: 67.0 symbols/min [2025-09-28T02:15:25.570488] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-28T02:15:25.577206] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-28T02:15:25.678382] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:25.690175] [DEBUG] [LOCAL ] FPI: Loaded 31525 existing records from primary storage. [2025-09-28T02:15:25.690947] [INFO ] [MAIN ] FPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:25.691110] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FPI took 0.6s. Estimated remaining: 22m 27s. Rate: 67.0 symbols/min [2025-09-28T02:15:25.843049] [DEBUG] [LOCAL ] FRA: Loaded 14717 existing records from primary storage. [2025-09-28T02:15:25.825999] [DEBUG] [LOCAL ] FR: Loaded 47174 existing records from primary storage. [2025-09-28T02:15:25.844810] [INFO ] [MAIN ] FRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:25.845532] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FRA took 0.4s. Estimated remaining: 22m 25s. Rate: 67.1 symbols/min [2025-09-28T02:15:25.845780] [INFO ] [MAIN ] FR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:25.879965] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FR took 0.8s. Estimated remaining: 22m 23s. Rate: 67.2 symbols/min [2025-09-28T02:15:26.036533] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-28T02:15:26.010754] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:26.066636] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-28T02:15:26.297324] [DEBUG] [LOCAL ] FRGE: Loaded 18571 existing records from primary storage. [2025-09-28T02:15:26.291394] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:26.337301] [INFO ] [MAIN ] FRGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:26.362516] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:26.362744] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FRGE took 0.7s. Estimated remaining: 22m 21s. Rate: 67.2 symbols/min [2025-09-28T02:15:26.593458] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:26.596967] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-28T02:15:26.599317] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-28T02:15:26.635629] [DEBUG] [LOCAL ] FRT: Loaded 42808 existing records from primary storage. [2025-09-28T02:15:26.634766] [DEBUG] [LOCAL ] FRO: Loaded 52603 existing records from primary storage. [2025-09-28T02:15:26.636300] [INFO ] [MAIN ] FRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:26.636400] [INFO ] [MAIN ] FRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:26.637267] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRO took 0.8s. Estimated remaining: 22m 19s. Rate: 67.2 symbols/min [2025-09-28T02:15:26.637677] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRT took 0.7s. Estimated remaining: 22m 17s. Rate: 67.3 symbols/min [2025-09-28T02:15:26.935682] [DEBUG] [LOCAL ] FSCO: Loaded 37725 existing records from primary storage. [2025-09-28T02:15:27.047399] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:27.038774] [INFO ] [MAIN ] FSCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:27.079848] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-28T02:15:27.082029] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-28T02:15:27.080729] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FSCO took 0.7s. Estimated remaining: 22m 15s. Rate: 67.4 symbols/min [2025-09-28T02:15:27.077070] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:27.312259] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:27.347415] [DEBUG] [LOCAL ] FSLY: Loaded 51989 existing records from primary storage. [2025-09-28T02:15:27.347966] [INFO ] [MAIN ] FSLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:27.348190] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FSLY took 0.7s. Estimated remaining: 22m 13s. Rate: 67.4 symbols/min [2025-09-28T02:15:27.451104] [DEBUG] [LOCAL ] FSK: Loaded 50173 existing records from primary storage. [2025-09-28T02:15:27.502749] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-28T02:15:27.510457] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-28T02:15:27.503506] [INFO ] [MAIN ] FSK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:27.543905] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 0.9s. Estimated remaining: 22m 11s. Rate: 67.5 symbols/min [2025-09-28T02:15:27.691499] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:27.719008] [DEBUG] [LOCAL ] FSM: Loaded 54065 existing records from primary storage. [2025-09-28T02:15:27.729994] [INFO ] [MAIN ] FSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:27.730942] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSM took 0.6s. Estimated remaining: 22m 9s. Rate: 67.5 symbols/min [2025-09-28T02:15:27.982453] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:28.067328] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:28.069017] [DEBUG] [LOCAL ] FSS: Loaded 34888 existing records from primary storage. [2025-09-28T02:15:28.069610] [INFO ] [MAIN ] FSS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:28.070168] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSS took 0.7s. Estimated remaining: 22m 7s. Rate: 67.6 symbols/min [2025-09-28T02:15:28.157405] [DEBUG] [LOCAL ] FT: Loaded 6432 existing records from primary storage. [2025-09-28T02:15:28.162917] [INFO ] [MAIN ] FT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:28.136054] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-28T02:15:28.183974] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FT took 0.6s. Estimated remaining: 22m 5s. Rate: 67.6 symbols/min [2025-09-28T02:15:28.190870] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-28T02:15:28.223478] [DEBUG] [LOCAL ] FTHY: Loaded 11947 existing records from primary storage. [2025-09-28T02:15:28.264765] [INFO ] [MAIN ] FTHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:28.285015] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:28.285204] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FTHY took 0.5s. Estimated remaining: 22m 3s. Rate: 67.7 symbols/min [2025-09-28T02:15:28.338920] [DEBUG] [LOCAL ] FTI: Loaded 54078 existing records from primary storage. [2025-09-28T02:15:28.339331] [INFO ] [MAIN ] FTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:28.339438] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTI took 0.3s. Estimated remaining: 22m 1s. Rate: 67.8 symbols/min [2025-09-28T02:15:28.719767] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-28T02:15:28.721155] [INFO ] [REMOTE ] FMY: Full fetch complete (1968 records). [2025-09-28T02:15:28.721268] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-28T02:15:29.134370] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-28T02:15:29.134496] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-28T02:15:29.134662] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-28T02:15:29.134745] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-28T02:15:29.135204] [DEBUG] [LOCAL ] FMY: Trimmed 1968 records to 1400 (keeping 200 days of data) [2025-09-28T02:15:29.144771] [DEBUG] [LOCAL ] FMY: Primary data saved (1400 records). [2025-09-28T02:15:29.144884] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-28T02:15:29.144995] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FMY took 7.3s. Estimated remaining: 21m 60s. Rate: 67.8 symbols/min [2025-09-28T02:15:29.839916] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:29.956224] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:29.984205] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:30.016427] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:30.025626] [DEBUG] [LOCAL ] FTWO: Loaded 1837 existing records from primary storage. [2025-09-28T02:15:30.026258] [INFO ] [MAIN ] FTWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:30.026481] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 0.9s. Estimated remaining: 21m 59s. Rate: 67.8 symbols/min [2025-09-28T02:15:30.188024] [DEBUG] [LOCAL ] FTK: Loaded 32755 existing records from primary storage. [2025-09-28T02:15:30.228578] [INFO ] [MAIN ] FTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:30.277272] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTK took 1.1s. Estimated remaining: 21m 57s. Rate: 67.9 symbols/min [2025-09-28T02:15:30.282808] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:30.365855] [DEBUG] [LOCAL ] FTV: Loaded 53686 existing records from primary storage. [2025-09-28T02:15:30.359291] [DEBUG] [LOCAL ] FTS: Loaded 42695 existing records from primary storage. [2025-09-28T02:15:30.398538] [INFO ] [MAIN ] FTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:30.393140] [INFO ] [MAIN ] FTV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:30.421149] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTS took 1.3s. Estimated remaining: 21m 55s. Rate: 67.9 symbols/min [2025-09-28T02:15:30.436585] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 1.3s. Estimated remaining: 21m 52s. Rate: 68.0 symbols/min [2025-09-28T02:15:30.729313] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:30.934293] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:30.938707] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:30.975480] [DEBUG] [LOCAL ] FUBO: Loaded 54476 existing records from primary storage. [2025-09-28T02:15:30.976756] [INFO ] [MAIN ] FUBO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:30.977802] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUBO took 1.0s. Estimated remaining: 21m 51s. Rate: 68.0 symbols/min [2025-09-28T02:15:31.143101] [DEBUG] [LOCAL ] FUL: Loaded 33570 existing records from primary storage. [2025-09-28T02:15:31.150743] [DEBUG] [LOCAL ] FVR: Loaded 22328 existing records from primary storage. [2025-09-28T02:15:31.189511] [INFO ] [MAIN ] FUL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:31.228066] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:31.207692] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUL took 0.9s. Estimated remaining: 21m 49s. Rate: 68.1 symbols/min [2025-09-28T02:15:31.228746] [INFO ] [MAIN ] FVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:31.276860] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FVR took 0.8s. Estimated remaining: 21m 47s. Rate: 68.2 symbols/min [2025-09-28T02:15:31.505909] [DEBUG] [LOCAL ] FUN: Loaded 52349 existing records from primary storage. [2025-09-28T02:15:31.545949] [INFO ] [MAIN ] FUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:31.595562] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUN took 1.2s. Estimated remaining: 21m 45s. Rate: 68.2 symbols/min [2025-09-28T02:15:31.690625] [DEBUG] [LOCAL ] FVRR: Loaded 40749 existing records from primary storage. [2025-09-28T02:15:31.693581] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:31.741386] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:31.740307] [INFO ] [MAIN ] FVRR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:31.753162] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FVRR took 0.8s. Estimated remaining: 21m 43s. Rate: 68.3 symbols/min [2025-09-28T02:15:31.861742] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-09-28T02:15:31.911130] [INFO ] [MAIN ] FXED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:31.968166] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FXED took 0.7s. Estimated remaining: 21m 41s. Rate: 68.3 symbols/min [2025-09-28T02:15:32.116634] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:32.173730] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:32.265213] [DEBUG] [LOCAL ] G: Loaded 50547 existing records from primary storage. [2025-09-28T02:15:32.266602] [INFO ] [MAIN ] G: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:32.319477] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. G took 1.0s. Estimated remaining: 21m 39s. Rate: 68.4 symbols/min [2025-09-28T02:15:32.329964] [DEBUG] [LOCAL ] GAM: Loaded 4174 existing records from primary storage. [2025-09-28T02:15:32.368400] [INFO ] [MAIN ] GAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:32.399358] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAM took 0.6s. Estimated remaining: 21m 37s. Rate: 68.4 symbols/min [2025-09-28T02:15:32.368145] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:32.421015] [DEBUG] [LOCAL ] GAP: No existing data file found in primary storage. [2025-09-28T02:15:32.440418] [DEBUG] [LOCAL ] GAB: Loaded 28493 existing records from primary storage. [2025-09-28T02:15:32.438677] [WARN ] [MAIN ] GAP: No existing data found, performing full refresh instead. [2025-09-28T02:15:32.457952] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-28T02:15:32.471148] [INFO ] [MAIN ] GAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:32.498627] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-28T02:15:32.527899] [DEBUG] [LOCAL ] GAP: No primary data file found to delete. [2025-09-28T02:15:32.533336] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-28T02:15:32.498907] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GAB took 0.9s. Estimated remaining: 21m 35s. Rate: 68.5 symbols/min [2025-09-28T02:15:33.133073] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:33.147198] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:33.148403] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:33.197977] [DEBUG] [LOCAL ] GATX: No existing data file found in primary storage. [2025-09-28T02:15:33.191383] [DEBUG] [LOCAL ] GBCI: No existing data file found in primary storage. [2025-09-28T02:15:33.209829] [WARN ] [MAIN ] GBCI: No existing data found, performing full refresh instead. [2025-09-28T02:15:33.209880] [WARN ] [MAIN ] GATX: No existing data found, performing full refresh instead. [2025-09-28T02:15:33.258762] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-28T02:15:33.259240] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-28T02:15:33.285385] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-28T02:15:33.290728] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-28T02:15:33.321383] [DEBUG] [LOCAL ] GBCI: No primary data file found to delete. [2025-09-28T02:15:33.332380] [DEBUG] [LOCAL ] GATX: No primary data file found to delete. [2025-09-28T02:15:33.342885] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-28T02:15:33.348244] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-28T02:15:33.369982] [DEBUG] [LOCAL ] GBAB: Loaded 13142 existing records from primary storage. [2025-09-28T02:15:33.417543] [INFO ] [MAIN ] GBAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:33.459823] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GBAB took 1.0s. Estimated remaining: 21m 34s. Rate: 68.5 symbols/min [2025-09-28T02:15:33.758081] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:15:33.869124] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-28T02:15:34.103445] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:34.196031] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-28T02:15:34.253379] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-28T02:15:34.329362] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-28T02:15:34.368031] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:15:34.381621] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-28T02:15:34.373468] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-28T02:15:34.395519] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-28T02:15:34.401449] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-28T02:15:34.498806] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:15:34.553800] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-28T02:15:34.887079] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:15:34.887470] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-28T02:15:35.318834] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-28T02:15:35.320273] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-28T02:15:35.679866] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-28T02:15:35.685162] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-28T02:15:35.823873] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-28T02:15:35.836776] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-28T02:15:35.839758] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-28T02:15:35.841893] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-28T02:15:35.906229] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-28T02:15:35.917072] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-28T02:15:36.082581] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-28T02:15:36.084176] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-28T02:15:36.450327] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-28T02:15:36.452023] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-28T02:15:36.485893] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-28T02:15:36.493864] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-28T02:15:37.051945] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-28T02:15:37.053575] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-28T02:15:37.236350] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-28T02:15:37.245507] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-28T02:15:37.462878] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-28T02:15:37.467191] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-28T02:15:37.506476] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-28T02:15:37.507820] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-28T02:15:37.572689] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-28T02:15:37.583997] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-28T02:15:37.820671] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-28T02:15:37.821856] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-28T02:15:38.114334] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-28T02:15:38.115419] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-28T02:15:38.195682] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-28T02:15:38.199995] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-28T02:15:38.592107] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-28T02:15:38.593952] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-28T02:15:38.621178] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-28T02:15:39.036215] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-28T02:15:39.037222] [INFO ] [REMOTE ] GBLI: Full fetch complete (1330 records). [2025-09-28T02:15:39.037575] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-28T02:15:39.061773] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-28T02:15:39.261213] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-28T02:15:39.261856] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:15:39.262358] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:15:39.267847] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-28T02:15:39.278743] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-28T02:15:39.278963] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-28T02:15:39.281911] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-28T02:15:39.282070] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GBLI took 5.7s. Estimated remaining: 21m 41s. Rate: 68.1 symbols/min [2025-09-28T02:15:39.338274] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-28T02:15:39.498787] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:39.532541] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-28T02:15:39.593160] [DEBUG] [LOCAL ] GBTG: Loaded 40807 existing records from primary storage. [2025-09-28T02:15:39.593555] [INFO ] [MAIN ] GBTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:39.594298] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GBTG took 0.3s. Estimated remaining: 21m 39s. Rate: 68.1 symbols/min [2025-09-28T02:15:39.786555] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:39.821190] [DEBUG] [LOCAL ] GBX: Loaded 29497 existing records from primary storage. [2025-09-28T02:15:39.821581] [INFO ] [MAIN ] GBX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:39.822167] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBX took 0.2s. Estimated remaining: 21m 37s. Rate: 68.2 symbols/min [2025-09-28T02:15:39.860833] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-28T02:15:40.015675] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:40.062695] [DEBUG] [LOCAL ] GCI: Loaded 44828 existing records from primary storage. [2025-09-28T02:15:40.063102] [INFO ] [MAIN ] GCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:40.063788] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GCI took 0.2s. Estimated remaining: 21m 35s. Rate: 68.2 symbols/min [2025-09-28T02:15:40.256301] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:40.286637] [DEBUG] [LOCAL ] GCO: Loaded 25686 existing records from primary storage. [2025-09-28T02:15:40.287213] [INFO ] [MAIN ] GCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:40.287350] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GCO took 0.2s. Estimated remaining: 21m 33s. Rate: 68.3 symbols/min [2025-09-28T02:15:40.475498] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:40.496129] [DEBUG] [LOCAL ] GCTS: Loaded 20060 existing records from primary storage. [2025-09-28T02:15:40.496465] [INFO ] [MAIN ] GCTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:40.496570] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GCTS took 0.2s. Estimated remaining: 21m 31s. Rate: 68.3 symbols/min [2025-09-28T02:15:40.659270] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-28T02:15:40.686224] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:40.686851] [DEBUG] [LOCAL ] GCV: No existing data file found in primary storage. [2025-09-28T02:15:40.686944] [WARN ] [MAIN ] GCV: No existing data found, performing full refresh instead. [2025-09-28T02:15:40.687085] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-28T02:15:40.687175] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-28T02:15:40.687274] [DEBUG] [LOCAL ] GCV: No primary data file found to delete. [2025-09-28T02:15:40.687358] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-28T02:15:41.067700] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-28T02:15:41.114915] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:15:41.420303] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-28T02:15:41.455748] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-28T02:15:41.756163] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-28T02:15:42.255708] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-28T02:15:43.051122] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-28T02:15:43.060955] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-28T02:15:43.728319] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-28T02:15:43.855746] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-28T02:15:44.061218] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-28T02:15:44.208181] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-28T02:15:44.655763] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-28T02:15:45.455753] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-28T02:15:45.626284] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-28T02:15:45.811325] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-28T02:15:46.255742] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-28T02:15:46.852016] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-28T02:15:47.055750] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-28T02:15:47.855703] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-28T02:15:48.069156] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-28T02:15:48.655730] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-28T02:15:49.202600] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-28T02:15:49.455733] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-28T02:15:49.516943] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-28T02:15:50.255728] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-28T02:15:50.956604] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-28T02:15:51.055740] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-28T02:15:51.398876] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-28T02:15:51.855738] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-28T02:15:51.989037] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-28T02:15:52.655718] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-28T02:15:53.455754] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-28T02:15:53.562477] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-28T02:15:53.799558] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-28T02:15:53.805486] [INFO ] [REMOTE ] GATX: Full fetch complete (25421 records). [2025-09-28T02:15:53.805770] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-28T02:15:54.228190] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-28T02:15:54.228311] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-28T02:15:54.228789] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-28T02:15:54.228875] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-28T02:15:54.229722] [DEBUG] [LOCAL ] GATX: Trimmed 25421 records to 18437 (keeping 200 days of data) [2025-09-28T02:15:54.283239] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-28T02:15:54.362034] [DEBUG] [LOCAL ] GATX: Primary data saved (18437 records). [2025-09-28T02:15:54.362329] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-28T02:15:54.362583] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GATX took 22.0s. Estimated remaining: 21m 52s. Rate: 67.2 symbols/min [2025-09-28T02:15:54.550462] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:54.609566] [DEBUG] [LOCAL ] GD: Loaded 47940 existing records from primary storage. [2025-09-28T02:15:54.610059] [INFO ] [MAIN ] GD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:54.610792] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GD took 0.2s. Estimated remaining: 21m 50s. Rate: 67.3 symbols/min [2025-09-28T02:15:54.801331] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:54.863463] [DEBUG] [LOCAL ] GDDY: Loaded 50449 existing records from primary storage. [2025-09-28T02:15:54.863902] [INFO ] [MAIN ] GDDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:54.864450] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GDDY took 0.3s. Estimated remaining: 21m 48s. Rate: 67.3 symbols/min [2025-09-28T02:15:55.060862] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-28T02:15:55.063030] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:55.072523] [DEBUG] [LOCAL ] GDIV: Loaded 3724 existing records from primary storage. [2025-09-28T02:15:55.072911] [INFO ] [MAIN ] GDIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:55.073015] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GDIV took 0.2s. Estimated remaining: 21m 46s. Rate: 67.4 symbols/min [2025-09-28T02:15:55.270028] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:55.275048] [DEBUG] [LOCAL ] GDL: Loaded 2572 existing records from primary storage. [2025-09-28T02:15:55.275270] [INFO ] [MAIN ] GDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:55.275372] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GDL took 0.2s. Estimated remaining: 21m 44s. Rate: 67.5 symbols/min [2025-09-28T02:15:55.462804] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:55.470205] [DEBUG] [LOCAL ] GDO: Loaded 6076 existing records from primary storage. [2025-09-28T02:15:55.470410] [INFO ] [MAIN ] GDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:55.470508] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GDO took 0.2s. Estimated remaining: 21m 42s. Rate: 67.5 symbols/min [2025-09-28T02:15:55.616118] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-28T02:15:55.707417] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:55.715078] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-28T02:15:55.754378] [DEBUG] [LOCAL ] GDOT: Loaded 39279 existing records from primary storage. [2025-09-28T02:15:55.754827] [INFO ] [MAIN ] GDOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:55.755257] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDOT took 0.3s. Estimated remaining: 21m 40s. Rate: 67.6 symbols/min [2025-09-28T02:15:55.856093] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-28T02:15:55.955056] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:55.986736] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-28T02:15:56.012223] [DEBUG] [LOCAL ] GDV: Loaded 19971 existing records from primary storage. [2025-09-28T02:15:56.012565] [INFO ] [MAIN ] GDV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:56.012730] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDV took 0.3s. Estimated remaining: 21m 38s. Rate: 67.6 symbols/min [2025-09-28T02:15:56.200629] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:56.258259] [DEBUG] [LOCAL ] GE: Loaded 54493 existing records from primary storage. [2025-09-28T02:15:56.258697] [INFO ] [MAIN ] GE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:56.259409] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GE took 0.2s. Estimated remaining: 21m 36s. Rate: 67.7 symbols/min [2025-09-28T02:15:56.452341] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:56.482744] [DEBUG] [LOCAL ] GEF: Loaded 20965 existing records from primary storage. [2025-09-28T02:15:56.483187] [INFO ] [MAIN ] GEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:56.483324] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GEF took 0.2s. Estimated remaining: 21m 34s. Rate: 67.7 symbols/min [2025-09-28T02:15:56.664366] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-28T02:15:56.686364] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:56.695168] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-28T02:15:56.738279] [DEBUG] [LOCAL ] GEL: Loaded 34252 existing records from primary storage. [2025-09-28T02:15:56.738700] [INFO ] [MAIN ] GEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:56.739296] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GEL took 0.3s. Estimated remaining: 21m 32s. Rate: 67.8 symbols/min [2025-09-28T02:15:56.941262] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:56.998076] [DEBUG] [LOCAL ] GENI: Loaded 53679 existing records from primary storage. [2025-09-28T02:15:56.998479] [INFO ] [MAIN ] GENI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:56.998946] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GENI took 0.3s. Estimated remaining: 21m 30s. Rate: 67.8 symbols/min [2025-09-28T02:15:57.195450] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:57.250237] [DEBUG] [LOCAL ] GEO: Loaded 52812 existing records from primary storage. [2025-09-28T02:15:57.250610] [INFO ] [MAIN ] GEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:57.250993] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GEO took 0.3s. Estimated remaining: 21m 29s. Rate: 67.9 symbols/min [2025-09-28T02:15:57.441615] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:57.455734] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-28T02:15:57.486680] [DEBUG] [LOCAL ] GES: Loaded 40424 existing records from primary storage. [2025-09-28T02:15:57.487085] [INFO ] [MAIN ] GES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:57.487456] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GES took 0.2s. Estimated remaining: 21m 27s. Rate: 67.9 symbols/min [2025-09-28T02:15:57.734884] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:57.773517] [DEBUG] [LOCAL ] GETY: Loaded 36378 existing records from primary storage. [2025-09-28T02:15:57.773898] [INFO ] [MAIN ] GETY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:57.774276] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GETY took 0.3s. Estimated remaining: 21m 25s. Rate: 68.0 symbols/min [2025-09-28T02:15:57.970393] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:58.035054] [DEBUG] [LOCAL ] GEV: Loaded 53878 existing records from primary storage. [2025-09-28T02:15:58.035451] [INFO ] [MAIN ] GEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:58.036168] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GEV took 0.3s. Estimated remaining: 21m 23s. Rate: 68.0 symbols/min [2025-09-28T02:15:58.223538] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:15:58.230241] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-28T02:15:58.238285] [DEBUG] [LOCAL ] GF: Loaded 3220 existing records from primary storage. [2025-09-28T02:15:58.238558] [INFO ] [MAIN ] GF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:15:58.238690] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GF took 0.2s. Estimated remaining: 21m 21s. Rate: 68.1 symbols/min [2025-09-28T02:15:58.255709] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-28T02:15:58.655290] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-28T02:15:59.004141] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-28T02:15:59.006797] [INFO ] [REMOTE ] GCV: Full fetch complete (9344 records). [2025-09-28T02:15:59.006909] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-28T02:15:59.066689] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-28T02:15:59.407941] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-28T02:15:59.408124] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-28T02:15:59.408434] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-28T02:15:59.408527] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-28T02:15:59.409320] [DEBUG] [LOCAL ] GCV: Trimmed 9344 records to 7333 (keeping 200 days of data) [2025-09-28T02:15:59.458533] [DEBUG] [LOCAL ] GCV: Primary data saved (7333 records). [2025-09-28T02:15:59.458755] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-28T02:15:59.458885] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GCV took 19.0s. Estimated remaining: 21m 21s. Rate: 68.1 symbols/min [2025-09-28T02:15:59.855784] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-28T02:16:00.859921] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-28T02:16:00.869330] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-28T02:16:01.610696] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-28T02:16:01.623474] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-28T02:16:02.566737] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-28T02:16:02.575148] [INFO ] [REMOTE ] GBCI: Full fetch complete (57991 records). [2025-09-28T02:16:02.575386] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-28T02:16:03.085560] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-28T02:16:03.085736] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-28T02:16:03.086488] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-28T02:16:03.086580] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-28T02:16:03.088570] [DEBUG] [LOCAL ] GBCI: Trimmed 57991 records to 40720 (keeping 200 days of data) [2025-09-28T02:16:03.335639] [DEBUG] [LOCAL ] GBCI: Primary data saved (40720 records). [2025-09-28T02:16:03.335832] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-28T02:16:03.335967] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GBCI took 30.8s. Estimated remaining: 21m 24s. Rate: 67.8 symbols/min [2025-09-28T02:16:03.493561] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-28T02:16:03.504729] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-28T02:16:03.504959] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-28T02:16:03.942580] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-28T02:16:03.942862] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-28T02:16:03.944125] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-28T02:16:03.944225] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-28T02:16:03.946572] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 54435 (keeping 200 days of data) [2025-09-28T02:16:04.329229] [DEBUG] [LOCAL ] GAP: Primary data saved (54435 records). [2025-09-28T02:16:04.329583] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-28T02:16:04.329827] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GAP took 32.3s. Estimated remaining: 21m 24s. Rate: 67.8 symbols/min [2025-09-28T02:16:05.139814] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:05.165154] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:05.163347] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:05.156672] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:05.180131] [DEBUG] [LOCAL ] GFR: Loaded 8572 existing records from primary storage. [2025-09-28T02:16:05.183356] [INFO ] [MAIN ] GFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:05.183678] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 0.8s. Estimated remaining: 21m 23s. Rate: 67.8 symbols/min [2025-09-28T02:16:05.335846] [DEBUG] [LOCAL ] GFF: Loaded 31088 existing records from primary storage. [2025-09-28T02:16:05.381823] [INFO ] [MAIN ] GFF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:05.414461] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 1.1s. Estimated remaining: 21m 21s. Rate: 67.9 symbols/min [2025-09-28T02:16:05.482781] [DEBUG] [LOCAL ] GFL: Loaded 48755 existing records from primary storage. [2025-09-28T02:16:05.546142] [INFO ] [MAIN ] GFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:05.597718] [DEBUG] [LOCAL ] GFI: Loaded 53887 existing records from primary storage. [2025-09-28T02:16:05.597997] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFL took 1.3s. Estimated remaining: 21m 19s. Rate: 67.9 symbols/min [2025-09-28T02:16:05.623017] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:05.623310] [INFO ] [MAIN ] GFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:05.694107] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 1.4s. Estimated remaining: 21m 17s. Rate: 68.0 symbols/min [2025-09-28T02:16:05.977713] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:06.077821] [DEBUG] [LOCAL ] GGG: No existing data file found in primary storage. [2025-09-28T02:16:06.134361] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:06.134431] [WARN ] [MAIN ] GGG: No existing data found, performing full refresh instead. [2025-09-28T02:16:06.135480] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-28T02:16:06.135683] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-28T02:16:06.135908] [DEBUG] [LOCAL ] GGG: No primary data file found to delete. [2025-09-28T02:16:06.135994] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-28T02:16:06.177044] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:06.293898] [DEBUG] [LOCAL ] GGB: Loaded 51813 existing records from primary storage. [2025-09-28T02:16:06.313278] [INFO ] [MAIN ] GGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:06.312981] [DEBUG] [LOCAL ] GGT: Loaded 14309 existing records from primary storage. [2025-09-28T02:16:06.314913] [INFO ] [MAIN ] GGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:06.314029] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGB took 1.1s. Estimated remaining: 21m 16s. Rate: 68.0 symbols/min [2025-09-28T02:16:06.331371] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGT took 0.7s. Estimated remaining: 21m 13s. Rate: 68.1 symbols/min [2025-09-28T02:16:06.372952] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-09-28T02:16:06.474121] [INFO ] [MAIN ] GGZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:06.642905] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGZ took 0.9s. Estimated remaining: 21m 12s. Rate: 68.1 symbols/min [2025-09-28T02:16:07.041868] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:07.090012] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:07.132545] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:16:07.157329] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-28T02:16:07.180110] [DEBUG] [LOCAL ] GHC: Loaded 2664 existing records from primary storage. [2025-09-28T02:16:07.196293] [INFO ] [MAIN ] GHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:07.247896] [DEBUG] [LOCAL ] GHG: Loaded 3226 existing records from primary storage. [2025-09-28T02:16:07.248145] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GHC took 0.9s. Estimated remaining: 21m 10s. Rate: 68.2 symbols/min [2025-09-28T02:16:07.253943] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:07.254557] [INFO ] [MAIN ] GHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:07.260265] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHG took 0.9s. Estimated remaining: 21m 8s. Rate: 68.2 symbols/min [2025-09-28T02:16:07.430670] [DEBUG] [LOCAL ] GHI: Loaded 6963 existing records from primary storage. [2025-09-28T02:16:07.466000] [INFO ] [MAIN ] GHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:07.512081] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHI took 0.8s. Estimated remaining: 21m 6s. Rate: 68.3 symbols/min [2025-09-28T02:16:07.784251] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:07.788285] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:07.893769] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:07.894289] [DEBUG] [LOCAL ] GHLD: Loaded 4168 existing records from primary storage. [2025-09-28T02:16:07.895145] [INFO ] [MAIN ] GHLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:07.895281] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHLD took 0.6s. Estimated remaining: 21m 5s. Rate: 68.3 symbols/min [2025-09-28T02:16:07.984738] [DEBUG] [LOCAL ] GHM: Loaded 14350 existing records from primary storage. [2025-09-28T02:16:08.017254] [INFO ] [MAIN ] GHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:08.026130] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHM took 0.7s. Estimated remaining: 21m 2s. Rate: 68.4 symbols/min [2025-09-28T02:16:08.114393] [DEBUG] [LOCAL ] GHY: Loaded 21190 existing records from primary storage. [2025-09-28T02:16:08.226486] [INFO ] [MAIN ] GHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:08.240382] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHY took 0.7s. Estimated remaining: 21m 1s. Rate: 68.4 symbols/min [2025-09-28T02:16:08.217263] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:08.385860] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:08.555572] [DEBUG] [LOCAL ] GIB: Loaded 32653 existing records from primary storage. [2025-09-28T02:16:08.560433] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:08.560953] [DEBUG] [LOCAL ] GIC: Loaded 13796 existing records from primary storage. [2025-09-28T02:16:08.562277] [INFO ] [MAIN ] GIB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:08.562975] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GIB took 0.7s. Estimated remaining: 20m 59s. Rate: 68.5 symbols/min [2025-09-28T02:16:08.562732] [INFO ] [MAIN ] GIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:08.577124] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIC took 0.5s. Estimated remaining: 20m 57s. Rate: 68.6 symbols/min [2025-09-28T02:16:09.001429] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:08.977188] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:08.980401] [DEBUG] [LOCAL ] GIL: Loaded 43906 existing records from primary storage. [2025-09-28T02:16:09.003281] [INFO ] [MAIN ] GIL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:09.003942] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIL took 0.8s. Estimated remaining: 20m 55s. Rate: 68.6 symbols/min [2025-09-28T02:16:09.076818] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-28T02:16:09.134691] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-28T02:16:09.268249] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:09.284593] [DEBUG] [LOCAL ] GKOS: Loaded 43585 existing records from primary storage. [2025-09-28T02:16:09.285023] [INFO ] [MAIN ] GKOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:09.285142] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GKOS took 0.7s. Estimated remaining: 20m 53s. Rate: 68.7 symbols/min [2025-09-28T02:16:09.400622] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-09-28T02:16:09.409054] [INFO ] [MAIN ] GIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:09.434716] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIS took 0.9s. Estimated remaining: 20m 51s. Rate: 68.7 symbols/min [2025-09-28T02:16:09.610354] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:09.635974] [DEBUG] [LOCAL ] GL: Loaded 38382 existing records from primary storage. [2025-09-28T02:16:09.656178] [INFO ] [MAIN ] GL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:09.657153] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GL took 0.7s. Estimated remaining: 20m 49s. Rate: 68.8 symbols/min [2025-09-28T02:16:09.821870] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:10.009274] [DEBUG] [LOCAL ] GLP: Loaded 9585 existing records from primary storage. [2025-09-28T02:16:10.016208] [DEBUG] [LOCAL ] GLOB: Loaded 48111 existing records from primary storage. [2025-09-28T02:16:10.014838] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:10.017271] [INFO ] [MAIN ] GLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:10.017765] [INFO ] [MAIN ] GLOB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:10.017984] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GLP took 0.6s. Estimated remaining: 20m 48s. Rate: 68.8 symbols/min [2025-09-28T02:16:10.018534] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLOB took 0.7s. Estimated remaining: 20m 46s. Rate: 68.9 symbols/min [2025-09-28T02:16:10.415798] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:10.417593] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:10.461873] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-09-28T02:16:10.463778] [INFO ] [MAIN ] GLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:10.464057] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLW took 0.8s. Estimated remaining: 20m 44s. Rate: 68.9 symbols/min [2025-09-28T02:16:10.722517] [DEBUG] [LOCAL ] GME: Loaded 54540 existing records from primary storage. [2025-09-28T02:16:10.741993] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-28T02:16:10.746994] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:10.763132] [INFO ] [MAIN ] GME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:10.772725] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GME took 0.8s. Estimated remaining: 20m 42s. Rate: 69.0 symbols/min [2025-09-28T02:16:10.774599] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-09-28T02:16:10.797397] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-28T02:16:10.820532] [INFO ] [MAIN ] GM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:10.899325] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GM took 0.9s. Estimated remaining: 20m 40s. Rate: 69.0 symbols/min [2025-09-28T02:16:11.027094] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:11.156296] [DEBUG] [LOCAL ] GMED: Loaded 49096 existing records from primary storage. [2025-09-28T02:16:11.215934] [INFO ] [MAIN ] GMED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:11.215794] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:11.216326] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMED took 0.8s. Estimated remaining: 20m 39s. Rate: 69.1 symbols/min [2025-09-28T02:16:11.352598] [DEBUG] [LOCAL ] GMRE: Loaded 38133 existing records from primary storage. [2025-09-28T02:16:11.381972] [DEBUG] [LOCAL ] GNE: Loaded 17940 existing records from primary storage. [2025-09-28T02:16:11.382218] [INFO ] [MAIN ] GMRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:11.393629] [INFO ] [MAIN ] GNE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:11.388256] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GMRE took 0.6s. Estimated remaining: 20m 37s. Rate: 69.1 symbols/min [2025-09-28T02:16:11.428158] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GNE took 0.5s. Estimated remaining: 20m 35s. Rate: 69.2 symbols/min [2025-09-28T02:16:11.514933] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:11.875462] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:11.879985] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:11.922634] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-28T02:16:11.946828] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-28T02:16:11.950428] [DEBUG] [LOCAL ] GNK: Loaded 41039 existing records from primary storage. [2025-09-28T02:16:11.951196] [INFO ] [MAIN ] GNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:11.951351] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNK took 0.7s. Estimated remaining: 20m 33s. Rate: 69.2 symbols/min [2025-09-28T02:16:12.137546] [DEBUG] [LOCAL ] GNL: Loaded 47785 existing records from primary storage. [2025-09-28T02:16:12.175152] [DEBUG] [LOCAL ] GNRC: Loaded 45886 existing records from primary storage. [2025-09-28T02:16:12.205061] [INFO ] [MAIN ] GNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:12.204801] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:12.205960] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNL took 0.8s. Estimated remaining: 20m 31s. Rate: 69.3 symbols/min [2025-09-28T02:16:12.205805] [INFO ] [MAIN ] GNRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:12.211747] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNRC took 0.7s. Estimated remaining: 20m 29s. Rate: 69.4 symbols/min [2025-09-28T02:16:12.391789] [DEBUG] [LOCAL ] GNT: Loaded 8177 existing records from primary storage. [2025-09-28T02:16:12.462748] [INFO ] [MAIN ] GNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:12.500757] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNT took 0.5s. Estimated remaining: 20m 28s. Rate: 69.4 symbols/min [2025-09-28T02:16:12.624289] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:12.692798] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:12.851801] [DEBUG] [LOCAL ] GNTY: Loaded 7353 existing records from primary storage. [2025-09-28T02:16:12.888275] [INFO ] [MAIN ] GNTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:12.888068] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:12.888947] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNTY took 0.7s. Estimated remaining: 20m 26s. Rate: 69.4 symbols/min [2025-09-28T02:16:13.074405] [DEBUG] [LOCAL ] GNW: Loaded 52086 existing records from primary storage. [2025-09-28T02:16:13.139463] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:13.139947] [INFO ] [MAIN ] GNW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:13.140325] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNW took 0.9s. Estimated remaining: 20m 24s. Rate: 69.5 symbols/min [2025-09-28T02:16:13.276493] [DEBUG] [LOCAL ] GOF: Loaded 43374 existing records from primary storage. [2025-09-28T02:16:13.311249] [INFO ] [MAIN ] GOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:13.364153] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:13.364277] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOF took 0.8s. Estimated remaining: 20m 22s. Rate: 69.5 symbols/min [2025-09-28T02:16:13.444123] [DEBUG] [LOCAL ] GOLF: Loaded 32049 existing records from primary storage. [2025-09-28T02:16:13.481825] [INFO ] [MAIN ] GOLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:13.498425] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GOLF took 0.6s. Estimated remaining: 20m 20s. Rate: 69.6 symbols/min [2025-09-28T02:16:13.627604] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:13.809141] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:13.839418] [DEBUG] [LOCAL ] GOOS: Loaded 46008 existing records from primary storage. [2025-09-28T02:16:13.851322] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-28T02:16:13.851536] [INFO ] [MAIN ] GOOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:13.861963] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOOS took 0.7s. Estimated remaining: 20m 19s. Rate: 69.7 symbols/min [2025-09-28T02:16:13.863567] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-28T02:16:13.975349] [DEBUG] [LOCAL ] GOTU: Loaded 39533 existing records from primary storage. [2025-09-28T02:16:14.000912] [INFO ] [MAIN ] GOTU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:14.017392] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOTU took 0.7s. Estimated remaining: 20m 17s. Rate: 69.7 symbols/min [2025-09-28T02:16:14.090592] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:14.106235] [DEBUG] [LOCAL ] GPC: Loaded 47289 existing records from primary storage. [2025-09-28T02:16:14.106731] [INFO ] [MAIN ] GPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:14.107338] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GPC took 0.6s. Estimated remaining: 20m 15s. Rate: 69.8 symbols/min [2025-09-28T02:16:14.120485] [DEBUG] [LOCAL ] GPI: Loaded 15126 existing records from primary storage. [2025-09-28T02:16:14.120797] [INFO ] [MAIN ] GPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:14.120902] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPI took 0.3s. Estimated remaining: 20m 13s. Rate: 69.8 symbols/min [2025-09-28T02:16:15.454267] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-28T02:16:15.465714] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-28T02:16:17.104843] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-28T02:16:17.114449] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-28T02:16:18.610539] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-28T02:16:18.619250] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-28T02:16:20.131518] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-28T02:16:20.141832] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-28T02:16:21.680867] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-28T02:16:21.689983] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-28T02:16:23.030459] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-28T02:16:23.039093] [INFO ] [REMOTE ] GGG: Full fetch complete (59324 records). [2025-09-28T02:16:23.039271] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-28T02:16:23.511878] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-28T02:16:23.512057] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-28T02:16:23.512917] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-28T02:16:23.513020] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-28T02:16:23.514521] [DEBUG] [LOCAL ] GGG: Trimmed 59324 records to 41580 (keeping 200 days of data) [2025-09-28T02:16:23.804438] [DEBUG] [LOCAL ] GGG: Primary data saved (41580 records). [2025-09-28T02:16:23.804681] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-28T02:16:23.804860] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GGG took 18.4s. Estimated remaining: 20m 25s. Rate: 69.1 symbols/min [2025-09-28T02:16:24.485772] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:24.557412] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:24.564377] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:24.607484] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:24.612412] [DEBUG] [LOCAL ] GPJA: Loaded 4140 existing records from primary storage. [2025-09-28T02:16:24.613391] [INFO ] [MAIN ] GPJA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:24.613519] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPJA took 0.8s. Estimated remaining: 20m 24s. Rate: 69.1 symbols/min [2025-09-28T02:16:24.776087] [DEBUG] [LOCAL ] GPMT: Loaded 26788 existing records from primary storage. [2025-09-28T02:16:24.798124] [INFO ] [MAIN ] GPMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:24.798426] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPMT took 1.0s. Estimated remaining: 20m 22s. Rate: 69.2 symbols/min [2025-09-28T02:16:24.842079] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:25.021076] [DEBUG] [LOCAL ] GPN: Loaded 52822 existing records from primary storage. [2025-09-28T02:16:25.073856] [DEBUG] [LOCAL ] GPK: Loaded 53441 existing records from primary storage. [2025-09-28T02:16:25.094482] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:25.094757] [INFO ] [MAIN ] GPN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:25.095193] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPN took 1.3s. Estimated remaining: 20m 20s. Rate: 69.2 symbols/min [2025-09-28T02:16:25.095297] [INFO ] [MAIN ] GPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:25.095951] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPK took 1.3s. Estimated remaining: 20m 18s. Rate: 69.3 symbols/min [2025-09-28T02:16:25.152375] [DEBUG] [LOCAL ] GPOR: Loaded 23328 existing records from primary storage. [2025-09-28T02:16:25.200226] [INFO ] [MAIN ] GPOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:25.331787] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 0.7s. Estimated remaining: 20m 17s. Rate: 69.3 symbols/min [2025-09-28T02:16:25.527256] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:25.601561] [DEBUG] [LOCAL ] GPRK: Loaded 39841 existing records from primary storage. [2025-09-28T02:16:25.618751] [INFO ] [MAIN ] GPRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:25.624188] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GPRK took 0.8s. Estimated remaining: 20m 15s. Rate: 69.4 symbols/min [2025-09-28T02:16:25.628807] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:25.850532] [DEBUG] [LOCAL ] GRC: Loaded 9061 existing records from primary storage. [2025-09-28T02:16:25.862088] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:25.882534] [INFO ] [MAIN ] GRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:25.927859] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:25.926590] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRC took 0.8s. Estimated remaining: 20m 13s. Rate: 69.4 symbols/min [2025-09-28T02:16:26.026214] [DEBUG] [LOCAL ] GRBK: Loaded 27375 existing records from primary storage. [2025-09-28T02:16:26.049354] [INFO ] [MAIN ] GRBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:26.082865] [DEBUG] [LOCAL ] GRDN: Loaded 20178 existing records from primary storage. [2025-09-28T02:16:26.070532] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRBK took 1.0s. Estimated remaining: 20m 11s. Rate: 69.5 symbols/min [2025-09-28T02:16:26.148383] [INFO ] [MAIN ] GRDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:26.235195] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:26.235345] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRDN took 0.8s. Estimated remaining: 20m 9s. Rate: 69.6 symbols/min [2025-09-28T02:16:26.445998] [DEBUG] [LOCAL ] GRMN: Loaded 41798 existing records from primary storage. [2025-09-28T02:16:26.439204] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:26.481293] [INFO ] [MAIN ] GRMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:26.497265] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRMN took 0.9s. Estimated remaining: 20m 8s. Rate: 69.6 symbols/min [2025-09-28T02:16:26.777293] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:26.799492] [DEBUG] [LOCAL ] GRND: Loaded 50744 existing records from primary storage. [2025-09-28T02:16:26.852797] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:26.851702] [INFO ] [MAIN ] GRND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:26.866611] [DEBUG] [LOCAL ] GRNT: Loaded 34235 existing records from primary storage. [2025-09-28T02:16:26.865872] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRND took 0.9s. Estimated remaining: 20m 6s. Rate: 69.6 symbols/min [2025-09-28T02:16:26.868310] [INFO ] [MAIN ] GRNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:26.873879] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRNT took 0.8s. Estimated remaining: 20m 4s. Rate: 69.7 symbols/min [2025-09-28T02:16:27.011402] [DEBUG] [LOCAL ] GROV: Loaded 9240 existing records from primary storage. [2025-09-28T02:16:26.975299] [DEBUG] [LOCAL ] GRX: Loaded 4547 existing records from primary storage. [2025-09-28T02:16:27.060113] [INFO ] [MAIN ] GROV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:27.088711] [INFO ] [MAIN ] GRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:27.094137] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GROV took 0.8s. Estimated remaining: 20m 2s. Rate: 69.8 symbols/min [2025-09-28T02:16:27.130255] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRX took 0.6s. Estimated remaining: 20m 0s. Rate: 69.8 symbols/min [2025-09-28T02:16:27.221248] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:27.344430] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:27.616154] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:27.669550] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:27.716690] [DEBUG] [LOCAL ] GS: Loaded 52736 existing records from primary storage. [2025-09-28T02:16:27.728322] [INFO ] [MAIN ] GS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:27.730692] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GS took 0.9s. Estimated remaining: 19m 59s. Rate: 69.9 symbols/min [2025-09-28T02:16:27.737015] [DEBUG] [LOCAL ] GSBD: Loaded 39756 existing records from primary storage. [2025-09-28T02:16:27.761469] [INFO ] [MAIN ] GSBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:27.865156] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GSBD took 1.0s. Estimated remaining: 19m 57s. Rate: 69.9 symbols/min [2025-09-28T02:16:27.910002] [DEBUG] [LOCAL ] GSL: Loaded 33824 existing records from primary storage. [2025-09-28T02:16:27.994819] [INFO ] [MAIN ] GSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:28.033900] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:28.034374] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSL took 0.8s. Estimated remaining: 19m 55s. Rate: 70.0 symbols/min [2025-09-28T02:16:28.233526] [DEBUG] [LOCAL ] GSK: Loaded 54272 existing records from primary storage. [2025-09-28T02:16:28.268133] [INFO ] [MAIN ] GSK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:28.335242] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GSK took 1.2s. Estimated remaining: 19m 54s. Rate: 70.0 symbols/min [2025-09-28T02:16:28.339512] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:28.418074] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:28.540764] [DEBUG] [LOCAL ] GTES: Loaded 51399 existing records from primary storage. [2025-09-28T02:16:28.566024] [INFO ] [MAIN ] GTES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:28.620439] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTES took 0.9s. Estimated remaining: 19m 52s. Rate: 70.1 symbols/min [2025-09-28T02:16:28.625353] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:28.799430] [DEBUG] [LOCAL ] GTN: Loaded 46301 existing records from primary storage. [2025-09-28T02:16:28.839567] [DEBUG] [LOCAL ] GTLS: Loaded 43461 existing records from primary storage. [2025-09-28T02:16:28.884299] [INFO ] [MAIN ] GTLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:28.883686] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:28.885371] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTLS took 1.0s. Estimated remaining: 19m 50s. Rate: 70.1 symbols/min [2025-09-28T02:16:28.846409] [INFO ] [MAIN ] GTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:28.891301] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTN took 0.9s. Estimated remaining: 19m 48s. Rate: 70.2 symbols/min [2025-09-28T02:16:29.141323] [DEBUG] [LOCAL ] GUG: Loaded 12138 existing records from primary storage. [2025-09-28T02:16:29.142351] [DEBUG] [LOCAL ] GTY: Loaded 30796 existing records from primary storage. [2025-09-28T02:16:29.178206] [INFO ] [MAIN ] GUG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:29.210771] [INFO ] [MAIN ] GTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:29.214967] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:29.195772] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GUG took 0.6s. Estimated remaining: 19m 47s. Rate: 70.2 symbols/min [2025-09-28T02:16:29.222020] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GTY took 0.8s. Estimated remaining: 19m 44s. Rate: 70.3 symbols/min [2025-09-28T02:16:29.399445] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:29.728603] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:29.754947] [DEBUG] [LOCAL ] GVA: Loaded 34030 existing records from primary storage. [2025-09-28T02:16:29.755505] [DEBUG] [LOCAL ] GUT: Loaded 15560 existing records from primary storage. [2025-09-28T02:16:29.760832] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:29.761393] [INFO ] [MAIN ] GVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:29.761790] [INFO ] [MAIN ] GUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:29.762416] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GVA took 0.9s. Estimated remaining: 19m 43s. Rate: 70.3 symbols/min [2025-09-28T02:16:29.775351] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GUT took 0.9s. Estimated remaining: 19m 41s. Rate: 70.4 symbols/min [2025-09-28T02:16:29.971150] [DEBUG] [LOCAL ] GWH: Loaded 15825 existing records from primary storage. [2025-09-28T02:16:30.022087] [INFO ] [MAIN ] GWH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:30.067079] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWH took 0.9s. Estimated remaining: 19m 40s. Rate: 70.5 symbols/min [2025-09-28T02:16:30.206897] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:30.236062] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:30.274002] [DEBUG] [LOCAL ] GWRE: Loaded 41564 existing records from primary storage. [2025-09-28T02:16:30.311508] [INFO ] [MAIN ] GWRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:30.332035] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWRE took 1.1s. Estimated remaining: 19m 38s. Rate: 70.5 symbols/min [2025-09-28T02:16:30.516340] [DEBUG] [LOCAL ] GWW: Loaded 20108 existing records from primary storage. [2025-09-28T02:16:30.608388] [INFO ] [MAIN ] GWW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:30.608153] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:30.620939] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GWW took 0.9s. Estimated remaining: 19m 36s. Rate: 70.5 symbols/min [2025-09-28T02:16:30.740055] [DEBUG] [LOCAL ] GYLD: Loaded 1569 existing records from primary storage. [2025-09-28T02:16:30.739852] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:30.778462] [INFO ] [MAIN ] GYLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:30.795178] [DEBUG] [LOCAL ] GXO: Loaded 48260 existing records from primary storage. [2025-09-28T02:16:30.795534] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GYLD took 0.6s. Estimated remaining: 19m 34s. Rate: 70.6 symbols/min [2025-09-28T02:16:30.809302] [INFO ] [MAIN ] GXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:30.832924] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GXO took 1.0s. Estimated remaining: 19m 32s. Rate: 70.7 symbols/min [2025-09-28T02:16:31.146061] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:31.302504] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:31.366969] [DEBUG] [LOCAL ] H: Loaded 45492 existing records from primary storage. [2025-09-28T02:16:31.370315] [INFO ] [MAIN ] H: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:31.369484] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:31.370963] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. H took 1.0s. Estimated remaining: 19m 31s. Rate: 70.7 symbols/min [2025-09-28T02:16:31.532673] [DEBUG] [LOCAL ] HAE: Loaded 40176 existing records from primary storage. [2025-09-28T02:16:31.583214] [INFO ] [MAIN ] HAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:31.624670] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAE took 1.0s. Estimated remaining: 19m 29s. Rate: 70.8 symbols/min [2025-09-28T02:16:31.624253] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:31.709993] [DEBUG] [LOCAL ] HAFN: Loaded 44189 existing records from primary storage. [2025-09-28T02:16:31.732078] [INFO ] [MAIN ] HAFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:31.753506] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAFN took 0.9s. Estimated remaining: 19m 28s. Rate: 70.8 symbols/min [2025-09-28T02:16:31.854539] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-09-28T02:16:31.930093] [INFO ] [MAIN ] HAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:32.023287] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAL took 1.2s. Estimated remaining: 19m 26s. Rate: 70.9 symbols/min [2025-09-28T02:16:32.032597] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:32.175814] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:32.226583] [DEBUG] [LOCAL ] HASI: Loaded 47868 existing records from primary storage. [2025-09-28T02:16:32.227119] [INFO ] [MAIN ] HASI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:32.227889] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HASI took 0.9s. Estimated remaining: 19m 24s. Rate: 70.9 symbols/min [2025-09-28T02:16:32.360950] [DEBUG] [LOCAL ] HBB: Loaded 6912 existing records from primary storage. [2025-09-28T02:16:32.446956] [INFO ] [MAIN ] HBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:32.451930] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:32.474895] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HBB took 0.7s. Estimated remaining: 19m 23s. Rate: 71.0 symbols/min [2025-09-28T02:16:32.575199] [DEBUG] [LOCAL ] HAYW: Loaded 49444 existing records from primary storage. [2025-09-28T02:16:32.606687] [INFO ] [MAIN ] HAYW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:32.642978] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:32.653701] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HAYW took 1.0s. Estimated remaining: 19m 21s. Rate: 71.0 symbols/min [2025-09-28T02:16:32.814348] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:32.837010] [DEBUG] [LOCAL ] HBI: Loaded 53769 existing records from primary storage. [2025-09-28T02:16:32.837617] [INFO ] [MAIN ] HBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:32.837751] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 0.8s. Estimated remaining: 19m 19s. Rate: 71.1 symbols/min [2025-09-28T02:16:32.880377] [DEBUG] [LOCAL ] HBM: Loaded 53683 existing records from primary storage. [2025-09-28T02:16:32.881027] [INFO ] [MAIN ] HBM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:32.881147] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HBM took 0.7s. Estimated remaining: 19m 17s. Rate: 71.1 symbols/min [2025-09-28T02:16:32.913553] [DEBUG] [LOCAL ] HCA: Loaded 47781 existing records from primary storage. [2025-09-28T02:16:32.913973] [INFO ] [MAIN ] HCA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:32.914716] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HCA took 0.4s. Estimated remaining: 19m 15s. Rate: 71.2 symbols/min [2025-09-28T02:16:33.577385] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:33.615510] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:33.666805] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:33.670540] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:33.671252] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-28T02:16:33.671559] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-28T02:16:33.671852] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-28T02:16:33.672027] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-28T02:16:33.672275] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-28T02:16:33.672330] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-28T02:16:33.802265] [DEBUG] [LOCAL ] HCI: Loaded 14126 existing records from primary storage. [2025-09-28T02:16:33.850882] [INFO ] [MAIN ] HCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:33.947905] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCI took 1.0s. Estimated remaining: 19m 15s. Rate: 71.2 symbols/min [2025-09-28T02:16:34.200923] [DEBUG] [LOCAL ] HD: Loaded 54283 existing records from primary storage. [2025-09-28T02:16:34.176317] [DEBUG] [LOCAL ] HCC: Loaded 46057 existing records from primary storage. [2025-09-28T02:16:34.232745] [INFO ] [MAIN ] HD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:34.258396] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HD took 1.3s. Estimated remaining: 19m 13s. Rate: 71.2 symbols/min [2025-09-28T02:16:34.233010] [INFO ] [MAIN ] HCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:34.334907] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HCC took 1.4s. Estimated remaining: 19m 11s. Rate: 71.3 symbols/min [2025-09-28T02:16:34.378596] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:34.405924] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:16:34.487352] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-28T02:16:34.713066] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:34.775991] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:34.802560] [DEBUG] [LOCAL ] HDB: Loaded 52695 existing records from primary storage. [2025-09-28T02:16:34.803461] [INFO ] [MAIN ] HDB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:34.803776] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HDB took 0.8s. Estimated remaining: 19m 10s. Rate: 71.3 symbols/min [2025-09-28T02:16:35.043872] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:35.041713] [DEBUG] [LOCAL ] HEI: Loaded 32846 existing records from primary storage. [2025-09-28T02:16:35.046412] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-28T02:16:35.048043] [DEBUG] [LOCAL ] HE: Loaded 49870 existing records from primary storage. [2025-09-28T02:16:35.048490] [INFO ] [MAIN ] HEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:35.048717] [INFO ] [MAIN ] HE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:35.050231] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HEI took 0.6s. Estimated remaining: 19m 8s. Rate: 71.4 symbols/min [2025-09-28T02:16:35.049960] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-28T02:16:35.057508] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HE took 0.8s. Estimated remaining: 19m 6s. Rate: 71.5 symbols/min [2025-09-28T02:16:35.124254] [DEBUG] [LOCAL ] HEQ: Loaded 6236 existing records from primary storage. [2025-09-28T02:16:35.262236] [INFO ] [MAIN ] HEQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:35.274020] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HEQ took 0.5s. Estimated remaining: 19m 4s. Rate: 71.5 symbols/min [2025-09-28T02:16:35.442994] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-28T02:16:35.495383] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-28T02:16:35.510125] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:35.565069] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:35.567057] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-28T02:16:35.573035] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-28T02:16:35.593921] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-28T02:16:35.641112] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-28T02:16:35.645756] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:35.646419] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-28T02:16:35.646483] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-28T02:16:35.646779] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-28T02:16:35.646677] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-28T02:16:35.694184] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-28T02:16:35.722741] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-28T02:16:35.759553] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-28T02:16:35.771763] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-28T02:16:35.981175] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-28T02:16:36.023584] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-28T02:16:36.069263] [DEBUG] [LOCAL ] HESM: Loaded 48879 existing records from primary storage. [2025-09-28T02:16:36.109141] [INFO ] [MAIN ] HESM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:36.121535] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HESM took 1.1s. Estimated remaining: 19m 4s. Rate: 71.5 symbols/min [2025-09-28T02:16:36.392155] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:16:36.439022] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-28T02:16:36.512478] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-28T02:16:36.553953] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-28T02:16:36.594067] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:36.681164] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:16:36.681668] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-28T02:16:36.694935] [DEBUG] [LOCAL ] HFRO: Loaded 17798 existing records from primary storage. [2025-09-28T02:16:36.695245] [INFO ] [MAIN ] HFRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:36.695727] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HFRO took 0.6s. Estimated remaining: 19m 2s. Rate: 71.5 symbols/min [2025-09-28T02:16:36.881852] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:36.896582] [DEBUG] [LOCAL ] HGER: Loaded 13428 existing records from primary storage. [2025-09-28T02:16:36.896948] [INFO ] [MAIN ] HGER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:36.897054] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HGER took 0.2s. Estimated remaining: 19m 1s. Rate: 71.6 symbols/min [2025-09-28T02:16:37.068382] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-28T02:16:37.088505] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:37.089781] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-28T02:16:37.103387] [DEBUG] [LOCAL ] HGLB: Loaded 9836 existing records from primary storage. [2025-09-28T02:16:37.103822] [INFO ] [MAIN ] HGLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:37.103928] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HGLB took 0.2s. Estimated remaining: 18m 59s. Rate: 71.6 symbols/min [2025-09-28T02:16:37.191483] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-28T02:16:37.226238] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-28T02:16:37.220076] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-28T02:16:37.239209] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-28T02:16:37.310361] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:37.325688] [DEBUG] [LOCAL ] HGTY: Loaded 13290 existing records from primary storage. [2025-09-28T02:16:37.326014] [INFO ] [MAIN ] HGTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:37.326137] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGTY took 0.2s. Estimated remaining: 18m 57s. Rate: 71.7 symbols/min [2025-09-28T02:16:37.480691] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-28T02:16:37.516629] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:37.517852] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-28T02:16:37.546340] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-28T02:16:37.549119] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-28T02:16:37.550113] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-28T02:16:37.552805] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-28T02:16:37.570212] [DEBUG] [LOCAL ] HGV: Loaded 47426 existing records from primary storage. [2025-09-28T02:16:37.570572] [INFO ] [MAIN ] HGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:37.570698] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HGV took 0.2s. Estimated remaining: 18m 56s. Rate: 71.7 symbols/min [2025-09-28T02:16:37.750428] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:37.783300] [DEBUG] [LOCAL ] HHH: Loaded 33042 existing records from primary storage. [2025-09-28T02:16:37.783675] [INFO ] [MAIN ] HHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:37.783789] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HHH took 0.2s. Estimated remaining: 18m 54s. Rate: 71.8 symbols/min [2025-09-28T02:16:37.862814] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-28T02:16:37.863733] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-28T02:16:37.871922] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-28T02:16:37.888684] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-28T02:16:37.896622] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-28T02:16:37.889514] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-28T02:16:37.991061] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:38.027542] [DEBUG] [LOCAL ] HI: Loaded 35713 existing records from primary storage. [2025-09-28T02:16:38.027943] [INFO ] [MAIN ] HI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:38.028051] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HI took 0.2s. Estimated remaining: 18m 52s. Rate: 71.8 symbols/min [2025-09-28T02:16:38.217186] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-28T02:16:38.221673] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:38.223149] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-28T02:16:38.265853] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-28T02:16:38.267766] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-28T02:16:38.284959] [DEBUG] [LOCAL ] HIG: Loaded 51962 existing records from primary storage. [2025-09-28T02:16:38.285397] [INFO ] [MAIN ] HIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:38.286214] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HIG took 0.3s. Estimated remaining: 18m 51s. Rate: 71.9 symbols/min [2025-09-28T02:16:38.401322] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-28T02:16:38.405944] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-28T02:16:38.482319] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:38.485077] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-28T02:16:38.486571] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-28T02:16:38.526820] [DEBUG] [LOCAL ] HII: Loaded 35728 existing records from primary storage. [2025-09-28T02:16:38.527192] [INFO ] [MAIN ] HII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:38.527299] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HII took 0.2s. Estimated remaining: 18m 49s. Rate: 71.9 symbols/min [2025-09-28T02:16:38.611083] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-28T02:16:38.642443] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-28T02:16:38.721357] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:38.724852] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-28T02:16:38.727025] [INFO ] [REMOTE ] HCXY: Full fetch complete (592 records). [2025-09-28T02:16:38.727756] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-28T02:16:38.728272] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:16:38.728497] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:16:38.728592] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:16:38.728701] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-28T02:16:38.728804] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-28T02:16:38.728881] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-28T02:16:38.729106] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-28T02:16:38.729233] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HCXY took 5.8s. Estimated remaining: 18m 48s. Rate: 72.0 symbols/min [2025-09-28T02:16:38.825632] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-28T02:16:38.861724] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-28T02:16:38.949044] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-28T02:16:38.971771] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:38.973822] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-28T02:16:38.994341] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-09-28T02:16:38.994886] [INFO ] [MAIN ] HIMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:38.995137] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HIMS took 0.5s. Estimated remaining: 18m 46s. Rate: 72.0 symbols/min [2025-09-28T02:16:39.144361] [DEBUG] [LOCAL ] HIO: Loaded 24107 existing records from primary storage. [2025-09-28T02:16:39.175425] [INFO ] [MAIN ] HIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:39.205454] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:39.186621] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIO took 0.5s. Estimated remaining: 18m 44s. Rate: 72.1 symbols/min [2025-09-28T02:16:39.277210] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-28T02:16:39.271842] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-28T02:16:39.289558] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-28T02:16:39.312320] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-28T02:16:39.437758] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:39.438813] [DEBUG] [LOCAL ] HIPO: Loaded 22774 existing records from primary storage. [2025-09-28T02:16:39.439453] [INFO ] [MAIN ] HIPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:39.439583] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIPO took 0.4s. Estimated remaining: 18m 43s. Rate: 72.1 symbols/min [2025-09-28T02:16:39.660618] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:39.663571] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-28T02:16:39.664792] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-28T02:16:39.686347] [DEBUG] [LOCAL ] HIW: Loaded 45329 existing records from primary storage. [2025-09-28T02:16:39.686969] [INFO ] [MAIN ] HIW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:39.688083] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIW took 0.5s. Estimated remaining: 18m 41s. Rate: 72.2 symbols/min [2025-09-28T02:16:39.727239] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-28T02:16:39.754606] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-28T02:16:39.852464] [DEBUG] [LOCAL ] HIX: Loaded 20714 existing records from primary storage. [2025-09-28T02:16:39.858341] [INFO ] [MAIN ] HIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:39.874311] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIX took 0.4s. Estimated remaining: 18m 39s. Rate: 72.3 symbols/min [2025-09-28T02:16:39.980833] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-28T02:16:40.012788] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:40.029251] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-28T02:16:40.198329] [DEBUG] [LOCAL ] HKD: Loaded 18654 existing records from primary storage. [2025-09-28T02:16:40.203380] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:40.203973] [INFO ] [MAIN ] HKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:40.204471] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HKD took 0.5s. Estimated remaining: 18m 38s. Rate: 72.3 symbols/min [2025-09-28T02:16:40.294592] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-28T02:16:40.316492] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-28T02:16:40.347418] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-28T02:16:40.359872] [INFO ] [REMOTE ] HF: Full fetch complete (505 records). [2025-09-28T02:16:40.381220] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-28T02:16:40.382108] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:16:40.382446] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:16:40.402023] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:16:40.402174] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-28T02:16:40.434244] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:40.434534] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-28T02:16:40.434890] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-28T02:16:40.450553] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-28T02:16:40.451127] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HF took 5.4s. Estimated remaining: 18m 36s. Rate: 72.3 symbols/min [2025-09-28T02:16:40.594888] [DEBUG] [LOCAL ] HL: Loaded 54451 existing records from primary storage. [2025-09-28T02:16:40.622615] [INFO ] [MAIN ] HL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:40.623398] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HL took 0.7s. Estimated remaining: 18m 35s. Rate: 72.4 symbols/min [2025-09-28T02:16:40.806789] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-28T02:16:40.788790] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:40.843058] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-28T02:16:40.893173] [DEBUG] [LOCAL ] HLF: Loaded 49357 existing records from primary storage. [2025-09-28T02:16:40.898605] [INFO ] [MAIN ] HLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:40.926183] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLF took 0.7s. Estimated remaining: 18m 33s. Rate: 72.4 symbols/min [2025-09-28T02:16:41.047320] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:41.165689] [DEBUG] [LOCAL ] HLI: Loaded 31573 existing records from primary storage. [2025-09-28T02:16:41.180271] [INFO ] [MAIN ] HLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:41.210466] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:41.211478] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HLI took 0.8s. Estimated remaining: 18m 32s. Rate: 72.5 symbols/min [2025-09-28T02:16:41.287718] [DEBUG] [LOCAL ] HLIO: Loaded 28490 existing records from primary storage. [2025-09-28T02:16:41.329813] [INFO ] [MAIN ] HLIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:41.345964] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLIO took 0.7s. Estimated remaining: 18m 30s. Rate: 72.6 symbols/min [2025-09-28T02:16:41.413260] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-28T02:16:41.430947] [INFO ] [REMOTE ] HFND: Full fetch complete (1798 records). [2025-09-28T02:16:41.442310] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-28T02:16:41.570853] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:41.756509] [DEBUG] [LOCAL ] HLLY: Loaded 33911 existing records from primary storage. [2025-09-28T02:16:41.792103] [INFO ] [MAIN ] HLLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:41.792500] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLLY took 0.9s. Estimated remaining: 18m 29s. Rate: 72.6 symbols/min [2025-09-28T02:16:41.957725] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:42.070097] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-28T02:16:42.076586] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:16:42.081947] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:16:42.110200] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-28T02:16:42.169858] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:42.138228] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-28T02:16:42.170775] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-28T02:16:42.170883] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-28T02:16:42.171036] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HFND took 6.9s. Estimated remaining: 18m 27s. Rate: 72.6 symbols/min [2025-09-28T02:16:42.294697] [DEBUG] [LOCAL ] HLN: Loaded 53861 existing records from primary storage. [2025-09-28T02:16:42.337727] [INFO ] [MAIN ] HLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:42.349446] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLN took 1.1s. Estimated remaining: 18m 25s. Rate: 72.7 symbols/min [2025-09-28T02:16:42.497006] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:42.568323] [DEBUG] [LOCAL ] HLT: Loaded 51450 existing records from primary storage. [2025-09-28T02:16:42.599717] [INFO ] [MAIN ] HLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:42.653438] [DEBUG] [LOCAL ] HLX: Loaded 48650 existing records from primary storage. [2025-09-28T02:16:42.653782] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLT took 1.3s. Estimated remaining: 18m 24s. Rate: 72.7 symbols/min [2025-09-28T02:16:42.673127] [INFO ] [MAIN ] HLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:42.679193] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLX took 0.9s. Estimated remaining: 18m 22s. Rate: 72.8 symbols/min [2025-09-28T02:16:42.707711] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:43.018549] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:43.110530] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:43.112615] [DEBUG] [LOCAL ] HMN: Loaded 23671 existing records from primary storage. [2025-09-28T02:16:43.112967] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-28T02:16:43.113157] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-28T02:16:43.113311] [INFO ] [MAIN ] HMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:43.113601] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMN took 0.8s. Estimated remaining: 18m 21s. Rate: 72.8 symbols/min [2025-09-28T02:16:43.125495] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-28T02:16:43.137992] [DEBUG] [LOCAL ] HMC: Loaded 47500 existing records from primary storage. [2025-09-28T02:16:43.153462] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-28T02:16:43.159398] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-28T02:16:43.153919] [INFO ] [MAIN ] HMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:43.184177] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMC took 1.0s. Estimated remaining: 18m 19s. Rate: 72.9 symbols/min [2025-09-28T02:16:43.201511] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-28T02:16:43.593490] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:43.661431] [DEBUG] [LOCAL ] HMY: Loaded 53914 existing records from primary storage. [2025-09-28T02:16:43.687703] [INFO ] [MAIN ] HMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:43.739874] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HMY took 1.1s. Estimated remaining: 18m 18s. Rate: 72.9 symbols/min [2025-09-28T02:16:43.774929] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:43.995480] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:16:43.989752] [DEBUG] [LOCAL ] HNI: Loaded 29386 existing records from primary storage. [2025-09-28T02:16:43.995988] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-28T02:16:43.996857] [INFO ] [MAIN ] HNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:43.997888] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HNI took 0.9s. Estimated remaining: 18m 16s. Rate: 73.0 symbols/min [2025-09-28T02:16:44.041115] [DEBUG] [LOCAL ] HOG: Loaded 51958 existing records from primary storage. [2025-09-28T02:16:44.041598] [INFO ] [MAIN ] HOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:44.041737] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HOG took 0.8s. Estimated remaining: 18m 14s. Rate: 73.0 symbols/min [2025-09-28T02:16:44.132570] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:16:44.133000] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-28T02:16:44.133088] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:16:44.133164] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-09-28T02:16:44.133232] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:16:44.133308] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-28T02:16:44.133419] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-28T02:16:44.133495] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-28T02:16:44.133596] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-28T02:16:44.133711] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HNGE took 1.4s. Estimated remaining: 18m 13s. Rate: 73.1 symbols/min [2025-09-28T02:16:44.876014] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:44.897945] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:44.951622] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:44.987721] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:45.019793] [DEBUG] [LOCAL ] HOV: Loaded 13975 existing records from primary storage. [2025-09-28T02:16:45.020416] [INFO ] [MAIN ] HOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:45.029954] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 0.9s. Estimated remaining: 18m 12s. Rate: 73.1 symbols/min [2025-09-28T02:16:45.160381] [DEBUG] [LOCAL ] HOMB: Loaded 44272 existing records from primary storage. [2025-09-28T02:16:45.172245] [INFO ] [MAIN ] HOMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:45.192754] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOMB took 1.1s. Estimated remaining: 18m 10s. Rate: 73.1 symbols/min [2025-09-28T02:16:45.187951] [DEBUG] [LOCAL ] HOUS: Loaded 44903 existing records from primary storage. [2025-09-28T02:16:45.220543] [INFO ] [MAIN ] HOUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:45.303715] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HOUS took 1.1s. Estimated remaining: 18m 9s. Rate: 73.2 symbols/min [2025-09-28T02:16:45.361450] [DEBUG] [LOCAL ] HP: Loaded 52313 existing records from primary storage. [2025-09-28T02:16:45.372220] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:45.404585] [INFO ] [MAIN ] HP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:45.453519] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HP took 1.3s. Estimated remaining: 18m 7s. Rate: 73.3 symbols/min [2025-09-28T02:16:45.626324] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:45.839273] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:45.893214] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:45.893596] [DEBUG] [LOCAL ] HPF: Loaded 7388 existing records from primary storage. [2025-09-28T02:16:45.909109] [INFO ] [MAIN ] HPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:45.909488] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 0.7s. Estimated remaining: 18m 6s. Rate: 73.3 symbols/min [2025-09-28T02:16:46.053601] [DEBUG] [LOCAL ] HPI: Loaded 10339 existing records from primary storage. [2025-09-28T02:16:46.055735] [INFO ] [MAIN ] HPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:46.066221] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPI took 0.7s. Estimated remaining: 18m 4s. Rate: 73.3 symbols/min [2025-09-28T02:16:46.078240] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-09-28T02:16:46.099856] [INFO ] [MAIN ] HPE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:46.160483] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPE took 1.1s. Estimated remaining: 18m 2s. Rate: 73.4 symbols/min [2025-09-28T02:16:46.227092] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:46.422778] [DEBUG] [LOCAL ] HPP: Loaded 51595 existing records from primary storage. [2025-09-28T02:16:46.475998] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:46.476755] [INFO ] [MAIN ] HPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:46.529595] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPP took 1.0s. Estimated remaining: 18m 1s. Rate: 73.4 symbols/min [2025-09-28T02:16:46.556931] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:46.634313] [DEBUG] [LOCAL ] HPS: Loaded 10277 existing records from primary storage. [2025-09-28T02:16:46.687805] [INFO ] [MAIN ] HPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:46.712707] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPS took 0.6s. Estimated remaining: 17m 59s. Rate: 73.5 symbols/min [2025-09-28T02:16:46.889914] [DEBUG] [LOCAL ] HQH: Loaded 25387 existing records from primary storage. [2025-09-28T02:16:46.900796] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-09-28T02:16:46.952963] [INFO ] [MAIN ] HPQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:46.964029] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPQ took 1.1s. Estimated remaining: 17m 58s. Rate: 73.5 symbols/min [2025-09-28T02:16:46.956822] [INFO ] [MAIN ] HQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:46.956534] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:46.985960] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQH took 0.8s. Estimated remaining: 17m 56s. Rate: 73.6 symbols/min [2025-09-28T02:16:47.408535] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:47.428194] [DEBUG] [LOCAL ] HQL: Loaded 16206 existing records from primary storage. [2025-09-28T02:16:47.495044] [INFO ] [MAIN ] HQL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:47.547222] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQL took 1.0s. Estimated remaining: 17m 55s. Rate: 73.6 symbols/min [2025-09-28T02:16:47.690939] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:47.905311] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:47.996816] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:48.018273] [DEBUG] [LOCAL ] HR: Loaded 52716 existing records from primary storage. [2025-09-28T02:16:48.019426] [INFO ] [MAIN ] HR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:48.019574] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HR took 1.3s. Estimated remaining: 17m 54s. Rate: 73.7 symbols/min [2025-09-28T02:16:48.219775] [DEBUG] [LOCAL ] HRB: Loaded 49275 existing records from primary storage. [2025-09-28T02:16:48.256866] [INFO ] [MAIN ] HRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:48.302358] [DEBUG] [LOCAL ] HRI: Loaded 33507 existing records from primary storage. [2025-09-28T02:16:48.328190] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRB took 1.4s. Estimated remaining: 17m 52s. Rate: 73.7 symbols/min [2025-09-28T02:16:48.332894] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:48.338943] [INFO ] [MAIN ] HRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:48.359825] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRI took 1.3s. Estimated remaining: 17m 50s. Rate: 73.8 symbols/min [2025-09-28T02:16:48.526593] [DEBUG] [LOCAL ] HRL: Loaded 53855 existing records from primary storage. [2025-09-28T02:16:48.666810] [INFO ] [MAIN ] HRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:48.718560] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:48.719376] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRL took 1.2s. Estimated remaining: 17m 49s. Rate: 73.8 symbols/min [2025-09-28T02:16:48.814244] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:48.799518] [DEBUG] [LOCAL ] HRTG: Loaded 33658 existing records from primary storage. [2025-09-28T02:16:48.872526] [INFO ] [MAIN ] HRTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:48.884401] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRTG took 0.9s. Estimated remaining: 17m 47s. Rate: 73.9 symbols/min [2025-09-28T02:16:49.154399] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:49.155039] [DEBUG] [LOCAL ] HSHP: Loaded 15773 existing records from primary storage. [2025-09-28T02:16:49.178694] [INFO ] [MAIN ] HSHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:49.202816] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSHP took 0.8s. Estimated remaining: 17m 46s. Rate: 73.9 symbols/min [2025-09-28T02:16:49.239168] [DEBUG] [LOCAL ] HSBC: Loaded 51868 existing records from primary storage. [2025-09-28T02:16:49.264904] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:49.272108] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-28T02:16:49.292121] [INFO ] [MAIN ] HSBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:49.291985] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-28T02:16:49.308222] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-28T02:16:49.313532] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSBC took 1.0s. Estimated remaining: 17m 44s. Rate: 74.0 symbols/min [2025-09-28T02:16:49.335720] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-28T02:16:49.445845] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-28T02:16:49.517020] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-28T02:16:49.595203] [DEBUG] [LOCAL ] HSY: Loaded 51161 existing records from primary storage. [2025-09-28T02:16:49.650482] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:49.706051] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:49.693287] [INFO ] [MAIN ] HSY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:49.732578] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSY took 1.0s. Estimated remaining: 17m 43s. Rate: 74.0 symbols/min [2025-09-28T02:16:49.747371] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-28T02:16:49.801250] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-28T02:16:49.875786] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-28T02:16:49.902446] [DEBUG] [LOCAL ] HTD: Loaded 13754 existing records from primary storage. [2025-09-28T02:16:49.911222] [INFO ] [MAIN ] HTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:49.901849] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-28T02:16:49.916089] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTD took 0.7s. Estimated remaining: 17m 41s. Rate: 74.1 symbols/min [2025-09-28T02:16:49.916211] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-28T02:16:50.015242] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-28T02:16:50.269882] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:50.614808] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:50.825891] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:16:50.843175] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-28T02:16:50.943119] [DEBUG] [LOCAL ] HTGC: Loaded 48222 existing records from primary storage. [2025-09-28T02:16:50.977122] [INFO ] [MAIN ] HTGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:51.013763] [DEBUG] [LOCAL ] HTH: Loaded 32696 existing records from primary storage. [2025-09-28T02:16:51.021888] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTGC took 1.3s. Estimated remaining: 17m 41s. Rate: 74.0 symbols/min [2025-09-28T02:16:51.022170] [INFO ] [MAIN ] HTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:51.021497] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:16:51.027553] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTH took 1.1s. Estimated remaining: 17m 39s. Rate: 74.1 symbols/min [2025-09-28T02:16:51.027849] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-28T02:16:51.175359] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:16:51.251202] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-28T02:16:51.261711] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:16:51.308683] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-09-28T02:16:51.327092] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:16:51.327295] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-28T02:16:51.330933] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:51.331265] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-28T02:16:51.331559] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-28T02:16:51.331734] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-28T02:16:51.332012] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTB took 2.4s. Estimated remaining: 17m 38s. Rate: 74.1 symbols/min [2025-09-28T02:16:51.527498] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:51.555880] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-28T02:16:51.581136] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-28T02:16:51.679246] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:51.705376] [DEBUG] [LOCAL ] HUBB: Loaded 37650 existing records from primary storage. [2025-09-28T02:16:51.706284] [INFO ] [MAIN ] HUBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:51.706506] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 0.7s. Estimated remaining: 17m 36s. Rate: 74.2 symbols/min [2025-09-28T02:16:51.871265] [DEBUG] [LOCAL ] HUBS: Loaded 39953 existing records from primary storage. [2025-09-28T02:16:51.901567] [INFO ] [MAIN ] HUBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:51.929722] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:51.943268] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUBS took 0.9s. Estimated remaining: 17m 35s. Rate: 74.2 symbols/min [2025-09-28T02:16:51.991147] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-28T02:16:52.022187] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-28T02:16:52.101949] [DEBUG] [LOCAL ] HUM: Loaded 49568 existing records from primary storage. [2025-09-28T02:16:52.138807] [INFO ] [MAIN ] HUM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:52.139078] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUM took 0.8s. Estimated remaining: 17m 33s. Rate: 74.3 symbols/min [2025-09-28T02:16:52.161136] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:52.344200] [DEBUG] [LOCAL ] HUN: Loaded 53976 existing records from primary storage. [2025-09-28T02:16:52.393665] [INFO ] [MAIN ] HUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:52.426896] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-28T02:16:52.426620] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:52.427059] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUN took 0.7s. Estimated remaining: 17m 32s. Rate: 74.3 symbols/min [2025-09-28T02:16:52.428868] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-28T02:16:52.572529] [DEBUG] [LOCAL ] HUYA: Loaded 44956 existing records from primary storage. [2025-09-28T02:16:52.602155] [DEBUG] [LOCAL ] HVT: Loaded 16133 existing records from primary storage. [2025-09-28T02:16:52.591258] [INFO ] [MAIN ] HUYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:52.640887] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HUYA took 0.7s. Estimated remaining: 17m 30s. Rate: 74.4 symbols/min [2025-09-28T02:16:52.624229] [INFO ] [MAIN ] HVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:52.663330] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:52.686327] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HVT took 0.5s. Estimated remaining: 17m 28s. Rate: 74.4 symbols/min [2025-09-28T02:16:52.880927] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-28T02:16:52.948952] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-28T02:16:52.985183] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:53.059901] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:53.115135] [DEBUG] [LOCAL ] HY: Loaded 10192 existing records from primary storage. [2025-09-28T02:16:53.117068] [INFO ] [MAIN ] HY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:53.118249] [DEBUG] [LOCAL ] HWM: Loaded 53767 existing records from primary storage. [2025-09-28T02:16:53.117253] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HY took 0.4s. Estimated remaining: 17m 27s. Rate: 74.5 symbols/min [2025-09-28T02:16:53.119049] [INFO ] [MAIN ] HWM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:53.152149] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HWM took 0.7s. Estimated remaining: 17m 25s. Rate: 74.5 symbols/min [2025-09-28T02:16:53.489112] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-28T02:16:53.523796] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-28T02:16:53.519617] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:53.547119] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:53.542711] [DEBUG] [LOCAL ] HXL: Loaded 46661 existing records from primary storage. [2025-09-28T02:16:53.548182] [INFO ] [MAIN ] HXL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:53.547978] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-28T02:16:53.548433] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HXL took 0.9s. Estimated remaining: 17m 24s. Rate: 74.6 symbols/min [2025-09-28T02:16:53.548909] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-28T02:16:53.554538] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-28T02:16:53.548577] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-28T02:16:53.575522] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-28T02:16:53.575300] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-28T02:16:53.626677] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-28T02:16:53.649724] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-28T02:16:53.650257] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-28T02:16:53.669124] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-28T02:16:53.649908] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-28T02:16:53.679773] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-28T02:16:53.995324] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-28T02:16:54.016831] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-28T02:16:54.021548] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:54.344146] [DEBUG] [LOCAL ] HYI: Loaded 9254 existing records from primary storage. [2025-09-28T02:16:54.434218] [INFO ] [MAIN ] HYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:54.454448] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HYI took 0.9s. Estimated remaining: 17m 24s. Rate: 74.6 symbols/min [2025-09-28T02:16:54.448136] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-28T02:16:54.610138] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-28T02:16:54.613957] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:16:54.634205] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-28T02:16:54.707182] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:16:54.713246] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-28T02:16:54.833396] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:54.867548] [DEBUG] [LOCAL ] HYT: Loaded 33853 existing records from primary storage. [2025-09-28T02:16:54.867911] [INFO ] [MAIN ] HYT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:54.868410] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYT took 0.3s. Estimated remaining: 17m 22s. Rate: 74.6 symbols/min [2025-09-28T02:16:54.985178] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-28T02:16:54.992690] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-28T02:16:55.071227] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:55.078575] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-28T02:16:55.080009] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-28T02:16:55.082784] [DEBUG] [LOCAL ] HYTR: Loaded 3208 existing records from primary storage. [2025-09-28T02:16:55.083975] [INFO ] [MAIN ] HYTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:55.084094] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYTR took 0.2s. Estimated remaining: 17m 21s. Rate: 74.7 symbols/min [2025-09-28T02:16:55.193434] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-28T02:16:55.194772] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-28T02:16:55.274013] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:16:55.308437] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-28T02:16:55.306377] [DEBUG] [LOCAL ] HZO: Loaded 29733 existing records from primary storage. [2025-09-28T02:16:55.309623] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-28T02:16:55.309818] [INFO ] [MAIN ] HZO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:16:55.310634] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HZO took 0.2s. Estimated remaining: 17m 19s. Rate: 74.7 symbols/min [2025-09-28T02:16:55.492950] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-28T02:16:55.494351] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-28T02:16:55.541617] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-28T02:16:55.542665] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-28T02:16:55.548505] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-28T02:16:55.549284] [INFO ] [REMOTE ] HTFC: Full fetch complete (837 records). [2025-09-28T02:16:55.549426] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-28T02:16:55.746012] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-28T02:16:55.746235] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:16:55.746310] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:16:55.746389] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-28T02:16:55.746505] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-28T02:16:55.746580] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-28T02:16:55.746745] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-28T02:16:55.746866] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HTFC took 6.4s. Estimated remaining: 17m 18s. Rate: 74.7 symbols/min [2025-09-28T02:16:55.753506] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-28T02:16:55.754472] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-28T02:16:55.925045] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-28T02:16:55.926020] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-28T02:16:56.113153] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-28T02:16:56.114112] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-28T02:16:56.153689] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-28T02:16:56.154683] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-28T02:16:56.477156] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-28T02:16:56.478558] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-28T02:16:56.481575] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-28T02:16:56.482476] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-28T02:16:56.819428] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-28T02:16:56.823155] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-28T02:16:56.823299] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-28T02:16:56.824777] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-28T02:16:57.140557] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-28T02:16:57.141534] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-28T02:16:57.149314] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-28T02:16:57.150370] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-28T02:16:57.425828] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-28T02:16:57.426866] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-28T02:16:57.579703] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-28T02:16:57.581029] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-28T02:16:57.810595] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-28T02:16:57.813634] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-28T02:16:58.255770] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-28T02:16:58.492109] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-28T02:16:58.492848] [INFO ] [REMOTE ] HYAC: Full fetch complete (866 records). [2025-09-28T02:16:58.492953] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-28T02:16:58.493438] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:16:58.493521] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:16:58.493588] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:16:58.493689] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-28T02:16:58.493826] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-28T02:16:58.493908] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-28T02:16:58.494003] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-28T02:16:58.494110] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYAC took 5.4s. Estimated remaining: 17m 20s. Rate: 74.6 symbols/min [2025-09-28T02:16:59.055733] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-28T02:16:59.297957] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-28T02:16:59.298722] [INFO ] [REMOTE ] HYBX: Full fetch complete (799 records). [2025-09-28T02:16:59.298816] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-28T02:16:59.487333] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-28T02:16:59.487532] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:16:59.487603] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:16:59.487706] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-28T02:16:59.487787] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-28T02:16:59.487854] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-28T02:16:59.487947] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-28T02:16:59.488052] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HYBX took 6.3s. Estimated remaining: 17m 19s. Rate: 74.6 symbols/min [2025-09-28T02:17:00.162449] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:00.270889] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:00.212168] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:00.300915] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:00.314240] [DEBUG] [LOCAL ] IAE: Loaded 6104 existing records from primary storage. [2025-09-28T02:17:00.314535] [INFO ] [MAIN ] IAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:00.314767] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 0.8s. Estimated remaining: 17m 18s. Rate: 74.6 symbols/min [2025-09-28T02:17:00.582224] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:00.628254] [DEBUG] [LOCAL ] IBN: Loaded 53654 existing records from primary storage. [2025-09-28T02:17:00.645963] [INFO ] [MAIN ] IBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:00.646143] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBN took 1.2s. Estimated remaining: 17m 17s. Rate: 74.6 symbols/min [2025-09-28T02:17:00.646955] [DEBUG] [LOCAL ] IBM: Loaded 54416 existing records from primary storage. [2025-09-28T02:17:00.670724] [DEBUG] [LOCAL ] IAG: Loaded 54225 existing records from primary storage. [2025-09-28T02:17:00.697152] [INFO ] [MAIN ] IBM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:00.691771] [INFO ] [MAIN ] IAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:00.726900] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IAG took 1.2s. Estimated remaining: 17m 15s. Rate: 74.7 symbols/min [2025-09-28T02:17:00.771997] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBM took 1.2s. Estimated remaining: 17m 13s. Rate: 74.7 symbols/min [2025-09-28T02:17:01.028004] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:01.105328] [DEBUG] [LOCAL ] IBP: Loaded 29584 existing records from primary storage. [2025-09-28T02:17:01.216729] [INFO ] [MAIN ] IBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:01.312333] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:01.313401] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBP took 1.0s. Estimated remaining: 17m 12s. Rate: 74.7 symbols/min [2025-09-28T02:17:01.335939] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:01.482322] [DEBUG] [LOCAL ] IBTA: Loaded 38445 existing records from primary storage. [2025-09-28T02:17:01.503620] [INFO ] [MAIN ] IBTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:01.503922] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. IBTA took 0.9s. Estimated remaining: 17m 11s. Rate: 74.8 symbols/min [2025-09-28T02:17:01.783708] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:01.790049] [DEBUG] [LOCAL ] ICL: Loaded 39135 existing records from primary storage. [2025-09-28T02:17:01.791864] [INFO ] [MAIN ] ICL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:01.809026] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. ICL took 1.0s. Estimated remaining: 17m 9s. Rate: 74.8 symbols/min [2025-09-28T02:17:01.932855] [DEBUG] [LOCAL ] ICE: Loaded 53800 existing records from primary storage. [2025-09-28T02:17:01.940263] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:01.951936] [INFO ] [MAIN ] ICE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:01.972147] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICE took 1.2s. Estimated remaining: 17m 8s. Rate: 74.9 symbols/min [2025-09-28T02:17:02.109300] [DEBUG] [LOCAL ] IDE: Loaded 8755 existing records from primary storage. [2025-09-28T02:17:02.231116] [DEBUG] [LOCAL ] IDA: Loaded 32398 existing records from primary storage. [2025-09-28T02:17:02.224502] [INFO ] [MAIN ] IDE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:02.219075] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:02.275566] [INFO ] [MAIN ] IDA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:02.265087] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDE took 0.7s. Estimated remaining: 17m 6s. Rate: 74.9 symbols/min [2025-09-28T02:17:02.287027] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDA took 0.9s. Estimated remaining: 17m 5s. Rate: 75.0 symbols/min [2025-09-28T02:17:02.403797] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:02.488187] [DEBUG] [LOCAL ] IDT: Loaded 17885 existing records from primary storage. [2025-09-28T02:17:02.519444] [INFO ] [MAIN ] IDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:02.538037] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDT took 0.7s. Estimated remaining: 17m 3s. Rate: 75.1 symbols/min [2025-09-28T02:17:02.752662] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:02.893253] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:02.972999] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:02.974526] [DEBUG] [LOCAL ] IEX: Loaded 38978 existing records from primary storage. [2025-09-28T02:17:02.975453] [INFO ] [MAIN ] IEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:02.977278] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IEX took 0.9s. Estimated remaining: 17m 2s. Rate: 75.1 symbols/min [2025-09-28T02:17:03.031528] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-09-28T02:17:03.068397] [INFO ] [MAIN ] IFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:03.104196] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 0.8s. Estimated remaining: 17m 0s. Rate: 75.1 symbols/min [2025-09-28T02:17:03.139726] [DEBUG] [LOCAL ] IFS: Loaded 23359 existing records from primary storage. [2025-09-28T02:17:03.164850] [INFO ] [MAIN ] IFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:03.265998] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFS took 0.7s. Estimated remaining: 16m 59s. Rate: 75.2 symbols/min [2025-09-28T02:17:03.248841] [DEBUG] [LOCAL ] IFF: Loaded 51727 existing records from primary storage. [2025-09-28T02:17:03.324264] [INFO ] [MAIN ] IFF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:03.376813] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFF took 1.1s. Estimated remaining: 16m 57s. Rate: 75.3 symbols/min [2025-09-28T02:17:03.402984] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:03.752544] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:03.757455] [DEBUG] [LOCAL ] IGA: Loaded 9779 existing records from primary storage. [2025-09-28T02:17:03.808365] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:03.808928] [INFO ] [MAIN ] IGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:03.833229] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGA took 0.9s. Estimated remaining: 16m 56s. Rate: 75.3 symbols/min [2025-09-28T02:17:03.904402] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:03.953201] [DEBUG] [LOCAL ] IGI: Loaded 3756 existing records from primary storage. [2025-09-28T02:17:03.986316] [INFO ] [MAIN ] IGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:04.004158] [DEBUG] [LOCAL ] IGD: Loaded 19170 existing records from primary storage. [2025-09-28T02:17:04.008144] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGI took 0.7s. Estimated remaining: 16m 55s. Rate: 75.3 symbols/min [2025-09-28T02:17:04.007995] [INFO ] [MAIN ] IGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:04.019356] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGD took 0.8s. Estimated remaining: 16m 53s. Rate: 75.4 symbols/min [2025-09-28T02:17:04.190236] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:04.432595] [DEBUG] [LOCAL ] IGR: Loaded 30882 existing records from primary storage. [2025-09-28T02:17:04.472014] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:04.510586] [DEBUG] [LOCAL ] IH: Loaded 3450 existing records from primary storage. [2025-09-28T02:17:04.511315] [INFO ] [MAIN ] IGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:04.514023] [INFO ] [MAIN ] IH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:04.513286] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:04.514478] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IH took 0.7s. Estimated remaining: 16m 52s. Rate: 75.4 symbols/min [2025-09-28T02:17:04.514924] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IGR took 1.1s. Estimated remaining: 16m 50s. Rate: 75.5 symbols/min [2025-09-28T02:17:04.688877] [DEBUG] [LOCAL ] IHD: Loaded 7225 existing records from primary storage. [2025-09-28T02:17:04.735037] [INFO ] [MAIN ] IHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:04.763090] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IHD took 0.8s. Estimated remaining: 16m 49s. Rate: 75.5 symbols/min [2025-09-28T02:17:04.929202] [DEBUG] [LOCAL ] IHG: Loaded 24977 existing records from primary storage. [2025-09-28T02:17:04.941030] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:04.987557] [INFO ] [MAIN ] IHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:05.044290] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:05.039730] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHG took 1.0s. Estimated remaining: 16m 47s. Rate: 75.6 symbols/min [2025-09-28T02:17:05.222434] [DEBUG] [LOCAL ] IIF: Loaded 5787 existing records from primary storage. [2025-09-28T02:17:05.288495] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:05.288754] [INFO ] [MAIN ] IIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:05.310530] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IIF took 0.8s. Estimated remaining: 16m 46s. Rate: 75.6 symbols/min [2025-09-28T02:17:05.381889] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:05.460336] [DEBUG] [LOCAL ] IHS: Loaded 39400 existing records from primary storage. [2025-09-28T02:17:05.498922] [INFO ] [MAIN ] IHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:05.493616] [DEBUG] [LOCAL ] IIIN: Loaded 16828 existing records from primary storage. [2025-09-28T02:17:05.515100] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHS took 1.0s. Estimated remaining: 16m 44s. Rate: 75.7 symbols/min [2025-09-28T02:17:05.515859] [INFO ] [MAIN ] IIIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:05.520378] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIIN took 0.7s. Estimated remaining: 16m 43s. Rate: 75.8 symbols/min [2025-09-28T02:17:05.622076] [DEBUG] [LOCAL ] IIM: Loaded 16102 existing records from primary storage. [2025-09-28T02:17:05.731796] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:05.731947] [INFO ] [MAIN ] IIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:05.827331] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIM took 0.8s. Estimated remaining: 16m 41s. Rate: 75.8 symbols/min [2025-09-28T02:17:05.983615] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:05.980241] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:06.092624] [DEBUG] [LOCAL ] IIPR: Loaded 30052 existing records from primary storage. [2025-09-28T02:17:06.123037] [INFO ] [MAIN ] IIPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:06.123752] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIPR took 0.8s. Estimated remaining: 16m 40s. Rate: 75.8 symbols/min [2025-09-28T02:17:06.320588] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:06.416832] [DEBUG] [LOCAL ] IMAX: Loaded 43382 existing records from primary storage. [2025-09-28T02:17:06.446807] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:06.447577] [INFO ] [MAIN ] IMAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:06.461521] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IMAX took 0.9s. Estimated remaining: 16m 39s. Rate: 75.9 symbols/min [2025-09-28T02:17:06.534202] [DEBUG] [LOCAL ] INFA: Loaded 50602 existing records from primary storage. [2025-09-28T02:17:06.584635] [INFO ] [MAIN ] INFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:06.612370] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFA took 1.0s. Estimated remaining: 16m 37s. Rate: 75.9 symbols/min [2025-09-28T02:17:06.671132] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:06.878866] [DEBUG] [LOCAL ] ING: Loaded 51537 existing records from primary storage. [2025-09-28T02:17:06.880607] [DEBUG] [LOCAL ] INFY: Loaded 54378 existing records from primary storage. [2025-09-28T02:17:06.900075] [INFO ] [MAIN ] INFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:06.905997] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFY took 0.9s. Estimated remaining: 16m 36s. Rate: 76.0 symbols/min [2025-09-28T02:17:06.905451] [INFO ] [MAIN ] ING: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:06.972897] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. ING took 0.8s. Estimated remaining: 16m 34s. Rate: 76.0 symbols/min [2025-09-28T02:17:07.019572] [DEBUG] [LOCAL ] INGM: Loaded 29224 existing records from primary storage. [2025-09-28T02:17:07.036242] [INFO ] [MAIN ] INGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:07.042032] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:07.062143] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INGM took 0.6s. Estimated remaining: 16m 33s. Rate: 76.1 symbols/min [2025-09-28T02:17:07.480686] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:07.562799] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:07.584610] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:07.585987] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-28T02:17:07.586254] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-28T02:17:07.596992] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-28T02:17:07.598508] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-28T02:17:07.598636] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-28T02:17:07.598728] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-28T02:17:07.652081] [DEBUG] [LOCAL ] INGR: Loaded 33913 existing records from primary storage. [2025-09-28T02:17:07.680756] [INFO ] [MAIN ] INGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:07.698047] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INGR took 1.1s. Estimated remaining: 16m 32s. Rate: 76.1 symbols/min [2025-09-28T02:17:07.904004] [DEBUG] [LOCAL ] INSP: Loaded 37492 existing records from primary storage. [2025-09-28T02:17:07.942250] [INFO ] [MAIN ] INSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:08.027362] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INSP took 0.9s. Estimated remaining: 16m 30s. Rate: 76.2 symbols/min [2025-09-28T02:17:08.027163] [DEBUG] [LOCAL ] INN: Loaded 42433 existing records from primary storage. [2025-09-28T02:17:08.064455] [INFO ] [MAIN ] INN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:08.138288] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INN took 1.2s. Estimated remaining: 16m 29s. Rate: 76.2 symbols/min [2025-09-28T02:17:08.285191] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:08.537031] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:08.552189] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:08.575462] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-28T02:17:08.654118] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:08.688051] [DEBUG] [LOCAL ] INSW: Loaded 40831 existing records from primary storage. [2025-09-28T02:17:08.688680] [INFO ] [MAIN ] INSW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:08.688780] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSW took 1.0s. Estimated remaining: 16m 28s. Rate: 76.2 symbols/min [2025-09-28T02:17:08.862544] [DEBUG] [LOCAL ] INVX: Loaded 29366 existing records from primary storage. [2025-09-28T02:17:08.892059] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:17:08.939034] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:08.915009] [INFO ] [MAIN ] INVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:08.940559] [DEBUG] [LOCAL ] INVH: Loaded 53918 existing records from primary storage. [2025-09-28T02:17:08.940727] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INVX took 0.7s. Estimated remaining: 16m 26s. Rate: 76.3 symbols/min [2025-09-28T02:17:08.941558] [INFO ] [MAIN ] INVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:08.941418] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-28T02:17:08.941921] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:17:08.943181] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-09-28T02:17:08.943074] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVH took 0.9s. Estimated remaining: 16m 25s. Rate: 76.3 symbols/min [2025-09-28T02:17:08.943344] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:17:08.943445] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-28T02:17:08.943754] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-28T02:17:08.943876] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-28T02:17:08.943978] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-28T02:17:08.944059] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INR took 1.9s. Estimated remaining: 16m 23s. Rate: 76.4 symbols/min [2025-09-28T02:17:08.995147] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-09-28T02:17:08.995543] [INFO ] [MAIN ] IONQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:08.995680] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 0.3s. Estimated remaining: 16m 21s. Rate: 76.5 symbols/min [2025-09-28T02:17:09.691089] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:09.668574] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:09.781402] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:09.787240] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:09.807781] [DEBUG] [LOCAL ] IPI: Loaded 21704 existing records from primary storage. [2025-09-28T02:17:09.811349] [INFO ] [MAIN ] IPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:09.811591] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPI took 0.8s. Estimated remaining: 16m 21s. Rate: 76.5 symbols/min [2025-09-28T02:17:10.064696] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:10.115522] [DEBUG] [LOCAL ] IPG: Loaded 54110 existing records from primary storage. [2025-09-28T02:17:10.116107] [INFO ] [MAIN ] IPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:10.117551] [DEBUG] [LOCAL ] IOT: Loaded 54249 existing records from primary storage. [2025-09-28T02:17:10.117882] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IPG took 1.1s. Estimated remaining: 16m 19s. Rate: 76.5 symbols/min [2025-09-28T02:17:10.129579] [INFO ] [MAIN ] IOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:10.171126] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IOT took 1.2s. Estimated remaining: 16m 18s. Rate: 76.6 symbols/min [2025-09-28T02:17:10.150984] [DEBUG] [LOCAL ] IP: Loaded 54093 existing records from primary storage. [2025-09-28T02:17:10.226103] [DEBUG] [LOCAL ] IQI: Loaded 18161 existing records from primary storage. [2025-09-28T02:17:10.241911] [INFO ] [MAIN ] IP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:10.283686] [INFO ] [MAIN ] IQI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:10.283838] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IP took 1.2s. Estimated remaining: 16m 16s. Rate: 76.6 symbols/min [2025-09-28T02:17:10.314515] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQI took 0.5s. Estimated remaining: 16m 15s. Rate: 76.7 symbols/min [2025-09-28T02:17:10.653080] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:10.854293] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:10.922885] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:10.951495] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:10.994716] [DEBUG] [LOCAL ] IRS: Loaded 22136 existing records from primary storage. [2025-09-28T02:17:10.995043] [INFO ] [MAIN ] IRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:10.995122] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IRS took 0.6s. Estimated remaining: 16m 14s. Rate: 76.7 symbols/min [2025-09-28T02:17:11.151252] [DEBUG] [LOCAL ] IQV: Loaded 50895 existing records from primary storage. [2025-09-28T02:17:11.212832] [INFO ] [MAIN ] IQV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:11.183562] [DEBUG] [LOCAL ] IRM: Loaded 50159 existing records from primary storage. [2025-09-28T02:17:11.229820] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IQV took 1.1s. Estimated remaining: 16m 12s. Rate: 76.8 symbols/min [2025-09-28T02:17:11.229954] [INFO ] [MAIN ] IRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:11.262921] [DEBUG] [LOCAL ] IR: Loaded 53470 existing records from primary storage. [2025-09-28T02:17:11.235431] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IRM took 0.9s. Estimated remaining: 16m 11s. Rate: 76.8 symbols/min [2025-09-28T02:17:11.326468] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:11.335876] [INFO ] [MAIN ] IR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:11.423729] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IR took 1.2s. Estimated remaining: 16m 9s. Rate: 76.9 symbols/min [2025-09-28T02:17:11.732607] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:11.764198] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:11.860131] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:11.877104] [DEBUG] [LOCAL ] IRT: Loaded 51146 existing records from primary storage. [2025-09-28T02:17:11.877912] [INFO ] [MAIN ] IRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:11.878213] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IRT took 0.9s. Estimated remaining: 16m 8s. Rate: 76.9 symbols/min [2025-09-28T02:17:12.014482] [DEBUG] [LOCAL ] ISD: Loaded 15803 existing records from primary storage. [2025-09-28T02:17:12.027941] [INFO ] [MAIN ] ISD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:12.033829] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. ISD took 0.8s. Estimated remaining: 16m 7s. Rate: 77.0 symbols/min [2025-09-28T02:17:12.148764] [DEBUG] [LOCAL ] IT: Loaded 42234 existing records from primary storage. [2025-09-28T02:17:12.207348] [DEBUG] [LOCAL ] ITGR: Loaded 31996 existing records from primary storage. [2025-09-28T02:17:12.212746] [INFO ] [MAIN ] IT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:12.219105] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. IT took 0.9s. Estimated remaining: 16m 5s. Rate: 77.0 symbols/min [2025-09-28T02:17:12.218351] [INFO ] [MAIN ] ITGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:12.201117] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:12.243564] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ITGR took 0.8s. Estimated remaining: 16m 4s. Rate: 77.1 symbols/min [2025-09-28T02:17:12.571925] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:12.673893] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:12.752597] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:12.764559] [DEBUG] [LOCAL ] ITT: Loaded 33511 existing records from primary storage. [2025-09-28T02:17:12.765717] [INFO ] [MAIN ] ITT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:12.766057] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 0.9s. Estimated remaining: 16m 3s. Rate: 77.1 symbols/min [2025-09-28T02:17:13.020461] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:13.025494] [DEBUG] [LOCAL ] ITUB: Loaded 54084 existing records from primary storage. [2025-09-28T02:17:13.028409] [INFO ] [MAIN ] ITUB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:13.029972] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITUB took 0.9s. Estimated remaining: 16m 1s. Rate: 77.2 symbols/min [2025-09-28T02:17:13.063770] [DEBUG] [LOCAL ] IVR: Loaded 48557 existing records from primary storage. [2025-09-28T02:17:13.103173] [INFO ] [MAIN ] IVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:13.103433] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. IVR took 0.8s. Estimated remaining: 15m 60s. Rate: 77.2 symbols/min [2025-09-28T02:17:13.109511] [DEBUG] [LOCAL ] ITW: Loaded 46782 existing records from primary storage. [2025-09-28T02:17:13.232344] [INFO ] [MAIN ] ITW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:13.327114] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. ITW took 1.1s. Estimated remaining: 15m 58s. Rate: 77.3 symbols/min [2025-09-28T02:17:13.352987] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:13.328157] [DEBUG] [LOCAL ] IVT: Loaded 31325 existing records from primary storage. [2025-09-28T02:17:13.381182] [INFO ] [MAIN ] IVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:13.381966] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IVT took 0.6s. Estimated remaining: 15m 57s. Rate: 77.3 symbols/min [2025-09-28T02:17:13.650590] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:13.884203] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:13.885347] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:13.897038] [DEBUG] [LOCAL ] IX: Loaded 22926 existing records from primary storage. [2025-09-28T02:17:13.898908] [INFO ] [MAIN ] IX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:13.914145] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IX took 0.8s. Estimated remaining: 15m 56s. Rate: 77.3 symbols/min [2025-09-28T02:17:13.916173] [DEBUG] [LOCAL ] IVZ: Loaded 53908 existing records from primary storage. [2025-09-28T02:17:13.921968] [INFO ] [MAIN ] IVZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:13.939581] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. IVZ took 0.9s. Estimated remaining: 15m 54s. Rate: 77.4 symbols/min [2025-09-28T02:17:14.325972] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:14.335588] [DEBUG] [LOCAL ] J: Loaded 40873 existing records from primary storage. [2025-09-28T02:17:14.365819] [INFO ] [MAIN ] J: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:14.365635] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:14.360419] [DEBUG] [LOCAL ] JBGS: Loaded 43089 existing records from primary storage. [2025-09-28T02:17:14.366713] [INFO ] [MAIN ] JBGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:14.366813] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. J took 1.0s. Estimated remaining: 15m 53s. Rate: 77.4 symbols/min [2025-09-28T02:17:14.378553] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBGS took 1.0s. Estimated remaining: 15m 51s. Rate: 77.5 symbols/min [2025-09-28T02:17:14.685459] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:14.733510] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-28T02:17:14.752900] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:14.776597] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-28T02:17:14.778179] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-28T02:17:14.779989] [DEBUG] [LOCAL ] JBI: Loaded 44362 existing records from primary storage. [2025-09-28T02:17:14.780757] [INFO ] [MAIN ] JBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:14.780913] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBI took 0.9s. Estimated remaining: 15m 50s. Rate: 77.5 symbols/min [2025-09-28T02:17:14.778328] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-28T02:17:14.826235] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-28T02:17:14.872082] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-28T02:17:14.907410] [DEBUG] [LOCAL ] JBL: Loaded 49145 existing records from primary storage. [2025-09-28T02:17:14.932848] [INFO ] [MAIN ] JBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:14.933780] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBL took 1.0s. Estimated remaining: 15m 49s. Rate: 77.6 symbols/min [2025-09-28T02:17:15.046450] [DEBUG] [LOCAL ] JBND: Loaded 26051 existing records from primary storage. [2025-09-28T02:17:15.153813] [INFO ] [MAIN ] JBND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:15.159227] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBND took 0.8s. Estimated remaining: 15m 47s. Rate: 77.6 symbols/min [2025-09-28T02:17:15.106555] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:15.173959] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-28T02:17:15.216260] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-28T02:17:15.445487] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:15.340451] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-28T02:17:15.478566] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-28T02:17:15.497899] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-28T02:17:15.609498] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-28T02:17:15.622958] [DEBUG] [LOCAL ] JCE: Loaded 6591 existing records from primary storage. [2025-09-28T02:17:15.661556] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:15.748519] [INFO ] [MAIN ] JCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:15.793743] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JCE took 0.8s. Estimated remaining: 15m 46s. Rate: 77.7 symbols/min [2025-09-28T02:17:16.110949] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:16.137749] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-28T02:17:16.342342] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:16.428490] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:16.430350] [DEBUG] [LOCAL ] JCI: Loaded 54327 existing records from primary storage. [2025-09-28T02:17:16.431038] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-28T02:17:16.432278] [INFO ] [MAIN ] JCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:16.432501] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JCI took 1.3s. Estimated remaining: 15m 46s. Rate: 77.7 symbols/min [2025-09-28T02:17:16.483255] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:17:16.520615] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-28T02:17:16.531175] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:17:16.550717] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-09-28T02:17:16.550989] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:17:16.551458] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-28T02:17:16.562436] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-28T02:17:16.578621] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-28T02:17:16.670284] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:16.670432] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:17:16.670672] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-28T02:17:16.671533] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-28T02:17:16.671947] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:17:16.671902] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JBS took 2.3s. Estimated remaining: 15m 44s. Rate: 77.7 symbols/min [2025-09-28T02:17:16.672123] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-09-28T02:17:16.756034] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:17:16.756327] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-28T02:17:16.756428] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-28T02:17:16.756507] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-28T02:17:16.756592] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-28T02:17:16.756725] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JBTM took 2.0s. Estimated remaining: 15m 43s. Rate: 77.8 symbols/min [2025-09-28T02:17:16.957678] [DEBUG] [LOCAL ] JEF: Loaded 50763 existing records from primary storage. [2025-09-28T02:17:17.026206] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:17.038405] [INFO ] [MAIN ] JEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:17.060941] [DEBUG] [LOCAL ] JELD: Loaded 46791 existing records from primary storage. [2025-09-28T02:17:17.067412] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JEF took 1.2s. Estimated remaining: 15m 41s. Rate: 77.8 symbols/min [2025-09-28T02:17:17.090457] [INFO ] [MAIN ] JELD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:17.135909] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JELD took 0.7s. Estimated remaining: 15m 40s. Rate: 77.9 symbols/min [2025-09-28T02:17:17.145933] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:17.250132] [DEBUG] [LOCAL ] JEQ: Loaded 9336 existing records from primary storage. [2025-09-28T02:17:17.324539] [INFO ] [MAIN ] JEQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:17.397627] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JEQ took 0.7s. Estimated remaining: 15m 39s. Rate: 77.9 symbols/min [2025-09-28T02:17:17.435708] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:17.560853] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:17.567432] [DEBUG] [LOCAL ] JFR: Loaded 30975 existing records from primary storage. [2025-09-28T02:17:17.581241] [INFO ] [MAIN ] JFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:17.604504] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JFR took 0.8s. Estimated remaining: 15m 37s. Rate: 78.0 symbols/min [2025-09-28T02:17:17.641702] [DEBUG] [LOCAL ] JGH: Loaded 11064 existing records from primary storage. [2025-09-28T02:17:17.707600] [INFO ] [MAIN ] JGH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:17.729819] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JGH took 0.6s. Estimated remaining: 15m 36s. Rate: 78.0 symbols/min [2025-09-28T02:17:17.952239] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:18.117115] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:18.145821] [DEBUG] [LOCAL ] JHG: Loaded 48497 existing records from primary storage. [2025-09-28T02:17:18.173862] [INFO ] [MAIN ] JHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:18.174792] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:18.179113] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHG took 1.0s. Estimated remaining: 15m 35s. Rate: 78.1 symbols/min [2025-09-28T02:17:18.179494] [DEBUG] [LOCAL ] JHI: Loaded 3641 existing records from primary storage. [2025-09-28T02:17:18.193307] [INFO ] [MAIN ] JHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:18.203874] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHI took 0.8s. Estimated remaining: 15m 33s. Rate: 78.1 symbols/min [2025-09-28T02:17:18.232116] [DEBUG] [LOCAL ] JHS: Loaded 2878 existing records from primary storage. [2025-09-28T02:17:18.289845] [INFO ] [MAIN ] JHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:18.331073] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JHS took 0.7s. Estimated remaining: 15m 32s. Rate: 78.2 symbols/min [2025-09-28T02:17:18.527804] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:18.586472] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:18.605638] [DEBUG] [LOCAL ] JHX: Loaded 51216 existing records from primary storage. [2025-09-28T02:17:18.606313] [INFO ] [MAIN ] JHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:18.606558] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JHX took 0.8s. Estimated remaining: 15m 30s. Rate: 78.2 symbols/min [2025-09-28T02:17:18.627231] [DEBUG] [LOCAL ] JILL: Loaded 16931 existing records from primary storage. [2025-09-28T02:17:18.627684] [INFO ] [MAIN ] JILL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:18.627904] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JILL took 0.4s. Estimated remaining: 15m 29s. Rate: 78.3 symbols/min [2025-09-28T02:17:18.656345] [DEBUG] [LOCAL ] JKS: Loaded 40672 existing records from primary storage. [2025-09-28T02:17:18.656789] [INFO ] [MAIN ] JKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:18.656897] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 0.4s. Estimated remaining: 15m 27s. Rate: 78.4 symbols/min [2025-09-28T02:17:19.183663] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:19.230889] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-28T02:17:19.315679] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-28T02:17:19.397265] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:19.400515] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:19.402083] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-28T02:17:19.401989] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:19.402914] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-28T02:17:19.403556] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-28T02:17:19.403815] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-28T02:17:19.509054] [DEBUG] [LOCAL ] JLS: Loaded 4142 existing records from primary storage. [2025-09-28T02:17:19.522907] [INFO ] [MAIN ] JLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:19.548785] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JLS took 0.9s. Estimated remaining: 15m 27s. Rate: 78.3 symbols/min [2025-09-28T02:17:19.607273] [DEBUG] [LOCAL ] JLL: Loaded 32458 existing records from primary storage. [2025-09-28T02:17:19.721758] [INFO ] [MAIN ] JLL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:19.775068] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JLL took 1.1s. Estimated remaining: 15m 25s. Rate: 78.4 symbols/min [2025-09-28T02:17:19.962184] [DEBUG] [LOCAL ] JMIA: Loaded 51279 existing records from primary storage. [2025-09-28T02:17:20.068923] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:20.074822] [INFO ] [MAIN ] JMIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:20.075134] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JMIA took 1.4s. Estimated remaining: 15m 24s. Rate: 78.4 symbols/min [2025-09-28T02:17:20.297362] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:20.365305] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:20.377163] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-28T02:17:20.484510] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:20.512092] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-09-28T02:17:20.527323] [INFO ] [MAIN ] JNJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:20.533263] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JNJ took 0.9s. Estimated remaining: 15m 23s. Rate: 78.5 symbols/min [2025-09-28T02:17:20.650466] [DEBUG] [LOCAL ] JOE: Loaded 24860 existing records from primary storage. [2025-09-28T02:17:20.680006] [DEBUG] [LOCAL ] JOBY: Loaded 54579 existing records from primary storage. [2025-09-28T02:17:20.680586] [INFO ] [MAIN ] JOE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:20.681435] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOE took 0.6s. Estimated remaining: 15m 22s. Rate: 78.5 symbols/min [2025-09-28T02:17:20.681240] [INFO ] [MAIN ] JOBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:20.745787] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOBY took 0.9s. Estimated remaining: 15m 20s. Rate: 78.6 symbols/min [2025-09-28T02:17:20.844380] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:20.858690] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-28T02:17:20.893705] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-28T02:17:21.049622] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:21.095287] [DEBUG] [LOCAL ] JOF: Loaded 7177 existing records from primary storage. [2025-09-28T02:17:21.095817] [INFO ] [MAIN ] JOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:21.096040] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOF took 0.6s. Estimated remaining: 15m 19s. Rate: 78.6 symbols/min [2025-09-28T02:17:21.262112] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:21.359595] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-28T02:17:21.409719] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-28T02:17:21.417346] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:21.444484] [DEBUG] [LOCAL ] JPC: Loaded 37620 existing records from primary storage. [2025-09-28T02:17:21.445487] [INFO ] [MAIN ] JPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:21.445748] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JPC took 0.8s. Estimated remaining: 15m 18s. Rate: 78.6 symbols/min [2025-09-28T02:17:21.682953] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-09-28T02:17:21.724221] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:21.725231] [INFO ] [MAIN ] JPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:21.727173] [DEBUG] [LOCAL ] JQC: Loaded 34194 existing records from primary storage. [2025-09-28T02:17:21.726115] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JPM took 0.9s. Estimated remaining: 15m 17s. Rate: 78.7 symbols/min [2025-09-28T02:17:21.728104] [INFO ] [MAIN ] JQC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:21.741127] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JQC took 0.6s. Estimated remaining: 15m 15s. Rate: 78.8 symbols/min [2025-09-28T02:17:21.952431] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-28T02:17:21.973795] [DEBUG] [LOCAL ] JRI: Loaded 15068 existing records from primary storage. [2025-09-28T02:17:22.016091] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-28T02:17:22.054742] [INFO ] [MAIN ] JRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:22.082639] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRI took 0.6s. Estimated remaining: 15m 14s. Rate: 78.8 symbols/min [2025-09-28T02:17:22.082484] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:22.247617] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:22.306151] [DEBUG] [LOCAL ] JRS: Loaded 11250 existing records from primary storage. [2025-09-28T02:17:22.343619] [INFO ] [MAIN ] JRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:22.380774] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:22.381365] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRS took 0.7s. Estimated remaining: 15m 13s. Rate: 78.8 symbols/min [2025-09-28T02:17:22.468813] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-28T02:17:22.504569] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-28T02:17:22.637949] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:22.654791] [DEBUG] [LOCAL ] JXN: Loaded 46558 existing records from primary storage. [2025-09-28T02:17:22.655956] [INFO ] [MAIN ] JXN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:22.656086] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JXN took 0.9s. Estimated remaining: 15m 11s. Rate: 78.9 symbols/min [2025-09-28T02:17:22.797615] [DEBUG] [LOCAL ] KAI: Loaded 13729 existing records from primary storage. [2025-09-28T02:17:22.798551] [DEBUG] [LOCAL ] K: Loaded 50637 existing records from primary storage. [2025-09-28T02:17:22.809906] [INFO ] [MAIN ] KAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:22.815408] [INFO ] [MAIN ] K: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:22.815541] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 0.4s. Estimated remaining: 15m 10s. Rate: 78.9 symbols/min [2025-09-28T02:17:22.930870] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:22.873541] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. K took 0.8s. Estimated remaining: 15m 8s. Rate: 79.0 symbols/min [2025-09-28T02:17:23.076867] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-28T02:17:23.094460] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-28T02:17:23.233778] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:23.306141] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:23.307328] [DEBUG] [LOCAL ] KBDC: No existing data file found in primary storage. [2025-09-28T02:17:23.307455] [WARN ] [MAIN ] KBDC: No existing data found, performing full refresh instead. [2025-09-28T02:17:23.318744] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-28T02:17:23.318967] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-28T02:17:23.319711] [DEBUG] [LOCAL ] KAR: Loaded 40411 existing records from primary storage. [2025-09-28T02:17:23.319068] [DEBUG] [LOCAL ] KBDC: No primary data file found to delete. [2025-09-28T02:17:23.320066] [INFO ] [MAIN ] KAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:23.320863] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KAR took 0.7s. Estimated remaining: 15m 7s. Rate: 79.0 symbols/min [2025-09-28T02:17:23.319947] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-28T02:17:23.584292] [DEBUG] [LOCAL ] KB: Loaded 24453 existing records from primary storage. [2025-09-28T02:17:23.631718] [INFO ] [MAIN ] KB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:23.677997] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 0.9s. Estimated remaining: 15m 6s. Rate: 79.1 symbols/min [2025-09-28T02:17:23.797942] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-28T02:17:23.798984] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:23.885708] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-28T02:17:24.107820] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:24.114686] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-28T02:17:24.148602] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:24.183933] [DEBUG] [LOCAL ] KBH: Loaded 49678 existing records from primary storage. [2025-09-28T02:17:24.184547] [INFO ] [MAIN ] KBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:24.185452] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBH took 0.9s. Estimated remaining: 15m 5s. Rate: 79.1 symbols/min [2025-09-28T02:17:24.392279] [DEBUG] [LOCAL ] KBR: Loaded 48899 existing records from primary storage. [2025-09-28T02:17:24.428671] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:24.424268] [INFO ] [MAIN ] KBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:24.429827] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBR took 0.6s. Estimated remaining: 15m 4s. Rate: 79.1 symbols/min [2025-09-28T02:17:24.628465] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-28T02:17:24.623587] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:24.630248] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-28T02:17:24.655340] [DEBUG] [LOCAL ] KEN: Loaded 4784 existing records from primary storage. [2025-09-28T02:17:24.655853] [INFO ] [MAIN ] KEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:24.655989] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KEN took 0.2s. Estimated remaining: 15m 3s. Rate: 79.2 symbols/min [2025-09-28T02:17:24.788594] [DEBUG] [LOCAL ] KD: Loaded 53068 existing records from primary storage. [2025-09-28T02:17:24.815692] [INFO ] [MAIN ] KD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:24.833913] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KD took 0.6s. Estimated remaining: 15m 1s. Rate: 79.2 symbols/min [2025-09-28T02:17:24.919373] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:25.080631] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:25.082332] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-28T02:17:25.089049] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-28T02:17:25.119723] [DEBUG] [LOCAL ] KEP: Loaded 31169 existing records from primary storage. [2025-09-28T02:17:25.120615] [INFO ] [MAIN ] KEP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:25.121231] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KEP took 0.5s. Estimated remaining: 15m 0s. Rate: 79.3 symbols/min [2025-09-28T02:17:25.259776] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-28T02:17:25.262251] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-28T02:17:25.360036] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:25.360353] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-28T02:17:25.360506] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-28T02:17:25.361838] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-28T02:17:25.361528] [DEBUG] [LOCAL ] KEX: Loaded 38712 existing records from primary storage. [2025-09-28T02:17:25.362050] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-28T02:17:25.362344] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-28T02:17:25.362585] [INFO ] [MAIN ] KEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:25.362701] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-28T02:17:25.396733] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEX took 0.6s. Estimated remaining: 14m 59s. Rate: 79.3 symbols/min [2025-09-28T02:17:25.862208] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-28T02:17:25.844285] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:25.882262] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-28T02:17:25.997282] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:25.998925] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-28T02:17:26.035815] [DEBUG] [LOCAL ] KEYS: Loaded 43955 existing records from primary storage. [2025-09-28T02:17:26.047386] [INFO ] [MAIN ] KEYS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:26.048195] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEYS took 0.6s. Estimated remaining: 14m 58s. Rate: 79.3 symbols/min [2025-09-28T02:17:26.048689] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-28T02:17:26.128179] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-28T02:17:26.242182] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:26.246864] [DEBUG] [LOCAL ] KF: Loaded 2486 existing records from primary storage. [2025-09-28T02:17:26.247116] [INFO ] [MAIN ] KF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:26.247222] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KF took 0.2s. Estimated remaining: 14m 57s. Rate: 79.4 symbols/min [2025-09-28T02:17:26.325893] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-28T02:17:26.363040] [INFO ] [REMOTE ] JMM: Full fetch complete (2292 records). [2025-09-28T02:17:26.385869] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-28T02:17:26.490799] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:26.673449] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-28T02:17:26.673762] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:17:26.673841] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:17:26.673919] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-28T02:17:26.674103] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-28T02:17:26.674183] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-28T02:17:26.674299] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-28T02:17:26.674407] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. JMM took 8.0s. Estimated remaining: 14m 56s. Rate: 79.4 symbols/min [2025-09-28T02:17:26.785717] [DEBUG] [LOCAL ] KFRC: Loaded 19766 existing records from primary storage. [2025-09-28T02:17:26.799216] [INFO ] [MAIN ] KFRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:26.799438] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KFRC took 0.6s. Estimated remaining: 14m 54s. Rate: 79.4 symbols/min [2025-09-28T02:17:26.978268] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:27.099247] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:27.110221] [DEBUG] [LOCAL ] KFS: Loaded 8471 existing records from primary storage. [2025-09-28T02:17:27.110704] [INFO ] [MAIN ] KFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:27.110815] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KFS took 0.4s. Estimated remaining: 14m 53s. Rate: 79.5 symbols/min [2025-09-28T02:17:27.195489] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-28T02:17:27.243423] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-28T02:17:27.343364] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:27.344616] [DEBUG] [LOCAL ] KFY: Loaded 31057 existing records from primary storage. [2025-09-28T02:17:27.345631] [INFO ] [MAIN ] KFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:27.345801] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFY took 0.5s. Estimated remaining: 14m 52s. Rate: 79.5 symbols/min [2025-09-28T02:17:27.562662] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:27.604451] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-09-28T02:17:27.604996] [INFO ] [MAIN ] KGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:27.605916] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KGC took 0.5s. Estimated remaining: 14m 50s. Rate: 79.6 symbols/min [2025-09-28T02:17:27.773130] [DEBUG] [LOCAL ] KGS: Loaded 46487 existing records from primary storage. [2025-09-28T02:17:27.826002] [INFO ] [MAIN ] KGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:27.825479] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:27.827195] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KGS took 0.5s. Estimated remaining: 14m 49s. Rate: 79.6 symbols/min [2025-09-28T02:17:28.019255] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:28.054493] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-28T02:17:28.066675] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-28T02:17:28.099340] [DEBUG] [LOCAL ] KIO: Loaded 21625 existing records from primary storage. [2025-09-28T02:17:28.100754] [INFO ] [MAIN ] KIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:28.100949] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KIO took 0.3s. Estimated remaining: 14m 48s. Rate: 79.7 symbols/min [2025-09-28T02:17:28.186677] [DEBUG] [LOCAL ] KIM: Loaded 53831 existing records from primary storage. [2025-09-28T02:17:28.230325] [INFO ] [MAIN ] KIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:28.237135] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIM took 0.6s. Estimated remaining: 14m 47s. Rate: 79.7 symbols/min [2025-09-28T02:17:28.344531] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:28.499524] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-28T02:17:28.545879] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:28.546493] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-28T02:17:28.575588] [DEBUG] [LOCAL ] KKRS: Loaded 5801 existing records from primary storage. [2025-09-28T02:17:28.575983] [INFO ] [MAIN ] KKRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:28.576102] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KKRS took 0.3s. Estimated remaining: 14m 45s. Rate: 79.8 symbols/min [2025-09-28T02:17:28.707039] [DEBUG] [LOCAL ] KKR: Loaded 54281 existing records from primary storage. [2025-09-28T02:17:28.723531] [INFO ] [MAIN ] KKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:28.733906] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKR took 0.6s. Estimated remaining: 14m 44s. Rate: 79.8 symbols/min [2025-09-28T02:17:28.867087] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:28.893884] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-28T02:17:28.897153] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-28T02:17:28.909351] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-28T02:17:28.919784] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-28T02:17:28.930214] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-28T02:17:28.943130] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-28T02:17:29.027272] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:29.071985] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-28T02:17:29.072089] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-28T02:17:29.078311] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-28T02:17:29.083538] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-28T02:17:29.094603] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-28T02:17:29.111467] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-28T02:17:29.822234] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:29.860723] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-28T02:17:29.876209] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:29.878851] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-28T02:17:29.880024] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-28T02:17:29.888828] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-28T02:17:29.938467] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-28T02:17:29.949937] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-28T02:17:30.096584] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:17:30.097019] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-28T02:17:30.097129] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:17:30.097226] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-09-28T02:17:30.097315] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:17:30.097411] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-28T02:17:30.097536] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-28T02:17:30.097632] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-28T02:17:30.097779] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-28T02:17:30.097898] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KKRT took 1.5s. Estimated remaining: 14m 44s. Rate: 79.8 symbols/min [2025-09-28T02:17:30.333912] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:30.331547] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:17:30.334370] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-28T02:17:30.334810] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:17:30.334898] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-09-28T02:17:30.334996] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:17:30.335103] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-28T02:17:30.335230] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-28T02:17:30.335410] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-28T02:17:30.335594] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-28T02:17:30.335818] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KLAR took 1.6s. Estimated remaining: 14m 43s. Rate: 79.8 symbols/min [2025-09-28T02:17:30.379701] [DEBUG] [LOCAL ] KLC: Loaded 37107 existing records from primary storage. [2025-09-28T02:17:30.380153] [INFO ] [MAIN ] KLC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:30.381396] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KLC took 0.3s. Estimated remaining: 14m 41s. Rate: 79.9 symbols/min [2025-09-28T02:17:31.040120] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-28T02:17:31.045201] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-28T02:17:31.374389] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-28T02:17:31.386131] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-28T02:17:31.624682] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-28T02:17:31.629026] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-28T02:17:32.689021] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-28T02:17:32.694090] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-28T02:17:33.336563] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-28T02:17:33.348690] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-28T02:17:33.361638] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-28T02:17:33.367395] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-28T02:17:34.647223] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-28T02:17:34.653720] [INFO ] [REMOTE ] KBDC: Full fetch complete (28345 records). [2025-09-28T02:17:34.653880] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-28T02:17:35.122291] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-28T02:17:35.122407] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-28T02:17:35.122881] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-28T02:17:35.122965] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-28T02:17:35.123829] [DEBUG] [LOCAL ] KBDC: Trimmed 28345 records to 21252 (keeping 200 days of data) [2025-09-28T02:17:35.254154] [DEBUG] [LOCAL ] KBDC: Primary data saved (21252 records). [2025-09-28T02:17:35.254314] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-28T02:17:35.254434] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KBDC took 12.3s. Estimated remaining: 14m 45s. Rate: 79.5 symbols/min [2025-09-28T02:17:35.524905] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-28T02:17:35.536610] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-28T02:17:37.432542] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-28T02:17:37.444418] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-28T02:17:39.087259] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-28T02:17:39.099005] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-28T02:17:40.890659] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-28T02:17:40.903272] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-28T02:17:42.723619] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-28T02:17:42.735624] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-28T02:17:44.452468] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-28T02:17:44.469744] [INFO ] [REMOTE ] KEY: Full fetch complete (77256 records). [2025-09-28T02:17:44.470089] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-28T02:17:44.696019] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:17:44.696817] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:17:44.696918] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:17:44.697009] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-28T02:17:44.697152] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-28T02:17:44.697229] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-28T02:17:44.697323] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-28T02:17:44.697431] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KEY took 19.6s. Estimated remaining: 14m 52s. Rate: 78.7 symbols/min [2025-09-28T02:17:45.241678] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:45.416076] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:45.470677] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:45.474872] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:45.486009] [DEBUG] [LOCAL ] KMPB: Loaded 3646 existing records from primary storage. [2025-09-28T02:17:45.486389] [INFO ] [MAIN ] KMPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:45.486907] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 0.8s. Estimated remaining: 14m 52s. Rate: 78.7 symbols/min [2025-09-28T02:17:45.644329] [DEBUG] [LOCAL ] KMPR: Loaded 39117 existing records from primary storage. [2025-09-28T02:17:45.699350] [INFO ] [MAIN ] KMPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:45.743282] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:45.743502] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMPR took 1.0s. Estimated remaining: 14m 50s. Rate: 78.8 symbols/min [2025-09-28T02:17:45.756843] [DEBUG] [LOCAL ] KMT: Loaded 43687 existing records from primary storage. [2025-09-28T02:17:45.762902] [INFO ] [MAIN ] KMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:45.763083] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 1.1s. Estimated remaining: 14m 49s. Rate: 78.9 symbols/min [2025-09-28T02:17:45.967608] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-09-28T02:17:46.059759] [INFO ] [MAIN ] KMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:46.103068] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMI took 1.4s. Estimated remaining: 14m 48s. Rate: 78.9 symbols/min [2025-09-28T02:17:46.129776] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:46.212213] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:46.306765] [DEBUG] [LOCAL ] KMX: Loaded 53897 existing records from primary storage. [2025-09-28T02:17:46.337612] [INFO ] [MAIN ] KMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:46.418195] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 0.9s. Estimated remaining: 14m 46s. Rate: 78.9 symbols/min [2025-09-28T02:17:46.422896] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:46.589144] [DEBUG] [LOCAL ] KN: Loaded 39393 existing records from primary storage. [2025-09-28T02:17:46.582072] [DEBUG] [LOCAL ] KNF: Loaded 36435 existing records from primary storage. [2025-09-28T02:17:46.615546] [INFO ] [MAIN ] KN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:46.616118] [DEBUG] [LOCAL ] KNOP: Loaded 10274 existing records from primary storage. [2025-09-28T02:17:46.637314] [INFO ] [MAIN ] KNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:46.636845] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KN took 0.9s. Estimated remaining: 14m 45s. Rate: 79.0 symbols/min [2025-09-28T02:17:46.650489] [INFO ] [MAIN ] KNOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:46.685470] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNOP took 0.5s. Estimated remaining: 14m 44s. Rate: 79.0 symbols/min [2025-09-28T02:17:46.697510] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:46.718234] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNF took 0.9s. Estimated remaining: 14m 42s. Rate: 79.1 symbols/min [2025-09-28T02:17:47.095219] [DEBUG] [LOCAL ] KNSL: Loaded 18372 existing records from primary storage. [2025-09-28T02:17:47.237063] [INFO ] [MAIN ] KNSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:47.297227] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:47.308821] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:47.297587] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNSL took 0.9s. Estimated remaining: 14m 41s. Rate: 79.1 symbols/min [2025-09-28T02:17:47.371086] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:47.404560] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-28T02:17:47.416382] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-28T02:17:47.416804] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-28T02:17:47.416919] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-28T02:17:47.416988] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-28T02:17:47.432521] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-28T02:17:47.737047] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:47.794468] [DEBUG] [LOCAL ] KNTK: Loaded 46794 existing records from primary storage. [2025-09-28T02:17:47.842555] [INFO ] [MAIN ] KNTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:47.886743] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNTK took 1.2s. Estimated remaining: 14m 40s. Rate: 79.1 symbols/min [2025-09-28T02:17:47.991430] [DEBUG] [LOCAL ] KNX: Loaded 53363 existing records from primary storage. [2025-09-28T02:17:48.036191] [INFO ] [MAIN ] KNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:48.086973] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 1.4s. Estimated remaining: 14m 39s. Rate: 79.2 symbols/min [2025-09-28T02:17:48.330724] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:48.337260] [DEBUG] [LOCAL ] KODK: Loaded 44025 existing records from primary storage. [2025-09-28T02:17:48.363375] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-28T02:17:48.369704] [INFO ] [MAIN ] KODK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:48.410931] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 1.0s. Estimated remaining: 14m 38s. Rate: 79.2 symbols/min [2025-09-28T02:17:48.464848] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:48.589617] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:48.755442] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:48.763093] [DEBUG] [LOCAL ] KOP: Loaded 18066 existing records from primary storage. [2025-09-28T02:17:48.763807] [INFO ] [MAIN ] KOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:48.764024] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KOP took 0.6s. Estimated remaining: 14m 37s. Rate: 79.2 symbols/min [2025-09-28T02:17:48.853707] [DEBUG] [LOCAL ] KOF: Loaded 26219 existing records from primary storage. [2025-09-28T02:17:48.814578] [DEBUG] [LOCAL ] KORE: Loaded 2010 existing records from primary storage. [2025-09-28T02:17:48.892380] [INFO ] [MAIN ] KOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:48.887817] [INFO ] [MAIN ] KORE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:48.892562] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOF took 0.9s. Estimated remaining: 14m 35s. Rate: 79.3 symbols/min [2025-09-28T02:17:48.898385] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KORE took 0.4s. Estimated remaining: 14m 34s. Rate: 79.4 symbols/min [2025-09-28T02:17:49.161384] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:49.322718] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:49.379355] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:49.438068] [DEBUG] [LOCAL ] KOS: Loaded 53828 existing records from primary storage. [2025-09-28T02:17:49.438687] [INFO ] [MAIN ] KOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:49.438796] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KOS took 0.7s. Estimated remaining: 14m 33s. Rate: 79.4 symbols/min [2025-09-28T02:17:49.582886] [DEBUG] [LOCAL ] KRC: Loaded 49114 existing records from primary storage. [2025-09-28T02:17:49.630330] [INFO ] [MAIN ] KRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:49.682139] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-09-28T02:17:49.682850] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KRC took 0.8s. Estimated remaining: 14m 32s. Rate: 79.4 symbols/min [2025-09-28T02:17:49.688909] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:49.695165] [INFO ] [MAIN ] KR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:49.723756] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KR took 0.8s. Estimated remaining: 14m 30s. Rate: 79.5 symbols/min [2025-09-28T02:17:50.027913] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:50.096617] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:50.109276] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-28T02:17:50.110182] [DEBUG] [LOCAL ] KREF: Loaded 37767 existing records from primary storage. [2025-09-28T02:17:50.109439] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-28T02:17:50.110888] [INFO ] [MAIN ] KREF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:50.111133] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KREF took 0.7s. Estimated remaining: 14m 29s. Rate: 79.5 symbols/min [2025-09-28T02:17:50.110558] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-28T02:17:50.111258] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-28T02:17:50.144850] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-28T02:17:50.192030] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-28T02:17:50.441113] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:50.590872] [DEBUG] [LOCAL ] KRG: Loaded 49859 existing records from primary storage. [2025-09-28T02:17:50.640466] [INFO ] [MAIN ] KRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:50.657278] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRG took 1.0s. Estimated remaining: 14m 28s. Rate: 79.5 symbols/min [2025-09-28T02:17:50.826750] [DEBUG] [LOCAL ] KRO: Loaded 26448 existing records from primary storage. [2025-09-28T02:17:50.893091] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:50.893822] [INFO ] [MAIN ] KRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:50.895072] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRO took 0.8s. Estimated remaining: 14m 27s. Rate: 79.6 symbols/min [2025-09-28T02:17:50.894588] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-28T02:17:51.082991] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:51.183968] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:51.206087] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:17:51.220981] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-28T02:17:51.222908] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-09-28T02:17:51.221556] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:17:51.246222] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-28T02:17:51.245248] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-09-28T02:17:51.247978] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:17:51.248104] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-28T02:17:51.248192] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-28T02:17:51.248238] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-28T02:17:51.248305] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-28T02:17:51.248590] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRMN took 1.5s. Estimated remaining: 14m 26s. Rate: 79.6 symbols/min [2025-09-28T02:17:51.359116] [DEBUG] [LOCAL ] KRP: Loaded 37947 existing records from primary storage. [2025-09-28T02:17:51.383590] [INFO ] [MAIN ] KRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:51.441322] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 0.8s. Estimated remaining: 14m 25s. Rate: 79.7 symbols/min [2025-09-28T02:17:51.500420] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:51.595137] [DEBUG] [LOCAL ] KSS: Loaded 54385 existing records from primary storage. [2025-09-28T02:17:51.610061] [INFO ] [MAIN ] KSS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:51.627794] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KSS took 0.7s. Estimated remaining: 14m 23s. Rate: 79.7 symbols/min [2025-09-28T02:17:51.824218] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:51.913713] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:51.930822] [DEBUG] [LOCAL ] KT: Loaded 46336 existing records from primary storage. [2025-09-28T02:17:51.931380] [INFO ] [MAIN ] KT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:51.931587] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KT took 0.7s. Estimated remaining: 14m 22s. Rate: 79.8 symbols/min [2025-09-28T02:17:52.016794] [DEBUG] [LOCAL ] KTF: Loaded 13065 existing records from primary storage. [2025-09-28T02:17:52.042138] [INFO ] [MAIN ] KTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:52.072097] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KTF took 0.4s. Estimated remaining: 14m 21s. Rate: 79.8 symbols/min [2025-09-28T02:17:52.187975] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:52.219545] [DEBUG] [LOCAL ] KTB: Loaded 41738 existing records from primary storage. [2025-09-28T02:17:52.237533] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-28T02:17:52.255356] [INFO ] [MAIN ] KTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:52.269686] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KTB took 0.8s. Estimated remaining: 14m 20s. Rate: 79.9 symbols/min [2025-09-28T02:17:52.255527] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-28T02:17:52.306038] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-28T02:17:52.311467] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-28T02:17:52.351219] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-28T02:17:52.356493] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-28T02:17:52.482420] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:52.674154] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:52.993767] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:53.010550] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-28T02:17:53.013441] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-09-28T02:17:53.014566] [INFO ] [MAIN ] KVUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:53.028699] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KVUE took 0.9s. Estimated remaining: 14m 19s. Rate: 79.9 symbols/min [2025-09-28T02:17:53.051454] [DEBUG] [LOCAL ] KVYO: Loaded 50696 existing records from primary storage. [2025-09-28T02:17:53.104697] [INFO ] [MAIN ] KVYO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:53.123188] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KVYO took 0.8s. Estimated remaining: 14m 17s. Rate: 79.9 symbols/min [2025-09-28T02:17:53.336949] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:53.414137] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:53.448852] [DEBUG] [LOCAL ] KWR: Loaded 16931 existing records from primary storage. [2025-09-28T02:17:53.460957] [INFO ] [MAIN ] KWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:53.461079] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KWR took 0.3s. Estimated remaining: 14m 16s. Rate: 79.9 symbols/min [2025-09-28T02:17:53.508634] [DEBUG] [LOCAL ] KW: Loaded 41236 existing records from primary storage. [2025-09-28T02:17:53.534722] [INFO ] [MAIN ] KW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:53.545608] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KW took 0.5s. Estimated remaining: 14m 15s. Rate: 80.0 symbols/min [2025-09-28T02:17:53.737852] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:53.782314] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-28T02:17:53.816595] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-28T02:17:53.871989] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:53.916063] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-28T02:17:53.930915] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-28T02:17:53.943007] [DEBUG] [LOCAL ] KYN: Loaded 30432 existing records from primary storage. [2025-09-28T02:17:53.943618] [INFO ] [MAIN ] KYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:53.943995] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KYN took 0.5s. Estimated remaining: 14m 14s. Rate: 80.0 symbols/min [2025-09-28T02:17:54.126983] [DEBUG] [LOCAL ] L: Loaded 41562 existing records from primary storage. [2025-09-28T02:17:54.156834] [INFO ] [MAIN ] L: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:54.163222] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. L took 0.6s. Estimated remaining: 14m 13s. Rate: 80.1 symbols/min [2025-09-28T02:17:54.181308] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:54.366494] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:54.417968] [DEBUG] [LOCAL ] LAD: Loaded 24089 existing records from primary storage. [2025-09-28T02:17:54.418450] [INFO ] [MAIN ] LAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:54.419606] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. LAD took 0.2s. Estimated remaining: 14m 11s. Rate: 80.1 symbols/min [2025-09-28T02:17:54.419375] [DEBUG] [LOCAL ] LAC: Loaded 53091 existing records from primary storage. [2025-09-28T02:17:54.478681] [INFO ] [MAIN ] LAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:54.500834] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. LAC took 0.6s. Estimated remaining: 14m 10s. Rate: 80.2 symbols/min [2025-09-28T02:17:54.722539] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:54.808461] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:54.820089] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-28T02:17:54.827804] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-28T02:17:54.831497] [DEBUG] [LOCAL ] LANV: Loaded 2851 existing records from primary storage. [2025-09-28T02:17:54.831876] [INFO ] [MAIN ] LANV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:54.831990] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LANV took 0.3s. Estimated remaining: 14m 9s. Rate: 80.2 symbols/min [2025-09-28T02:17:54.974978] [DEBUG] [LOCAL ] LADR: Loaded 39204 existing records from primary storage. [2025-09-28T02:17:54.996603] [INFO ] [MAIN ] LADR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:17:55.016583] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LADR took 0.6s. Estimated remaining: 14m 8s. Rate: 80.3 symbols/min [2025-09-28T02:17:55.050988] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:17:55.051211] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-28T02:17:55.051288] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-28T02:17:55.051426] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-28T02:17:55.051499] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-28T02:17:55.051581] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-28T02:17:55.051674] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-28T02:17:55.430948] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:17:55.431452] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-28T02:17:55.664599] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:17:55.665583] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-28T02:17:55.666006] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-28T02:17:55.667884] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:17:55.668684] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-28T02:17:55.668786] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-09-28T02:17:55.670006] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:17:55.670094] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-28T02:17:55.670199] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-28T02:17:55.670256] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-28T02:17:55.670353] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-28T02:17:55.670448] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAR took 0.8s. Estimated remaining: 14m 7s. Rate: 80.3 symbols/min [2025-09-28T02:17:56.106526] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-28T02:17:56.117336] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-28T02:17:56.656266] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-28T02:17:56.659549] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-28T02:17:57.223926] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-28T02:17:57.225481] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-28T02:17:57.592529] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-28T02:17:57.593905] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-28T02:17:58.035562] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-28T02:17:58.036885] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-28T02:17:58.484050] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-28T02:17:58.485388] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-28T02:17:58.626860] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-28T02:17:58.638864] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-28T02:17:59.039175] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-28T02:17:59.041015] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-28T02:17:59.793931] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-28T02:17:59.795906] [INFO ] [REMOTE ] KUKE: Full fetch complete (8120 records). [2025-09-28T02:17:59.796016] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-28T02:17:59.991749] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:17:59.992074] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:17:59.992166] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:17:59.992263] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-28T02:17:59.992382] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-28T02:17:59.992476] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-28T02:17:59.992597] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-28T02:17:59.992754] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. KUKE took 8.1s. Estimated remaining: 14m 9s. Rate: 80.0 symbols/min [2025-09-28T02:18:01.463592] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-28T02:18:01.478733] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-28T02:18:04.299895] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-28T02:18:04.311512] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-28T02:18:06.870620] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-28T02:18:06.882494] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-28T02:18:09.742276] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-28T02:18:09.755337] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-28T02:18:12.436754] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-28T02:18:12.449018] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-28T02:18:14.899955] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-28T02:18:14.909774] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-09-28T02:18:14.910022] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-28T02:18:15.124372] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:18:15.125183] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:18:15.125281] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:18:15.125389] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-28T02:18:15.125507] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-28T02:18:15.125586] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-28T02:18:15.125713] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-28T02:18:15.125880] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. KO took 28.3s. Estimated remaining: 14m 22s. Rate: 78.7 symbols/min [2025-09-28T02:18:15.810586] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:15.851633] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:15.926769] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:15.941017] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:15.973791] [DEBUG] [LOCAL ] LAW: Loaded 14171 existing records from primary storage. [2025-09-28T02:18:15.974396] [INFO ] [MAIN ] LAW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:15.974578] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 0.8s. Estimated remaining: 14m 21s. Rate: 78.7 symbols/min [2025-09-28T02:18:16.138799] [DEBUG] [LOCAL ] LB: Loaded 38116 existing records from primary storage. [2025-09-28T02:18:16.207730] [INFO ] [MAIN ] LB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:16.223726] [DEBUG] [LOCAL ] LAZ: Loaded 45784 existing records from primary storage. [2025-09-28T02:18:16.225140] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LB took 1.1s. Estimated remaining: 14m 20s. Rate: 78.8 symbols/min [2025-09-28T02:18:16.247282] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:16.259728] [INFO ] [MAIN ] LAZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:16.280399] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LAZ took 1.2s. Estimated remaining: 14m 18s. Rate: 78.8 symbols/min [2025-09-28T02:18:16.338681] [DEBUG] [LOCAL ] LBRT: Loaded 53695 existing records from primary storage. [2025-09-28T02:18:16.376176] [INFO ] [MAIN ] LBRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:16.382730] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LBRT took 1.3s. Estimated remaining: 14m 17s. Rate: 78.9 symbols/min [2025-09-28T02:18:16.765617] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:16.933543] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:16.938786] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:16.941419] [DEBUG] [LOCAL ] LC: Loaded 48605 existing records from primary storage. [2025-09-28T02:18:16.943009] [INFO ] [MAIN ] LC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:16.943157] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 1.0s. Estimated remaining: 14m 16s. Rate: 78.9 symbols/min [2025-09-28T02:18:17.182356] [DEBUG] [LOCAL ] LCII: Loaded 28900 existing records from primary storage. [2025-09-28T02:18:17.197972] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:17.198862] [INFO ] [MAIN ] LCII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:17.199901] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LCII took 1.0s. Estimated remaining: 14m 15s. Rate: 79.0 symbols/min [2025-09-28T02:18:17.275432] [DEBUG] [LOCAL ] LDI: Loaded 44776 existing records from primary storage. [2025-09-28T02:18:17.317462] [INFO ] [MAIN ] LDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:17.345525] [DEBUG] [LOCAL ] LDOS: Loaded 46407 existing records from primary storage. [2025-09-28T02:18:17.345799] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDI took 1.0s. Estimated remaining: 14m 14s. Rate: 79.0 symbols/min [2025-09-28T02:18:17.403102] [DEBUG] [LOCAL ] LDP: Loaded 13128 existing records from primary storage. [2025-09-28T02:18:17.413720] [INFO ] [MAIN ] LDOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:17.519041] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 1.1s. Estimated remaining: 14m 12s. Rate: 79.1 symbols/min [2025-09-28T02:18:17.553406] [INFO ] [MAIN ] LDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:17.557607] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:17.590045] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDP took 0.6s. Estimated remaining: 14m 11s. Rate: 79.1 symbols/min [2025-09-28T02:18:17.879719] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:18.035313] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:18.072438] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:18.087850] [DEBUG] [LOCAL ] LEA: Loaded 42464 existing records from primary storage. [2025-09-28T02:18:18.089466] [INFO ] [MAIN ] LEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:18.090076] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 0.9s. Estimated remaining: 14m 10s. Rate: 79.1 symbols/min [2025-09-28T02:18:18.261323] [DEBUG] [LOCAL ] LEG: Loaded 51130 existing records from primary storage. [2025-09-28T02:18:18.277399] [DEBUG] [LOCAL ] LEO: Loaded 17785 existing records from primary storage. [2025-09-28T02:18:18.304184] [INFO ] [MAIN ] LEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:18.304537] [INFO ] [MAIN ] LEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:18.319875] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEG took 1.0s. Estimated remaining: 14m 9s. Rate: 79.2 symbols/min [2025-09-28T02:18:18.327513] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEO took 0.7s. Estimated remaining: 14m 7s. Rate: 79.2 symbols/min [2025-09-28T02:18:18.383061] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:18.606810] [DEBUG] [LOCAL ] LEN: Loaded 53967 existing records from primary storage. [2025-09-28T02:18:18.652716] [INFO ] [MAIN ] LEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:18.714956] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEN took 1.2s. Estimated remaining: 14m 6s. Rate: 79.3 symbols/min [2025-09-28T02:18:18.724310] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:18.805490] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:18.998164] [DEBUG] [LOCAL ] LFT: Loaded 18286 existing records from primary storage. [2025-09-28T02:18:19.000003] [DEBUG] [LOCAL ] LEVI: Loaded 52306 existing records from primary storage. [2025-09-28T02:18:19.030531] [INFO ] [MAIN ] LFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:19.029991] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:19.035015] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LFT took 0.7s. Estimated remaining: 14m 5s. Rate: 79.3 symbols/min [2025-09-28T02:18:19.034831] [INFO ] [MAIN ] LEVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:19.036140] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LEVI took 0.9s. Estimated remaining: 14m 4s. Rate: 79.4 symbols/min [2025-09-28T02:18:19.036821] [DEBUG] [LOCAL ] LGI: Loaded 10137 existing records from primary storage. [2025-09-28T02:18:19.037244] [INFO ] [MAIN ] LGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:19.066582] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LGI took 0.7s. Estimated remaining: 14m 2s. Rate: 79.4 symbols/min [2025-09-28T02:18:19.482860] [DEBUG] [LOCAL ] LH: Loaded 38660 existing records from primary storage. [2025-09-28T02:18:19.601133] [INFO ] [MAIN ] LH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:19.629020] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 0.9s. Estimated remaining: 14m 1s. Rate: 79.5 symbols/min [2025-09-28T02:18:19.804464] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:19.756424] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:19.843209] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:19.989069] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:20.005703] [DEBUG] [LOCAL ] LITB: Loaded 4436 existing records from primary storage. [2025-09-28T02:18:20.015936] [INFO ] [MAIN ] LITB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:20.016334] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LITB took 0.4s. Estimated remaining: 14m 0s. Rate: 79.5 symbols/min [2025-09-28T02:18:20.089011] [DEBUG] [LOCAL ] LII: Loaded 28648 existing records from primary storage. [2025-09-28T02:18:20.089549] [INFO ] [MAIN ] LII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:20.089684] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LII took 1.0s. Estimated remaining: 13m 59s. Rate: 79.5 symbols/min [2025-09-28T02:18:20.245040] [DEBUG] [LOCAL ] LION: Loaded 43950 existing records from primary storage. [2025-09-28T02:18:20.292678] [INFO ] [MAIN ] LION: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:20.298165] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LION took 1.2s. Estimated remaining: 13m 58s. Rate: 79.6 symbols/min [2025-09-28T02:18:20.431274] [DEBUG] [LOCAL ] LHX: Loaded 49413 existing records from primary storage. [2025-09-28T02:18:20.430028] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:20.467562] [INFO ] [MAIN ] LHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:20.473760] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LHX took 1.4s. Estimated remaining: 13m 56s. Rate: 79.6 symbols/min [2025-09-28T02:18:20.593291] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:20.729624] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:20.756747] [DEBUG] [LOCAL ] LMT: No existing data file found in primary storage. [2025-09-28T02:18:20.774732] [WARN ] [MAIN ] LMT: No existing data found, performing full refresh instead. [2025-09-28T02:18:20.774929] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-28T02:18:20.796713] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-28T02:18:20.855267] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:20.855564] [DEBUG] [LOCAL ] LMT: No primary data file found to delete. [2025-09-28T02:18:20.855852] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-28T02:18:21.035881] [DEBUG] [LOCAL ] LLY: Loaded 54064 existing records from primary storage. [2025-09-28T02:18:21.065719] [INFO ] [MAIN ] LLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:21.114146] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LLY took 1.1s. Estimated remaining: 13m 55s. Rate: 79.6 symbols/min [2025-09-28T02:18:21.247101] [DEBUG] [LOCAL ] LMND: Loaded 52647 existing records from primary storage. [2025-09-28T02:18:21.310378] [INFO ] [MAIN ] LMND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:21.354734] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LMND took 1.2s. Estimated remaining: 13m 54s. Rate: 79.7 symbols/min [2025-09-28T02:18:21.408194] [DEBUG] [LOCAL ] LNC: Loaded 52369 existing records from primary storage. [2025-09-28T02:18:21.484971] [INFO ] [MAIN ] LNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:21.474287] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:18:21.501216] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LNC took 1.0s. Estimated remaining: 13m 53s. Rate: 79.7 symbols/min [2025-09-28T02:18:21.495960] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-28T02:18:21.674228] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:21.842045] [DEBUG] [LOCAL ] LND: Loaded 5013 existing records from primary storage. [2025-09-28T02:18:21.921813] [INFO ] [MAIN ] LND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:21.925912] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LND took 0.8s. Estimated remaining: 13m 52s. Rate: 79.8 symbols/min [2025-09-28T02:18:21.919007] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:21.958458] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:22.107992] [DEBUG] [LOCAL ] LNN: Loaded 11404 existing records from primary storage. [2025-09-28T02:18:22.142759] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:22.143005] [INFO ] [MAIN ] LNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:22.143605] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LNN took 0.6s. Estimated remaining: 13m 51s. Rate: 79.8 symbols/min [2025-09-28T02:18:22.376026] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:22.394568] [DEBUG] [LOCAL ] LNG: Loaded 52224 existing records from primary storage. [2025-09-28T02:18:22.408724] [DEBUG] [LOCAL ] LOAR: Loaded 42150 existing records from primary storage. [2025-09-28T02:18:22.407692] [INFO ] [MAIN ] LNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:22.409093] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNG took 0.9s. Estimated remaining: 13m 50s. Rate: 79.8 symbols/min [2025-09-28T02:18:22.409290] [INFO ] [MAIN ] LOAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:22.448031] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOAR took 0.5s. Estimated remaining: 13m 48s. Rate: 79.9 symbols/min [2025-09-28T02:18:22.635033] [DEBUG] [LOCAL ] LOB: Loaded 27886 existing records from primary storage. [2025-09-28T02:18:22.685054] [INFO ] [MAIN ] LOB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:22.736281] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LOB took 0.6s. Estimated remaining: 13m 47s. Rate: 79.9 symbols/min [2025-09-28T02:18:22.805700] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:22.802153] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:22.896908] [DEBUG] [LOCAL ] LOCL: Loaded 3644 existing records from primary storage. [2025-09-28T02:18:22.929332] [INFO ] [MAIN ] LOCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:22.940383] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOCL took 0.5s. Estimated remaining: 13m 46s. Rate: 80.0 symbols/min [2025-09-28T02:18:23.022969] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:23.147473] [DEBUG] [LOCAL ] LOMA: Loaded 32576 existing records from primary storage. [2025-09-28T02:18:23.164047] [INFO ] [MAIN ] LOMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:23.175992] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOMA took 0.7s. Estimated remaining: 13m 45s. Rate: 80.0 symbols/min [2025-09-28T02:18:23.243962] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:23.442742] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:23.460826] [DEBUG] [LOCAL ] LOW: Loaded 53721 existing records from primary storage. [2025-09-28T02:18:23.461580] [INFO ] [MAIN ] LOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:23.462078] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LOW took 0.7s. Estimated remaining: 13m 43s. Rate: 80.1 symbols/min [2025-09-28T02:18:23.660767] [DEBUG] [LOCAL ] LPG: Loaded 40536 existing records from primary storage. [2025-09-28T02:18:23.673198] [INFO ] [MAIN ] LPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:23.691370] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LPG took 0.7s. Estimated remaining: 13m 42s. Rate: 80.1 symbols/min [2025-09-28T02:18:23.670342] [DEBUG] [LOCAL ] LPL: Loaded 26305 existing records from primary storage. [2025-09-28T02:18:23.691867] [INFO ] [MAIN ] LPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:23.695468] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:23.694230] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LPL took 0.5s. Estimated remaining: 13m 41s. Rate: 80.2 symbols/min [2025-09-28T02:18:24.126366] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:24.102953] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:24.130081] [DEBUG] [LOCAL ] LPX: Loaded 40311 existing records from primary storage. [2025-09-28T02:18:24.143423] [INFO ] [MAIN ] LPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:24.162257] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPX took 0.7s. Estimated remaining: 13m 40s. Rate: 80.2 symbols/min [2025-09-28T02:18:24.164749] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-28T02:18:24.204778] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-28T02:18:24.396388] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:24.431530] [DEBUG] [LOCAL ] LRN: Loaded 40503 existing records from primary storage. [2025-09-28T02:18:24.433760] [DEBUG] [LOCAL ] LSPD: Loaded 43782 existing records from primary storage. [2025-09-28T02:18:24.434318] [INFO ] [MAIN ] LRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:24.434694] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LRN took 0.7s. Estimated remaining: 13m 39s. Rate: 80.2 symbols/min [2025-09-28T02:18:24.434833] [INFO ] [MAIN ] LSPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:24.446599] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LSPD took 0.7s. Estimated remaining: 13m 37s. Rate: 80.3 symbols/min [2025-09-28T02:18:24.637266] [DEBUG] [LOCAL ] LTC: Loaded 30478 existing records from primary storage. [2025-09-28T02:18:24.641198] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:24.641760] [INFO ] [MAIN ] LTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:24.641992] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LTC took 0.5s. Estimated remaining: 13m 36s. Rate: 80.4 symbols/min [2025-09-28T02:18:24.693340] [DEBUG] [LOCAL ] LTH: Loaded 52563 existing records from primary storage. [2025-09-28T02:18:24.693773] [INFO ] [MAIN ] LTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:24.693878] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LTH took 0.3s. Estimated remaining: 13m 35s. Rate: 80.4 symbols/min [2025-09-28T02:18:26.375229] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-28T02:18:26.385870] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-28T02:18:28.486086] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-28T02:18:28.496625] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-28T02:18:30.708661] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-28T02:18:30.719996] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-28T02:18:32.608775] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-28T02:18:32.620374] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-28T02:18:34.696054] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-28T02:18:34.706591] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-28T02:18:37.100511] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-28T02:18:37.111179] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-28T02:18:39.374275] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-28T02:18:39.386902] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-28T02:18:41.352691] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-28T02:18:41.363963] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-28T02:18:43.319287] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-28T02:18:43.329969] [INFO ] [REMOTE ] LMT: Full fetch complete (72513 records). [2025-09-28T02:18:43.330142] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-28T02:18:43.757365] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-28T02:18:43.757512] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-28T02:18:43.758367] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-28T02:18:43.758468] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-28T02:18:43.760218] [DEBUG] [LOCAL ] LMT: Trimmed 72513 records to 50608 (keeping 200 days of data) [2025-09-28T02:18:44.097063] [DEBUG] [LOCAL ] LMT: Primary data saved (50608 records). [2025-09-28T02:18:44.097307] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-28T02:18:44.097445] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LMT took 23.8s. Estimated remaining: 13m 50s. Rate: 78.9 symbols/min [2025-09-28T02:18:44.785741] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:44.833988] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:44.958939] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:44.961921] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-28T02:18:44.978420] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-28T02:18:44.981626] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-28T02:18:44.982770] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:44.983166] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-28T02:18:44.983815] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-28T02:18:44.984094] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-28T02:18:45.301813] [DEBUG] [LOCAL ] LTM: Loaded 37076 existing records from primary storage. [2025-09-28T02:18:45.302695] [DEBUG] [LOCAL ] LU: Loaded 49679 existing records from primary storage. [2025-09-28T02:18:45.359319] [INFO ] [MAIN ] LTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:45.371347] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LTM took 1.3s. Estimated remaining: 13m 50s. Rate: 78.8 symbols/min [2025-09-28T02:18:45.371125] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-09-28T02:18:45.376929] [INFO ] [MAIN ] LU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:45.431052] [INFO ] [MAIN ] LUMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:45.430766] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LU took 1.3s. Estimated remaining: 13m 48s. Rate: 78.9 symbols/min [2025-09-28T02:18:45.521496] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LUMN took 1.4s. Estimated remaining: 13m 47s. Rate: 78.9 symbols/min [2025-09-28T02:18:45.701524] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:18:45.748687] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-28T02:18:45.905361] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:46.046567] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:46.101685] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:46.102101] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-28T02:18:46.102398] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-28T02:18:46.117845] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-28T02:18:46.117970] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-28T02:18:46.118192] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-28T02:18:46.118281] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-28T02:18:46.263038] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-09-28T02:18:46.294841] [INFO ] [MAIN ] LUV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:46.315596] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUV took 0.9s. Estimated remaining: 13m 46s. Rate: 78.9 symbols/min [2025-09-28T02:18:46.673282] [DEBUG] [LOCAL ] LVS: Loaded 54342 existing records from primary storage. [2025-09-28T02:18:46.753827] [INFO ] [MAIN ] LVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:46.774905] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:46.781805] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LVS took 1.2s. Estimated remaining: 13m 45s. Rate: 79.0 symbols/min [2025-09-28T02:18:46.781438] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:18:46.782205] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-28T02:18:46.985486] [DEBUG] [LOCAL ] LVWR: Loaded 17668 existing records from primary storage. [2025-09-28T02:18:46.990409] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:46.991094] [INFO ] [MAIN ] LVWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:46.991311] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LVWR took 0.7s. Estimated remaining: 13m 44s. Rate: 79.0 symbols/min [2025-09-28T02:18:47.018969] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-28T02:18:47.045403] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-28T02:18:47.086715] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:18:47.093877] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-28T02:18:47.094034] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:18:47.115055] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-09-28T02:18:47.127963] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:18:47.144338] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-28T02:18:47.154798] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-28T02:18:47.160932] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-28T02:18:47.209932] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:47.189197] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-28T02:18:47.210358] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LUXE took 1.7s. Estimated remaining: 13m 43s. Rate: 79.0 symbols/min [2025-09-28T02:18:47.396430] [DEBUG] [LOCAL ] LW: Loaded 51915 existing records from primary storage. [2025-09-28T02:18:47.401976] [DEBUG] [LOCAL ] LXFR: Loaded 17259 existing records from primary storage. [2025-09-28T02:18:47.455105] [INFO ] [MAIN ] LXFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:47.459365] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:47.459598] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LXFR took 0.5s. Estimated remaining: 13m 42s. Rate: 79.1 symbols/min [2025-09-28T02:18:47.454763] [INFO ] [MAIN ] LW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:47.460409] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LW took 0.7s. Estimated remaining: 13m 40s. Rate: 79.2 symbols/min [2025-09-28T02:18:47.817206] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:47.887255] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:47.907381] [DEBUG] [LOCAL ] LXP: Loaded 51361 existing records from primary storage. [2025-09-28T02:18:47.908144] [INFO ] [MAIN ] LXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:47.908836] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXP took 0.7s. Estimated remaining: 13m 39s. Rate: 79.2 symbols/min [2025-09-28T02:18:48.154776] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:48.155951] [DEBUG] [LOCAL ] LXU: Loaded 32354 existing records from primary storage. [2025-09-28T02:18:48.171627] [INFO ] [MAIN ] LXU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:48.172299] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXU took 0.7s. Estimated remaining: 13m 38s. Rate: 79.2 symbols/min [2025-09-28T02:18:48.173635] [DEBUG] [LOCAL ] LYB: Loaded 54379 existing records from primary storage. [2025-09-28T02:18:48.185954] [INFO ] [MAIN ] LYB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:48.232193] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LYB took 0.7s. Estimated remaining: 13m 37s. Rate: 79.3 symbols/min [2025-09-28T02:18:48.496746] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:48.596863] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:48.629415] [DEBUG] [LOCAL ] LYG: Loaded 53606 existing records from primary storage. [2025-09-28T02:18:48.641255] [INFO ] [MAIN ] LYG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:48.641701] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 0.7s. Estimated remaining: 13m 36s. Rate: 79.3 symbols/min [2025-09-28T02:18:48.643818] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-28T02:18:48.684336] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-28T02:18:48.894326] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:48.912711] [DEBUG] [LOCAL ] LZB: Loaded 36113 existing records from primary storage. [2025-09-28T02:18:48.915808] [DEBUG] [LOCAL ] LYV: Loaded 51906 existing records from primary storage. [2025-09-28T02:18:48.916187] [INFO ] [MAIN ] LZB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:48.917718] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LZB took 0.7s. Estimated remaining: 13m 34s. Rate: 79.3 symbols/min [2025-09-28T02:18:48.916850] [INFO ] [MAIN ] LYV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:48.930296] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LYV took 0.8s. Estimated remaining: 13m 33s. Rate: 79.4 symbols/min [2025-09-28T02:18:49.141972] [DEBUG] [LOCAL ] LZM: Loaded 13905 existing records from primary storage. [2025-09-28T02:18:49.165502] [INFO ] [MAIN ] LZM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:49.193346] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZM took 0.6s. Estimated remaining: 13m 32s. Rate: 79.4 symbols/min [2025-09-28T02:18:49.463803] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:49.484605] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:49.629531] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:49.723331] [DEBUG] [LOCAL ] MA: Loaded 53329 existing records from primary storage. [2025-09-28T02:18:49.726379] [INFO ] [MAIN ] MA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:49.740719] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. MA took 0.8s. Estimated remaining: 13m 31s. Rate: 79.5 symbols/min [2025-09-28T02:18:49.741949] [DEBUG] [LOCAL ] M: Loaded 54315 existing records from primary storage. [2025-09-28T02:18:49.742744] [DEBUG] [LOCAL ] MAA: Loaded 43354 existing records from primary storage. [2025-09-28T02:18:49.780996] [INFO ] [MAIN ] MAA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:49.781236] [INFO ] [MAIN ] M: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:49.781848] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MAA took 0.6s. Estimated remaining: 13m 30s. Rate: 79.5 symbols/min [2025-09-28T02:18:49.849820] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. M took 0.9s. Estimated remaining: 13m 28s. Rate: 79.6 symbols/min [2025-09-28T02:18:50.168117] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:50.278538] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:50.341288] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:50.367217] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-28T02:18:50.377596] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-28T02:18:50.451837] [DEBUG] [LOCAL ] MAC: Loaded 50469 existing records from primary storage. [2025-09-28T02:18:50.452628] [DEBUG] [LOCAL ] MAGN: Loaded 35466 existing records from primary storage. [2025-09-28T02:18:50.464489] [INFO ] [MAIN ] MAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:50.466337] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAC took 0.7s. Estimated remaining: 13m 27s. Rate: 79.6 symbols/min [2025-09-28T02:18:50.466630] [INFO ] [MAIN ] MAGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:50.467518] [DEBUG] [LOCAL ] MAIN: Loaded 41929 existing records from primary storage. [2025-09-28T02:18:50.473779] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAGN took 0.6s. Estimated remaining: 13m 26s. Rate: 79.6 symbols/min [2025-09-28T02:18:50.525882] [INFO ] [MAIN ] MAIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:50.551281] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAIN took 0.7s. Estimated remaining: 13m 25s. Rate: 79.7 symbols/min [2025-09-28T02:18:50.966428] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:51.043249] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:51.116311] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:51.180107] [DEBUG] [LOCAL ] MANU: Loaded 27544 existing records from primary storage. [2025-09-28T02:18:51.181385] [DEBUG] [LOCAL ] MAN: Loaded 44216 existing records from primary storage. [2025-09-28T02:18:51.182119] [INFO ] [MAIN ] MAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:51.182425] [INFO ] [MAIN ] MANU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:51.182576] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MAN took 0.7s. Estimated remaining: 13m 24s. Rate: 79.7 symbols/min [2025-09-28T02:18:51.183048] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MANU took 0.7s. Estimated remaining: 13m 23s. Rate: 79.8 symbols/min [2025-09-28T02:18:51.500363] [DEBUG] [LOCAL ] MAS: Loaded 53102 existing records from primary storage. [2025-09-28T02:18:51.553817] [INFO ] [MAIN ] MAS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:51.616706] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:51.616841] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MAS took 1.0s. Estimated remaining: 13m 22s. Rate: 79.8 symbols/min [2025-09-28T02:18:51.652898] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:51.873883] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:51.896013] [DEBUG] [LOCAL ] MATV: Loaded 37964 existing records from primary storage. [2025-09-28T02:18:51.898014] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-28T02:18:51.898293] [INFO ] [MAIN ] MATV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:51.906088] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MATV took 0.7s. Estimated remaining: 13m 20s. Rate: 79.8 symbols/min [2025-09-28T02:18:51.906759] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-28T02:18:52.023102] [DEBUG] [LOCAL ] MATX: Loaded 31851 existing records from primary storage. [2025-09-28T02:18:52.057195] [INFO ] [MAIN ] MATX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:52.083474] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATX took 0.9s. Estimated remaining: 13m 19s. Rate: 79.9 symbols/min [2025-09-28T02:18:52.165121] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:52.221245] [DEBUG] [LOCAL ] MAX: Loaded 31209 existing records from primary storage. [2025-09-28T02:18:52.270038] [INFO ] [MAIN ] MAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:52.277188] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MAX took 0.6s. Estimated remaining: 13m 18s. Rate: 79.9 symbols/min [2025-09-28T02:18:52.421361] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:52.559932] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:52.575673] [DEBUG] [LOCAL ] MBC: Loaded 43803 existing records from primary storage. [2025-09-28T02:18:52.582320] [INFO ] [MAIN ] MBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:52.583037] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MBC took 0.7s. Estimated remaining: 13m 17s. Rate: 80.0 symbols/min [2025-09-28T02:18:52.692289] [DEBUG] [LOCAL ] MBI: Loaded 24930 existing records from primary storage. [2025-09-28T02:18:52.718705] [INFO ] [MAIN ] MBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:52.729270] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBI took 0.6s. Estimated remaining: 13m 16s. Rate: 80.0 symbols/min [2025-09-28T02:18:52.805063] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:52.961713] [DEBUG] [LOCAL ] MC: Loaded 44878 existing records from primary storage. [2025-09-28T02:18:53.002879] [INFO ] [MAIN ] MC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:52.997533] [DEBUG] [LOCAL ] MCB: Loaded 11834 existing records from primary storage. [2025-09-28T02:18:53.028239] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:53.029005] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MC took 0.7s. Estimated remaining: 13m 15s. Rate: 80.0 symbols/min [2025-09-28T02:18:53.029272] [INFO ] [MAIN ] MCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:53.041812] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MCB took 0.5s. Estimated remaining: 13m 13s. Rate: 80.1 symbols/min [2025-09-28T02:18:53.041885] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-28T02:18:53.148466] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-28T02:18:53.221537] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-28T02:18:53.269353] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-28T02:18:53.290423] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-28T02:18:53.299277] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-28T02:18:53.394668] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:53.556639] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:53.603876] [DEBUG] [LOCAL ] MCI: Loaded 6477 existing records from primary storage. [2025-09-28T02:18:53.638362] [INFO ] [MAIN ] MCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:53.642858] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-28T02:18:53.643321] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MCI took 0.6s. Estimated remaining: 13m 12s. Rate: 80.1 symbols/min [2025-09-28T02:18:53.670478] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-28T02:18:54.129766] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:18:54.137301] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:54.138631] [DEBUG] [LOCAL ] MCK: Loaded 39985 existing records from primary storage. [2025-09-28T02:18:54.139117] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-28T02:18:54.139575] [INFO ] [MAIN ] MCK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:54.140467] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCK took 1.1s. Estimated remaining: 13m 11s. Rate: 80.1 symbols/min [2025-09-28T02:18:54.279614] [DEBUG] [LOCAL ] MCN: Loaded 8231 existing records from primary storage. [2025-09-28T02:18:54.290784] [INFO ] [MAIN ] MCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:54.296048] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCN took 0.6s. Estimated remaining: 13m 10s. Rate: 80.2 symbols/min [2025-09-28T02:18:54.467080] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:54.547423] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:54.561099] [DEBUG] [LOCAL ] MCR: Loaded 8858 existing records from primary storage. [2025-09-28T02:18:54.561402] [INFO ] [MAIN ] MCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:54.561617] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCR took 0.3s. Estimated remaining: 13m 9s. Rate: 80.2 symbols/min [2025-09-28T02:18:54.712072] [DEBUG] [LOCAL ] MCO: Loaded 40102 existing records from primary storage. [2025-09-28T02:18:54.739986] [INFO ] [MAIN ] MCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:54.748346] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCO took 0.6s. Estimated remaining: 13m 8s. Rate: 80.3 symbols/min [2025-09-28T02:18:54.772438] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:18:54.795792] [DEBUG] [LOCAL ] MCS: Loaded 21454 existing records from primary storage. [2025-09-28T02:18:54.796161] [INFO ] [MAIN ] MCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:18:54.796271] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCS took 0.2s. Estimated remaining: 13m 7s. Rate: 80.3 symbols/min [2025-09-28T02:18:55.054422] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-28T02:18:55.060929] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-28T02:18:56.303017] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-28T02:18:56.314797] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-28T02:18:56.333541] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-28T02:18:56.340137] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-28T02:18:57.566114] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-28T02:18:57.572856] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-28T02:18:58.484275] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-28T02:18:58.496083] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-28T02:18:58.574894] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-28T02:18:58.579356] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-28T02:18:59.832042] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-28T02:18:59.837826] [INFO ] [REMOTE ] LUCK: Full fetch complete (40658 records). [2025-09-28T02:18:59.838031] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-28T02:19:00.060775] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:19:00.061295] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:19:00.061373] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:19:00.061454] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-28T02:19:00.061576] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-28T02:19:00.061682] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-28T02:19:00.061785] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-28T02:19:00.061895] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. LUCK took 16.0s. Estimated remaining: 13m 9s. Rate: 80.0 symbols/min [2025-09-28T02:19:00.461073] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-28T02:19:00.471634] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-28T02:19:02.873116] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-28T02:19:02.885196] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-28T02:19:05.225781] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-28T02:19:05.237599] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-28T02:19:07.522675] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-28T02:19:07.534565] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-28T02:19:09.780301] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-28T02:19:09.792048] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-28T02:19:11.976228] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-28T02:19:11.989281] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-28T02:19:14.126780] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-28T02:19:14.138530] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-28T02:19:16.604526] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-28T02:19:16.614904] [INFO ] [REMOTE ] MCD: Full fetch complete (77031 records). [2025-09-28T02:19:16.615099] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-28T02:19:16.824447] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:19:16.825333] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:19:16.825417] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:19:16.825497] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-28T02:19:16.825600] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-28T02:19:16.825705] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-28T02:19:16.825812] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-28T02:19:16.825922] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCD took 24.1s. Estimated remaining: 13m 21s. Rate: 78.7 symbols/min [2025-09-28T02:19:17.482783] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:17.545336] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:17.473512] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:17.600510] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:17.608017] [DEBUG] [LOCAL ] MDST: Loaded 5688 existing records from primary storage. [2025-09-28T02:19:17.609023] [INFO ] [MAIN ] MDST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:17.609204] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 0.8s. Estimated remaining: 13m 21s. Rate: 78.7 symbols/min [2025-09-28T02:19:17.820570] [DEBUG] [LOCAL ] MCY: Loaded 25345 existing records from primary storage. [2025-09-28T02:19:17.853767] [INFO ] [MAIN ] MCY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:17.838077] [DEBUG] [LOCAL ] MD: Loaded 39064 existing records from primary storage. [2025-09-28T02:19:17.877224] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:17.877861] [INFO ] [MAIN ] MD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:17.877617] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MCY took 1.1s. Estimated remaining: 13m 19s. Rate: 78.7 symbols/min [2025-09-28T02:19:17.905382] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MD took 1.1s. Estimated remaining: 13m 18s. Rate: 78.8 symbols/min [2025-09-28T02:19:17.928217] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-09-28T02:19:17.988847] [INFO ] [MAIN ] MDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:18.026026] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 1.2s. Estimated remaining: 13m 17s. Rate: 78.8 symbols/min [2025-09-28T02:19:18.431932] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:18.408627] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:18.503093] [DEBUG] [LOCAL ] MDU: Loaded 48643 existing records from primary storage. [2025-09-28T02:19:18.530524] [INFO ] [MAIN ] MDU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:18.535406] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:18.536343] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDU took 0.9s. Estimated remaining: 13m 16s. Rate: 78.9 symbols/min [2025-09-28T02:19:18.591355] [DEBUG] [LOCAL ] MDV: Loaded 8733 existing records from primary storage. [2025-09-28T02:19:18.634218] [INFO ] [MAIN ] MDV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:18.657002] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MDV took 0.8s. Estimated remaining: 13m 15s. Rate: 78.9 symbols/min [2025-09-28T02:19:18.668710] [DEBUG] [LOCAL ] MEC: Loaded 16695 existing records from primary storage. [2025-09-28T02:19:18.677120] [INFO ] [MAIN ] MEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:18.699725] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MEC took 0.8s. Estimated remaining: 13m 13s. Rate: 79.0 symbols/min [2025-09-28T02:19:18.868297] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:18.869400] [DEBUG] [LOCAL ] MED: Loaded 22043 existing records from primary storage. [2025-09-28T02:19:18.909448] [INFO ] [MAIN ] MED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:18.953898] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MED took 0.9s. Estimated remaining: 13m 12s. Rate: 79.0 symbols/min [2025-09-28T02:19:19.331153] [DEBUG] [LOCAL ] MEG: Loaded 32426 existing records from primary storage. [2025-09-28T02:19:19.312855] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:19.335367] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:19.346950] [INFO ] [MAIN ] MEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:19.363606] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEG took 0.8s. Estimated remaining: 13m 11s. Rate: 79.0 symbols/min [2025-09-28T02:19:19.462284] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:19.555195] [DEBUG] [LOCAL ] MEGI: Loaded 20630 existing records from primary storage. [2025-09-28T02:19:19.578040] [INFO ] [MAIN ] MEGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:19.598535] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEGI took 0.9s. Estimated remaining: 13m 10s. Rate: 79.1 symbols/min [2025-09-28T02:19:19.685239] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:19.713810] [DEBUG] [LOCAL ] MEI: Loaded 32933 existing records from primary storage. [2025-09-28T02:19:19.758897] [INFO ] [MAIN ] MEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:19.776525] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MEI took 1.1s. Estimated remaining: 13m 9s. Rate: 79.1 symbols/min [2025-09-28T02:19:19.987688] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:20.139730] [DEBUG] [LOCAL ] MFA: Loaded 46019 existing records from primary storage. [2025-09-28T02:19:20.110414] [DEBUG] [LOCAL ] MET: Loaded 54089 existing records from primary storage. [2025-09-28T02:19:20.146046] [INFO ] [MAIN ] MFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:20.145780] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:20.140204] [DEBUG] [LOCAL ] MFAN: Loaded 4331 existing records from primary storage. [2025-09-28T02:19:20.146419] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MFA took 0.8s. Estimated remaining: 13m 8s. Rate: 79.1 symbols/min [2025-09-28T02:19:20.147576] [INFO ] [MAIN ] MFAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:20.153715] [INFO ] [MAIN ] MET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:20.153347] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MFAN took 0.5s. Estimated remaining: 13m 6s. Rate: 79.2 symbols/min [2025-09-28T02:19:20.161420] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MET took 1.2s. Estimated remaining: 13m 5s. Rate: 79.3 symbols/min [2025-09-28T02:19:20.273201] [DEBUG] [LOCAL ] MFAO: Loaded 3853 existing records from primary storage. [2025-09-28T02:19:20.367092] [INFO ] [MAIN ] MFAO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:20.418248] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFAO took 0.6s. Estimated remaining: 13m 4s. Rate: 79.3 symbols/min [2025-09-28T02:19:20.768350] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:20.854276] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:20.864097] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:20.959042] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:20.965572] [DEBUG] [LOCAL ] MFM: Loaded 14390 existing records from primary storage. [2025-09-28T02:19:20.967766] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-28T02:19:20.968076] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-28T02:19:20.968215] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-28T02:19:20.968439] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-28T02:19:20.968611] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-28T02:19:20.969029] [INFO ] [MAIN ] MFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:20.969287] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFM took 0.7s. Estimated remaining: 13m 3s. Rate: 79.3 symbols/min [2025-09-28T02:19:20.969110] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-28T02:19:21.362783] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:21.429517] [DEBUG] [LOCAL ] MFG: Loaded 49748 existing records from primary storage. [2025-09-28T02:19:21.473418] [INFO ] [MAIN ] MFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:21.457092] [DEBUG] [LOCAL ] MFC: Loaded 52000 existing records from primary storage. [2025-09-28T02:19:21.480372] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFG took 1.3s. Estimated remaining: 13m 2s. Rate: 79.3 symbols/min [2025-09-28T02:19:21.490713] [INFO ] [MAIN ] MFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:21.499682] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFC took 1.4s. Estimated remaining: 13m 1s. Rate: 79.4 symbols/min [2025-09-28T02:19:21.711911] [DEBUG] [LOCAL ] MFSG: Loaded 5267 existing records from primary storage. [2025-09-28T02:19:21.794881] [INFO ] [MAIN ] MFSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:21.858803] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFSG took 0.9s. Estimated remaining: 12m 60s. Rate: 79.4 symbols/min [2025-09-28T02:19:21.889476] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:19:21.942309] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-28T02:19:22.151669] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:22.144298] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:22.233187] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:22.238776] [DEBUG] [LOCAL ] MFSV: Loaded 2514 existing records from primary storage. [2025-09-28T02:19:22.239676] [INFO ] [MAIN ] MFSV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:22.239837] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSV took 0.7s. Estimated remaining: 12m 59s. Rate: 79.5 symbols/min [2025-09-28T02:19:22.305696] [DEBUG] [LOCAL ] MFSI: Loaded 11358 existing records from primary storage. [2025-09-28T02:19:22.352991] [INFO ] [MAIN ] MFSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:22.366802] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSI took 0.9s. Estimated remaining: 12m 57s. Rate: 79.5 symbols/min [2025-09-28T02:19:22.394560] [DEBUG] [LOCAL ] MG: Loaded 16832 existing records from primary storage. [2025-09-28T02:19:22.460182] [INFO ] [MAIN ] MG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:22.482427] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MG took 0.6s. Estimated remaining: 12m 56s. Rate: 79.6 symbols/min [2025-09-28T02:19:22.524781] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:22.770018] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-28T02:19:22.769732] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:22.777770] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-28T02:19:22.859613] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:22.880949] [DEBUG] [LOCAL ] MGF: Loaded 4186 existing records from primary storage. [2025-09-28T02:19:22.881458] [INFO ] [MAIN ] MGF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:22.881579] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MGF took 0.5s. Estimated remaining: 12m 55s. Rate: 79.6 symbols/min [2025-09-28T02:19:23.012328] [DEBUG] [LOCAL ] MGA: Loaded 51414 existing records from primary storage. [2025-09-28T02:19:23.018933] [INFO ] [MAIN ] MGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:23.041216] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGA took 0.8s. Estimated remaining: 12m 54s. Rate: 79.6 symbols/min [2025-09-28T02:19:23.110150] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:23.202523] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-28T02:19:23.225861] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-28T02:19:23.255125] [DEBUG] [LOCAL ] MGM: Loaded 54388 existing records from primary storage. [2025-09-28T02:19:23.269369] [DEBUG] [LOCAL ] MGR: Loaded 5675 existing records from primary storage. [2025-09-28T02:19:23.279995] [INFO ] [MAIN ] MGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:23.301323] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGM took 0.8s. Estimated remaining: 12m 53s. Rate: 79.7 symbols/min [2025-09-28T02:19:23.301117] [INFO ] [MAIN ] MGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:23.321102] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGR took 0.4s. Estimated remaining: 12m 51s. Rate: 79.7 symbols/min [2025-09-28T02:19:23.349511] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:23.563183] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-28T02:19:23.568673] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-28T02:19:23.563401] [DEBUG] [LOCAL ] MGRB: Loaded 4102 existing records from primary storage. [2025-09-28T02:19:23.597496] [INFO ] [MAIN ] MGRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:23.612276] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGRB took 0.5s. Estimated remaining: 12m 50s. Rate: 79.8 symbols/min [2025-09-28T02:19:23.658809] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:23.764559] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:23.841317] [DEBUG] [LOCAL ] MGRD: Loaded 2231 existing records from primary storage. [2025-09-28T02:19:23.855249] [INFO ] [MAIN ] MGRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:23.880987] [DEBUG] [LOCAL ] MGRE: Loaded 6684 existing records from primary storage. [2025-09-28T02:19:23.886353] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MGRD took 0.6s. Estimated remaining: 12m 49s. Rate: 79.8 symbols/min [2025-09-28T02:19:23.920550] [INFO ] [MAIN ] MGRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:23.983419] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MGRE took 0.6s. Estimated remaining: 12m 48s. Rate: 79.9 symbols/min [2025-09-28T02:19:23.977933] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:24.057341] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-28T02:19:24.136017] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-28T02:19:24.374609] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:24.378822] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:24.394677] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-28T02:19:24.394758] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-28T02:19:24.394852] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-28T02:19:24.394917] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-28T02:19:24.394977] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-28T02:19:24.395021] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-28T02:19:24.543353] [DEBUG] [LOCAL ] MHD: Loaded 12297 existing records from primary storage. [2025-09-28T02:19:24.561229] [INFO ] [MAIN ] MHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:24.555700] [DEBUG] [LOCAL ] MGY: Loaded 53195 existing records from primary storage. [2025-09-28T02:19:24.579486] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-28T02:19:24.571752] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MHD took 0.6s. Estimated remaining: 12m 47s. Rate: 79.9 symbols/min [2025-09-28T02:19:24.598344] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-28T02:19:24.579363] [INFO ] [MAIN ] MGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:24.644252] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MGY took 1.0s. Estimated remaining: 12m 46s. Rate: 79.9 symbols/min [2025-09-28T02:19:25.139346] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:19:25.175377] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-28T02:19:25.163123] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:25.175826] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-28T02:19:25.176714] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-28T02:19:25.229876] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:25.239731] [DEBUG] [LOCAL ] MHF: Loaded 8713 existing records from primary storage. [2025-09-28T02:19:25.240446] [INFO ] [MAIN ] MHF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:25.240550] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MHF took 0.6s. Estimated remaining: 12m 45s. Rate: 79.9 symbols/min [2025-09-28T02:19:25.439677] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:25.453557] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:19:25.453787] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-28T02:19:25.454250] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-28T02:19:25.455832] [DEBUG] [LOCAL ] MHK: Loaded 43076 existing records from primary storage. [2025-09-28T02:19:25.454444] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-28T02:19:25.456560] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-28T02:19:25.456791] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-28T02:19:25.456008] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:19:25.456905] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-28T02:19:25.456482] [INFO ] [MAIN ] MHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:25.457283] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MHK took 0.8s. Estimated remaining: 12m 44s. Rate: 80.0 symbols/min [2025-09-28T02:19:25.457180] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-28T02:19:25.457074] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-09-28T02:19:25.469872] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:19:25.565866] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-28T02:19:25.587514] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-28T02:19:25.649524] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-28T02:19:25.603282] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-28T02:19:25.734850] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-28T02:19:25.790244] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:25.800716] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-28T02:19:25.827869] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MH took 1.8s. Estimated remaining: 12m 43s. Rate: 80.0 symbols/min [2025-09-28T02:19:26.024118] [DEBUG] [LOCAL ] MHN: Loaded 7867 existing records from primary storage. [2025-09-28T02:19:26.039095] [INFO ] [MAIN ] MHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:26.050382] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MHN took 0.6s. Estimated remaining: 12m 42s. Rate: 80.0 symbols/min [2025-09-28T02:19:26.097967] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-28T02:19:26.352578] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:26.250999] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-28T02:19:26.396273] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:19:26.396893] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-28T02:19:26.476495] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:26.476974] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-28T02:19:26.477051] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-28T02:19:26.477169] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-28T02:19:26.477244] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-28T02:19:26.477415] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-28T02:19:26.477490] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-28T02:19:26.671897] [DEBUG] [LOCAL ] MHO: Loaded 24650 existing records from primary storage. [2025-09-28T02:19:26.690582] [INFO ] [MAIN ] MHO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:26.745585] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MHO took 0.9s. Estimated remaining: 12m 41s. Rate: 80.0 symbols/min [2025-09-28T02:19:26.842818] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-28T02:19:26.899674] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-28T02:19:27.008469] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-28T02:19:27.031337] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-28T02:19:27.092515] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:19:27.123707] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-28T02:19:27.145429] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:27.160381] [DEBUG] [LOCAL ] MIN: Loaded 13224 existing records from primary storage. [2025-09-28T02:19:27.160718] [INFO ] [MAIN ] MIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:27.160821] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MIN took 0.4s. Estimated remaining: 12m 40s. Rate: 80.1 symbols/min [2025-09-28T02:19:27.351845] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:19:27.352201] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-28T02:19:27.352291] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:19:27.352368] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-09-28T02:19:27.352440] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:19:27.352520] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-28T02:19:27.352618] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-28T02:19:27.352721] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-28T02:19:27.352882] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-28T02:19:27.352973] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MIAX took 1.3s. Estimated remaining: 12m 39s. Rate: 80.1 symbols/min [2025-09-28T02:19:27.380843] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-28T02:19:27.381978] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-28T02:19:27.662608] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-28T02:19:27.664183] [INFO ] [REMOTE ] MFSB: Full fetch complete (1610 records). [2025-09-28T02:19:27.664296] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-28T02:19:27.747256] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-28T02:19:27.782968] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-28T02:19:27.932419] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-28T02:19:27.932732] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:19:27.932816] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:19:27.932905] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-28T02:19:27.933011] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-28T02:19:27.933087] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-28T02:19:27.933171] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-28T02:19:27.933277] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MFSB took 7.5s. Estimated remaining: 12m 38s. Rate: 80.1 symbols/min [2025-09-28T02:19:28.226475] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-28T02:19:28.227713] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-28T02:19:28.679187] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-28T02:19:28.680559] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-28T02:19:29.167580] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-28T02:19:29.169110] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-28T02:19:29.510162] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-28T02:19:29.511298] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-28T02:19:29.763590] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-28T02:19:29.764547] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-28T02:19:30.030106] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-28T02:19:30.031157] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-28T02:19:30.372471] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-28T02:19:30.373462] [INFO ] [REMOTE ] MHLA: Full fetch complete (1547 records). [2025-09-28T02:19:30.373556] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-28T02:19:30.594764] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-28T02:19:30.595020] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:19:30.595122] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:19:30.595230] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-28T02:19:30.595365] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-28T02:19:30.595458] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-28T02:19:30.595608] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-28T02:19:30.595754] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MHLA took 5.4s. Estimated remaining: 12m 38s. Rate: 80.0 symbols/min [2025-09-28T02:19:31.355845] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:31.385735] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:31.347141] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:31.410232] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:31.410877] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-28T02:19:31.411782] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-28T02:19:31.412202] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-28T02:19:31.412501] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-28T02:19:31.412820] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-28T02:19:31.412924] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-28T02:19:31.494169] [DEBUG] [LOCAL ] MITP: Loaded 2467 existing records from primary storage. [2025-09-28T02:19:31.542404] [INFO ] [MAIN ] MITP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:31.548637] [DEBUG] [LOCAL ] MITT: Loaded 23379 existing records from primary storage. [2025-09-28T02:19:31.559540] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITP took 0.9s. Estimated remaining: 12m 38s. Rate: 80.0 symbols/min [2025-09-28T02:19:31.576103] [INFO ] [MAIN ] MITT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:31.646211] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MITT took 1.0s. Estimated remaining: 12m 37s. Rate: 80.0 symbols/min [2025-09-28T02:19:32.048952] [DEBUG] [LOCAL ] MIR: Loaded 51622 existing records from primary storage. [2025-09-28T02:19:32.155426] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:32.178677] [INFO ] [MAIN ] MIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:32.228262] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MIR took 1.6s. Estimated remaining: 12m 36s. Rate: 80.0 symbols/min [2025-09-28T02:19:32.262490] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:32.307513] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:19:32.325240] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-28T02:19:32.394730] [DEBUG] [LOCAL ] MIY: Loaded 6084 existing records from primary storage. [2025-09-28T02:19:32.417527] [INFO ] [MAIN ] MIY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:32.424085] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MIY took 0.8s. Estimated remaining: 12m 35s. Rate: 80.1 symbols/min [2025-09-28T02:19:32.517985] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:32.681225] [DEBUG] [LOCAL ] MKC: Loaded 53204 existing records from primary storage. [2025-09-28T02:19:32.698463] [INFO ] [MAIN ] MKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:32.698607] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MKC took 1.0s. Estimated remaining: 12m 33s. Rate: 80.1 symbols/min [2025-09-28T02:19:32.831594] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:32.841398] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-28T02:19:32.896729] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-28T02:19:32.903712] [DEBUG] [LOCAL ] MKL: Loaded 34588 existing records from primary storage. [2025-09-28T02:19:32.931465] [INFO ] [MAIN ] MKL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:32.955566] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKL took 0.7s. Estimated remaining: 12m 32s. Rate: 80.1 symbols/min [2025-09-28T02:19:33.023688] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:33.233170] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:33.234830] [DEBUG] [LOCAL ] MLI: Loaded 44447 existing records from primary storage. [2025-09-28T02:19:33.243882] [INFO ] [MAIN ] MLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:33.246002] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLI took 0.8s. Estimated remaining: 12m 31s. Rate: 80.2 symbols/min [2025-09-28T02:19:33.341550] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-28T02:19:33.336021] [DEBUG] [LOCAL ] MLM: Loaded 31068 existing records from primary storage. [2025-09-28T02:19:33.354629] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-28T02:19:33.381629] [INFO ] [MAIN ] MLM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:33.393923] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLM took 0.7s. Estimated remaining: 12m 30s. Rate: 80.2 symbols/min [2025-09-28T02:19:33.538192] [DEBUG] [LOCAL ] MLNK: Loaded 25921 existing records from primary storage. [2025-09-28T02:19:33.531886] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:33.550421] [INFO ] [MAIN ] MLNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:33.573251] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MLNK took 0.6s. Estimated remaining: 12m 29s. Rate: 80.3 symbols/min [2025-09-28T02:19:33.761254] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:33.768897] [DEBUG] [LOCAL ] MLP: Loaded 3120 existing records from primary storage. [2025-09-28T02:19:33.782106] [INFO ] [MAIN ] MLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:33.808929] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLP took 0.6s. Estimated remaining: 12m 28s. Rate: 80.3 symbols/min [2025-09-28T02:19:33.924140] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-28T02:19:33.973609] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:33.975112] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-28T02:19:33.995385] [DEBUG] [LOCAL ] MLR: Loaded 12982 existing records from primary storage. [2025-09-28T02:19:34.060780] [INFO ] [MAIN ] MLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:34.099631] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:34.099851] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLR took 0.7s. Estimated remaining: 12m 27s. Rate: 80.4 symbols/min [2025-09-28T02:19:34.280016] [DEBUG] [LOCAL ] MMD: Loaded 11435 existing records from primary storage. [2025-09-28T02:19:34.303266] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:34.303706] [INFO ] [MAIN ] MMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:34.304048] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MMD took 0.5s. Estimated remaining: 12m 26s. Rate: 80.4 symbols/min [2025-09-28T02:19:34.454041] [DEBUG] [LOCAL ] MMC: Loaded 52551 existing records from primary storage. [2025-09-28T02:19:34.459914] [DEBUG] [LOCAL ] MMI: Loaded 15452 existing records from primary storage. [2025-09-28T02:19:34.470605] [INFO ] [MAIN ] MMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:34.470847] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMI took 0.4s. Estimated remaining: 12m 24s. Rate: 80.4 symbols/min [2025-09-28T02:19:34.501828] [INFO ] [MAIN ] MMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:34.551263] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMC took 0.9s. Estimated remaining: 12m 23s. Rate: 80.5 symbols/min [2025-09-28T02:19:34.576592] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:34.631787] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-09-28T02:19:34.666300] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-09-28T02:19:34.681839] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-09-28T02:19:34.747693] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-28T02:19:34.815792] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-28T02:19:34.851742] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-28T02:19:34.845000] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-28T02:19:34.819755] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:34.930698] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-28T02:19:34.872741] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-09-28T02:19:34.932113] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-28T02:19:34.932008] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:34.932322] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-28T02:19:34.954362] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-28T02:19:34.971362] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-28T02:19:35.008725] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-28T02:19:35.613768] [DEBUG] [LOCAL ] MMM: Loaded 53995 existing records from primary storage. [2025-09-28T02:19:35.700885] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:19:35.692263] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-28T02:19:35.713938] [INFO ] [MAIN ] MMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:35.733509] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-28T02:19:35.715610] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMM took 1.1s. Estimated remaining: 12m 23s. Rate: 80.5 symbols/min [2025-09-28T02:19:35.715917] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-28T02:19:35.859492] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:19:35.889753] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-28T02:19:36.001344] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:36.049284] [DEBUG] [LOCAL ] MMS: Loaded 34398 existing records from primary storage. [2025-09-28T02:19:36.049661] [INFO ] [MAIN ] MMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:36.050291] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMS took 0.3s. Estimated remaining: 12m 22s. Rate: 80.5 symbols/min [2025-09-28T02:19:36.110884] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:19:36.159188] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-28T02:19:36.162846] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:19:36.163244] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-09-28T02:19:36.173829] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:19:36.179056] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-28T02:19:36.189418] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-28T02:19:36.211375] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-09-28T02:19:36.243088] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:36.238734] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-09-28T02:19:36.243436] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMID took 1.9s. Estimated remaining: 12m 21s. Rate: 80.5 symbols/min [2025-09-28T02:19:36.293293] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-28T02:19:36.363521] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-28T02:19:36.395851] [DEBUG] [LOCAL ] MMT: Loaded 10987 existing records from primary storage. [2025-09-28T02:19:36.417400] [INFO ] [MAIN ] MMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:36.416990] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-28T02:19:36.455719] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-28T02:19:36.454275] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:36.455940] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMT took 0.4s. Estimated remaining: 12m 19s. Rate: 80.6 symbols/min [2025-09-28T02:19:36.594938] [DEBUG] [LOCAL ] MMU: Loaded 17156 existing records from primary storage. [2025-09-28T02:19:36.610721] [INFO ] [MAIN ] MMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:36.615979] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMU took 0.4s. Estimated remaining: 12m 18s. Rate: 80.6 symbols/min [2025-09-28T02:19:36.736172] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:36.858949] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:36.879906] [DEBUG] [LOCAL ] MNR: Loaded 24918 existing records from primary storage. [2025-09-28T02:19:36.880282] [INFO ] [MAIN ] MNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:36.880406] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MNR took 0.4s. Estimated remaining: 12m 17s. Rate: 80.7 symbols/min [2025-09-28T02:19:36.925290] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-28T02:19:36.954916] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-28T02:19:36.979566] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-28T02:19:37.008666] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-28T02:19:37.120054] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:37.122047] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-28T02:19:37.123193] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-28T02:19:37.123372] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-28T02:19:37.123115] [DEBUG] [LOCAL ] MNSO: Loaded 45049 existing records from primary storage. [2025-09-28T02:19:37.123684] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-28T02:19:37.123817] [INFO ] [MAIN ] MNSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:37.124455] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-28T02:19:37.124375] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MNSO took 0.5s. Estimated remaining: 12m 16s. Rate: 80.7 symbols/min [2025-09-28T02:19:37.149540] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-28T02:19:37.430105] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-28T02:19:37.509121] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-28T02:19:37.551924] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:37.523078] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-28T02:19:37.557738] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-28T02:19:37.565440] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-28T02:19:37.578267] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-28T02:19:37.586145] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-28T02:19:37.602476] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-28T02:19:37.603511] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-28T02:19:37.643374] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-28T02:19:37.886542] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-28T02:19:37.952086] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:19:37.969964] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-28T02:19:37.985442] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-28T02:19:38.053073] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-28T02:19:38.088436] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-28T02:19:38.229738] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:19:38.230194] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-28T02:19:38.290471] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:19:38.290910] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-28T02:19:38.291002] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:19:38.291083] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-09-28T02:19:38.291152] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:19:38.291228] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-28T02:19:38.291323] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-28T02:19:38.291396] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-28T02:19:38.291507] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-28T02:19:38.291596] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNTN took 1.4s. Estimated remaining: 12m 16s. Rate: 80.7 symbols/min [2025-09-28T02:19:38.477978] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:38.480423] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-28T02:19:38.481310] [INFO ] [REMOTE ] MITN: Full fetch complete (2309 records). [2025-09-28T02:19:38.481440] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-28T02:19:38.539880] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-28T02:19:38.577271] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-28T02:19:38.697558] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:19:38.708638] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:19:38.708779] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:19:38.708838] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-28T02:19:38.708981] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-28T02:19:38.709059] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-28T02:19:38.709144] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-28T02:19:38.709260] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MITN took 8.1s. Estimated remaining: 12m 15s. Rate: 80.7 symbols/min [2025-09-28T02:19:38.866820] [DEBUG] [LOCAL ] MOD: Loaded 46169 existing records from primary storage. [2025-09-28T02:19:38.895897] [INFO ] [MAIN ] MOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:38.921928] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MOD took 0.6s. Estimated remaining: 12m 14s. Rate: 80.7 symbols/min [2025-09-28T02:19:38.926032] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:39.011788] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-28T02:19:39.047301] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-28T02:19:39.134096] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:39.173429] [DEBUG] [LOCAL ] MODG: Loaded 52353 existing records from primary storage. [2025-09-28T02:19:39.173986] [INFO ] [MAIN ] MODG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:39.174193] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MODG took 0.5s. Estimated remaining: 12m 12s. Rate: 80.8 symbols/min [2025-09-28T02:19:39.403358] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:39.405208] [DEBUG] [LOCAL ] MOH: Loaded 42444 existing records from primary storage. [2025-09-28T02:19:39.406095] [INFO ] [MAIN ] MOH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:39.406834] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MOH took 0.5s. Estimated remaining: 12m 11s. Rate: 80.8 symbols/min [2025-09-28T02:19:39.603398] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:39.599711] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-28T02:19:39.605672] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-28T02:19:39.649526] [DEBUG] [LOCAL ] MOS: Loaded 54284 existing records from primary storage. [2025-09-28T02:19:39.650039] [INFO ] [MAIN ] MOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:39.650160] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MOS took 0.5s. Estimated remaining: 12m 10s. Rate: 80.9 symbols/min [2025-09-28T02:19:39.739147] [DEBUG] [LOCAL ] MOV: Loaded 22417 existing records from primary storage. [2025-09-28T02:19:39.778952] [INFO ] [MAIN ] MOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:39.779537] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOV took 0.4s. Estimated remaining: 12m 9s. Rate: 80.9 symbols/min [2025-09-28T02:19:39.975704] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:40.035605] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-28T02:19:40.062224] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-28T02:19:40.060894] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:40.072390] [DEBUG] [LOCAL ] MPA: Loaded 5268 existing records from primary storage. [2025-09-28T02:19:40.072737] [INFO ] [MAIN ] MPA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:40.072849] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MPA took 0.3s. Estimated remaining: 12m 8s. Rate: 80.9 symbols/min [2025-09-28T02:19:40.292213] [DEBUG] [LOCAL ] MP: Loaded 54444 existing records from primary storage. [2025-09-28T02:19:40.314723] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:40.313700] [INFO ] [MAIN ] MP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:40.315368] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MP took 0.7s. Estimated remaining: 12m 7s. Rate: 81.0 symbols/min [2025-09-28T02:19:40.537973] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:40.587761] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-28T02:19:40.589281] [DEBUG] [LOCAL ] MPC: Loaded 52889 existing records from primary storage. [2025-09-28T02:19:40.591007] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-28T02:19:40.592486] [INFO ] [MAIN ] MPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:40.593057] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MPC took 0.5s. Estimated remaining: 12m 6s. Rate: 81.0 symbols/min [2025-09-28T02:19:40.787230] [DEBUG] [LOCAL ] MPLX: Loaded 51491 existing records from primary storage. [2025-09-28T02:19:40.824787] [INFO ] [MAIN ] MPLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:40.856297] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MPLX took 0.5s. Estimated remaining: 12m 5s. Rate: 81.0 symbols/min [2025-09-28T02:19:40.856159] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:40.851612] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-28T02:19:40.901562] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-28T02:19:40.983747] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-28T02:19:40.992984] [INFO ] [REMOTE ] MMKT: Full fetch complete (2099 records). [2025-09-28T02:19:41.014114] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-28T02:19:41.048274] [DEBUG] [LOCAL ] MPV: Loaded 5098 existing records from primary storage. [2025-09-28T02:19:41.065099] [INFO ] [MAIN ] MPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:41.094092] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPV took 0.5s. Estimated remaining: 12m 4s. Rate: 81.1 symbols/min [2025-09-28T02:19:41.147850] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:41.452318] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:19:41.486527] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:19:41.533290] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:41.533572] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:19:41.533952] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-28T02:19:41.534567] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-28T02:19:41.534796] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-28T02:19:41.536206] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-28T02:19:41.536481] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MMKT took 7.0s. Estimated remaining: 12m 3s. Rate: 81.1 symbols/min [2025-09-28T02:19:41.604437] [DEBUG] [LOCAL ] MPX: Loaded 4213 existing records from primary storage. [2025-09-28T02:19:41.650473] [INFO ] [MAIN ] MPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:41.663630] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPX took 0.5s. Estimated remaining: 12m 2s. Rate: 81.2 symbols/min [2025-09-28T02:19:41.695126] [DEBUG] [LOCAL ] MPW: Loaded 54275 existing records from primary storage. [2025-09-28T02:19:41.744620] [INFO ] [MAIN ] MPW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:41.813264] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MPW took 1.0s. Estimated remaining: 12m 0s. Rate: 81.2 symbols/min [2025-09-28T02:19:41.890079] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:42.095877] [DEBUG] [LOCAL ] MQT: Loaded 8523 existing records from primary storage. [2025-09-28T02:19:42.095370] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:42.096517] [INFO ] [MAIN ] MQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:42.096717] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MQT took 0.6s. Estimated remaining: 11m 59s. Rate: 81.2 symbols/min [2025-09-28T02:19:42.190318] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:19:42.198352] [DEBUG] [LOCAL ] MQY: Loaded 16979 existing records from primary storage. [2025-09-28T02:19:42.198861] [INFO ] [MAIN ] MQY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:42.198983] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQY took 0.5s. Estimated remaining: 11m 58s. Rate: 81.3 symbols/min [2025-09-28T02:19:42.234829] [DEBUG] [LOCAL ] MRC: Loaded 38128 existing records from primary storage. [2025-09-28T02:19:42.235231] [INFO ] [MAIN ] MRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:19:42.235337] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MRC took 0.3s. Estimated remaining: 11m 57s. Rate: 81.3 symbols/min [2025-09-28T02:19:43.546865] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-28T02:19:43.558308] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-28T02:19:45.531351] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-28T02:19:45.542436] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-28T02:19:47.861307] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-28T02:19:47.872972] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-28T02:19:50.075771] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-28T02:19:50.087565] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-28T02:19:52.546970] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-28T02:19:52.559145] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-28T02:19:54.729716] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-28T02:19:54.741432] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-28T02:19:57.132898] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-28T02:19:57.145410] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-28T02:19:59.349460] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-28T02:19:59.361804] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-28T02:20:01.712639] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-28T02:20:01.723549] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-28T02:20:01.723833] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-28T02:20:01.949075] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:20:01.949899] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:20:01.949991] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:20:01.950081] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-28T02:20:01.950189] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-28T02:20:01.950268] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-28T02:20:01.950386] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-28T02:20:01.950503] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MO took 24.8s. Estimated remaining: 12m 9s. Rate: 79.9 symbols/min [2025-09-28T02:20:02.612817] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:02.781597] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:02.785955] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:02.788510] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:02.789964] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-28T02:20:02.792453] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-28T02:20:02.793964] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-28T02:20:02.794164] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-28T02:20:02.794289] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-28T02:20:02.794532] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-28T02:20:02.975415] [DEBUG] [LOCAL ] MSA: Loaded 18988 existing records from primary storage. [2025-09-28T02:20:03.038453] [INFO ] [MAIN ] MSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:03.106396] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MSA took 1.1s. Estimated remaining: 12m 9s. Rate: 79.8 symbols/min [2025-09-28T02:20:03.265500] [DEBUG] [LOCAL ] MS: Loaded 54472 existing records from primary storage. [2025-09-28T02:20:03.384862] [DEBUG] [LOCAL ] MRK: Loaded 54569 existing records from primary storage. [2025-09-28T02:20:03.373605] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:03.398629] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-28T02:20:03.370044] [INFO ] [MAIN ] MS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:03.399019] [INFO ] [MAIN ] MRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:03.400225] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MS took 1.4s. Estimated remaining: 12m 8s. Rate: 79.9 symbols/min [2025-09-28T02:20:03.429627] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MRK took 1.5s. Estimated remaining: 12m 7s. Rate: 79.9 symbols/min [2025-09-28T02:20:03.551323] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:03.766522] [DEBUG] [LOCAL ] MSB: Loaded 7895 existing records from primary storage. [2025-09-28T02:20:03.801740] [INFO ] [MAIN ] MSB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:03.816417] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:20:03.847747] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MSB took 0.7s. Estimated remaining: 12m 6s. Rate: 80.0 symbols/min [2025-09-28T02:20:03.910304] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:03.905113] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:03.875272] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-28T02:20:03.923253] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:20:03.923509] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-09-28T02:20:03.944577] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:20:03.944695] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-28T02:20:03.944914] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-28T02:20:03.950189] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-28T02:20:03.956556] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-28T02:20:03.979050] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-28T02:20:03.978854] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-28T02:20:03.990436] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-28T02:20:04.016432] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-28T02:20:04.016760] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-28T02:20:04.022489] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MRP took 2.1s. Estimated remaining: 12m 4s. Rate: 80.0 symbols/min [2025-09-28T02:20:04.022197] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-28T02:20:04.403896] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:04.421104] [DEBUG] [LOCAL ] MSCI: Loaded 35351 existing records from primary storage. [2025-09-28T02:20:04.435517] [INFO ] [MAIN ] MSCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:04.520577] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSCI took 1.0s. Estimated remaining: 12m 4s. Rate: 80.0 symbols/min [2025-09-28T02:20:04.601975] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:04.687832] [DEBUG] [LOCAL ] MSD: Loaded 15775 existing records from primary storage. [2025-09-28T02:20:04.710178] [INFO ] [MAIN ] MSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:04.739453] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSD took 0.8s. Estimated remaining: 12m 2s. Rate: 80.1 symbols/min [2025-09-28T02:20:05.167519] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:05.185046] [DEBUG] [LOCAL ] MSDL: Loaded 38645 existing records from primary storage. [2025-09-28T02:20:05.173090] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:05.219203] [INFO ] [MAIN ] MSDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:05.219585] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-28T02:20:05.254584] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSDL took 1.2s. Estimated remaining: 12m 1s. Rate: 80.1 symbols/min [2025-09-28T02:20:05.260320] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:05.419243] [DEBUG] [LOCAL ] MSGS: Loaded 17318 existing records from primary storage. [2025-09-28T02:20:05.418673] [DEBUG] [LOCAL ] MSGE: Loaded 27513 existing records from primary storage. [2025-09-28T02:20:05.430079] [INFO ] [MAIN ] MSGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:05.488387] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:05.451461] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSGS took 0.6s. Estimated remaining: 12m 0s. Rate: 80.1 symbols/min [2025-09-28T02:20:05.484390] [INFO ] [MAIN ] MSGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:05.494172] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSGE took 0.9s. Estimated remaining: 11m 59s. Rate: 80.2 symbols/min [2025-09-28T02:20:05.741972] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-28T02:20:05.760053] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-28T02:20:05.933858] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:05.897543] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:05.935929] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-28T02:20:05.936427] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-28T02:20:05.936606] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-28T02:20:05.937673] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-28T02:20:05.937444] [DEBUG] [LOCAL ] MSI: Loaded 41128 existing records from primary storage. [2025-09-28T02:20:05.937877] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-28T02:20:05.938097] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-28T02:20:05.938284] [INFO ] [MAIN ] MSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:05.951631] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSI took 0.7s. Estimated remaining: 11m 58s. Rate: 80.2 symbols/min [2025-09-28T02:20:06.361392] [DEBUG] [LOCAL ] MSM: Loaded 36004 existing records from primary storage. [2025-09-28T02:20:06.409852] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:06.405476] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-28T02:20:06.455582] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-28T02:20:06.470841] [INFO ] [MAIN ] MSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:06.507172] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSM took 1.0s. Estimated remaining: 11m 57s. Rate: 80.2 symbols/min [2025-09-28T02:20:06.717718] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:06.734668] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-28T02:20:06.812762] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:06.835266] [DEBUG] [LOCAL ] MT: Loaded 51417 existing records from primary storage. [2025-09-28T02:20:06.835823] [INFO ] [MAIN ] MT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:06.836043] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MT took 0.9s. Estimated remaining: 11m 56s. Rate: 80.2 symbols/min [2025-09-28T02:20:07.068969] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:20:07.073218] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:07.073972] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-28T02:20:07.074134] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:20:07.075761] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-09-28T02:20:07.075683] [DEBUG] [LOCAL ] MTAL: Loaded 37002 existing records from primary storage. [2025-09-28T02:20:07.076522] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:20:07.076984] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-28T02:20:07.076746] [INFO ] [MAIN ] MTAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:07.077140] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-28T02:20:07.077235] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MTAL took 0.6s. Estimated remaining: 11m 55s. Rate: 80.3 symbols/min [2025-09-28T02:20:07.077362] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-28T02:20:07.077616] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-28T02:20:07.090030] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MSIF took 1.6s. Estimated remaining: 11m 54s. Rate: 80.3 symbols/min [2025-09-28T02:20:07.327885] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-28T02:20:07.386928] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-28T02:20:07.439292] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:07.490345] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:07.515474] [DEBUG] [LOCAL ] MTB: Loaded 47562 existing records from primary storage. [2025-09-28T02:20:07.531145] [DEBUG] [LOCAL ] MTD: Loaded 15342 existing records from primary storage. [2025-09-28T02:20:07.531416] [INFO ] [MAIN ] MTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:07.531875] [INFO ] [MAIN ] MTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:07.532080] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MTD took 0.5s. Estimated remaining: 11m 53s. Rate: 80.4 symbols/min [2025-09-28T02:20:07.532897] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTB took 0.7s. Estimated remaining: 11m 52s. Rate: 80.4 symbols/min [2025-09-28T02:20:07.910409] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:07.962056] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:07.962273] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-28T02:20:07.966830] [DEBUG] [LOCAL ] MTDR: Loaded 52316 existing records from primary storage. [2025-09-28T02:20:07.964948] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-28T02:20:07.969541] [INFO ] [MAIN ] MTDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:07.969780] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTDR took 0.9s. Estimated remaining: 11m 51s. Rate: 80.4 symbols/min [2025-09-28T02:20:08.176061] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:08.209047] [DEBUG] [LOCAL ] MTH: Loaded 44547 existing records from primary storage. [2025-09-28T02:20:08.210288] [INFO ] [MAIN ] MTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:08.224976] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTH took 0.7s. Estimated remaining: 11m 50s. Rate: 80.5 symbols/min [2025-09-28T02:20:08.265486] [DEBUG] [LOCAL ] MTG: Loaded 52091 existing records from primary storage. [2025-09-28T02:20:08.306095] [INFO ] [MAIN ] MTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:08.338537] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTG took 0.8s. Estimated remaining: 11m 49s. Rate: 80.5 symbols/min [2025-09-28T02:20:08.461949] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-28T02:20:08.521561] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-28T02:20:08.511785] [DEBUG] [LOCAL ] MTN: Loaded 39607 existing records from primary storage. [2025-09-28T02:20:08.566091] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:08.566297] [INFO ] [MAIN ] MTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:08.566784] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-28T02:20:08.578129] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTN took 0.6s. Estimated remaining: 11m 47s. Rate: 80.6 symbols/min [2025-09-28T02:20:08.600768] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-28T02:20:08.652037] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-28T02:20:08.726161] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-28T02:20:08.702556] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:08.759483] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-28T02:20:08.763608] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-28T02:20:08.934083] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:09.033061] [DEBUG] [LOCAL ] MTRN: Loaded 18303 existing records from primary storage. [2025-09-28T02:20:09.066147] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-28T02:20:09.078857] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-28T02:20:09.077669] [INFO ] [MAIN ] MTRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:09.090525] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTRN took 0.8s. Estimated remaining: 11m 47s. Rate: 80.6 symbols/min [2025-09-28T02:20:09.293941] [DEBUG] [LOCAL ] MTUS: Loaded 28984 existing records from primary storage. [2025-09-28T02:20:09.365365] [INFO ] [MAIN ] MTUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:09.381879] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTUS took 0.8s. Estimated remaining: 11m 46s. Rate: 80.6 symbols/min [2025-09-28T02:20:09.480895] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-28T02:20:09.433734] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:09.497982] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-28T02:20:09.532840] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:09.539125] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-28T02:20:09.707157] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:09.721210] [DEBUG] [LOCAL ] MTW: Loaded 26888 existing records from primary storage. [2025-09-28T02:20:09.721617] [INFO ] [MAIN ] MTW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:09.721890] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTW took 0.6s. Estimated remaining: 11m 45s. Rate: 80.7 symbols/min [2025-09-28T02:20:09.852674] [DEBUG] [LOCAL ] MTX: Loaded 23150 existing records from primary storage. [2025-09-28T02:20:09.904733] [INFO ] [MAIN ] MTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:09.926065] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:09.926228] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MTX took 0.5s. Estimated remaining: 11m 43s. Rate: 80.7 symbols/min [2025-09-28T02:20:10.062909] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-28T02:20:10.075950] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-28T02:20:10.116106] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-28T02:20:10.150612] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:10.164151] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-28T02:20:10.192107] [DEBUG] [LOCAL ] MUA: Loaded 12391 existing records from primary storage. [2025-09-28T02:20:10.193417] [INFO ] [MAIN ] MUA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:10.194170] [DEBUG] [LOCAL ] MTZ: Loaded 43922 existing records from primary storage. [2025-09-28T02:20:10.194483] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MUA took 0.3s. Estimated remaining: 11m 42s. Rate: 80.7 symbols/min [2025-09-28T02:20:10.194674] [INFO ] [MAIN ] MTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:10.200500] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MTZ took 0.5s. Estimated remaining: 11m 41s. Rate: 80.8 symbols/min [2025-09-28T02:20:10.602072] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:10.606589] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:10.622926] [DEBUG] [LOCAL ] MUE: Loaded 12092 existing records from primary storage. [2025-09-28T02:20:10.623451] [INFO ] [MAIN ] MUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:10.623729] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MUE took 0.4s. Estimated remaining: 11m 40s. Rate: 80.8 symbols/min [2025-09-28T02:20:10.632087] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-28T02:20:10.673917] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-28T02:20:10.720878] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-28T02:20:10.721741] [DEBUG] [LOCAL ] MUC: Loaded 20721 existing records from primary storage. [2025-09-28T02:20:10.760038] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-28T02:20:10.771044] [INFO ] [MAIN ] MUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:10.772268] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MUC took 0.6s. Estimated remaining: 11m 39s. Rate: 80.9 symbols/min [2025-09-28T02:20:10.940100] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:11.055920] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:11.086066] [DEBUG] [LOCAL ] MUJ: Loaded 13473 existing records from primary storage. [2025-09-28T02:20:11.086371] [INFO ] [MAIN ] MUJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:11.086474] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUJ took 0.3s. Estimated remaining: 11m 38s. Rate: 80.9 symbols/min [2025-09-28T02:20:11.220389] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-28T02:20:11.245890] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-28T02:20:11.247245] [DEBUG] [LOCAL ] MUFG: Loaded 53341 existing records from primary storage. [2025-09-28T02:20:11.285898] [INFO ] [MAIN ] MUFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:11.307596] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUFG took 0.7s. Estimated remaining: 11m 37s. Rate: 80.9 symbols/min [2025-09-28T02:20:11.312413] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:11.352921] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-28T02:20:11.400154] [INFO ] [REMOTE ] MSC: Full fetch complete (2509 records). [2025-09-28T02:20:11.427718] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-28T02:20:11.609863] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:11.760123] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-28T02:20:11.762097] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-28T02:20:11.769543] [DEBUG] [LOCAL ] MUR: Loaded 53705 existing records from primary storage. [2025-09-28T02:20:11.794616] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-28T02:20:11.795219] [INFO ] [MAIN ] MUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:11.795734] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUR took 0.7s. Estimated remaining: 11m 36s. Rate: 80.9 symbols/min [2025-09-28T02:20:11.795444] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:20:11.848170] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:20:11.853953] [DEBUG] [LOCAL ] MUSA: Loaded 25221 existing records from primary storage. [2025-09-28T02:20:11.884900] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-28T02:20:11.885145] [INFO ] [MAIN ] MUSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:11.885324] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUSA took 0.6s. Estimated remaining: 11m 35s. Rate: 81.0 symbols/min [2025-09-28T02:20:11.931564] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-28T02:20:11.948178] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-28T02:20:12.041566] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-28T02:20:12.083969] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:12.113865] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-28T02:20:12.126909] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-28T02:20:12.113749] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MSC took 8.7s. Estimated remaining: 11m 34s. Rate: 81.0 symbols/min [2025-09-28T02:20:12.127612] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-28T02:20:12.153934] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-28T02:20:12.205303] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-28T02:20:12.274048] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:12.274435] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-28T02:20:12.293704] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-28T02:20:12.333889] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-28T02:20:12.517947] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:12.636161] [DEBUG] [LOCAL ] MUX: Loaded 43253 existing records from primary storage. [2025-09-28T02:20:12.667315] [INFO ] [MAIN ] MUX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:12.695503] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUX took 0.8s. Estimated remaining: 11m 33s. Rate: 81.0 symbols/min [2025-09-28T02:20:12.711522] [DEBUG] [LOCAL ] MVF: Loaded 12921 existing records from primary storage. [2025-09-28T02:20:12.780520] [INFO ] [MAIN ] MVF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:12.819969] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MVF took 0.7s. Estimated remaining: 11m 32s. Rate: 81.1 symbols/min [2025-09-28T02:20:12.885050] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-28T02:20:12.988053] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-28T02:20:13.216614] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:13.247961] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:13.259978] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-28T02:20:13.337919] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:13.343874] [DEBUG] [LOCAL ] MVO: Loaded 9140 existing records from primary storage. [2025-09-28T02:20:13.344171] [INFO ] [MAIN ] MVO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:13.344275] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MVO took 0.6s. Estimated remaining: 11m 31s. Rate: 81.1 symbols/min [2025-09-28T02:20:13.354758] [DEBUG] [LOCAL ] MVT: Loaded 10355 existing records from primary storage. [2025-09-28T02:20:13.355075] [INFO ] [MAIN ] MVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:13.355206] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MVT took 0.5s. Estimated remaining: 11m 30s. Rate: 81.2 symbols/min [2025-09-28T02:20:13.548949] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-28T02:20:13.549914] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-28T02:20:13.810333] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:20:13.810738] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-28T02:20:13.810831] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:20:13.810937] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-09-28T02:20:13.811008] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:20:13.811083] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-28T02:20:13.811176] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-28T02:20:13.811249] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-28T02:20:13.811353] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-28T02:20:13.811442] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MUSE took 2.0s. Estimated remaining: 11m 29s. Rate: 81.2 symbols/min [2025-09-28T02:20:14.003545] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-28T02:20:14.005614] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-28T02:20:14.463551] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-28T02:20:14.464984] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-28T02:20:14.905343] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-28T02:20:14.906479] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-28T02:20:15.268979] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-28T02:20:15.269868] [INFO ] [REMOTE ] MTR: Full fetch complete (2549 records). [2025-09-28T02:20:15.269975] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-28T02:20:15.485065] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:20:15.485386] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:20:15.485474] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:20:15.485567] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-28T02:20:15.485736] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-28T02:20:15.485833] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-28T02:20:15.485935] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-28T02:20:15.486077] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MTR took 7.3s. Estimated remaining: 11m 29s. Rate: 81.1 symbols/min [2025-09-28T02:20:16.275040] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:16.328119] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:16.333182] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:16.287802] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:16.334060] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-28T02:20:16.334661] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-28T02:20:16.334787] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-28T02:20:16.334916] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-28T02:20:16.335165] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-28T02:20:16.335456] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-28T02:20:16.464154] [DEBUG] [LOCAL ] MXF: Loaded 5984 existing records from primary storage. [2025-09-28T02:20:16.471380] [INFO ] [MAIN ] MXF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:16.478893] [DEBUG] [LOCAL ] MX: Loaded 23379 existing records from primary storage. [2025-09-28T02:20:16.494814] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXF took 1.0s. Estimated remaining: 11m 28s. Rate: 81.1 symbols/min [2025-09-28T02:20:16.500184] [INFO ] [MAIN ] MX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:16.521961] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MX took 1.0s. Estimated remaining: 11m 27s. Rate: 81.2 symbols/min [2025-09-28T02:20:16.887894] [DEBUG] [LOCAL ] MWA: Loaded 47633 existing records from primary storage. [2025-09-28T02:20:16.964463] [INFO ] [MAIN ] MWA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:17.019412] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MWA took 1.5s. Estimated remaining: 11m 26s. Rate: 81.2 symbols/min [2025-09-28T02:20:17.301578] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:17.315551] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:17.285864] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:17.327892] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-09-28T02:20:17.336033] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-09-28T02:20:17.321710] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-28T02:20:17.341331] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-28T02:20:17.348619] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-28T02:20:17.370227] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-09-28T02:20:17.396931] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-28T02:20:17.472346] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:17.498743] [DEBUG] [LOCAL ] MYD: Loaded 13946 existing records from primary storage. [2025-09-28T02:20:17.537178] [INFO ] [MAIN ] MYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:17.551940] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MYD took 1.1s. Estimated remaining: 11m 25s. Rate: 81.2 symbols/min [2025-09-28T02:20:17.895890] [DEBUG] [LOCAL ] MYI: Loaded 19636 existing records from primary storage. [2025-09-28T02:20:17.952084] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-28T02:20:17.992182] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:17.993807] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-28T02:20:17.992312] [INFO ] [MAIN ] MYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:17.999819] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYI took 0.9s. Estimated remaining: 11m 24s. Rate: 81.2 symbols/min [2025-09-28T02:20:18.169081] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:18.205677] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-28T02:20:18.228092] [DEBUG] [LOCAL ] MYN: Loaded 10324 existing records from primary storage. [2025-09-28T02:20:18.254397] [INFO ] [MAIN ] MYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:18.254568] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYN took 0.7s. Estimated remaining: 11m 23s. Rate: 81.2 symbols/min [2025-09-28T02:20:18.301610] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:18.498825] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:18.515805] [DEBUG] [LOCAL ] NABL: Loaded 40294 existing records from primary storage. [2025-09-28T02:20:18.516282] [INFO ] [MAIN ] NABL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:18.516396] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. NABL took 0.5s. Estimated remaining: 11m 22s. Rate: 81.3 symbols/min [2025-09-28T02:20:18.625133] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-28T02:20:18.648509] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-28T02:20:18.646546] [DEBUG] [LOCAL ] NAC: Loaded 25076 existing records from primary storage. [2025-09-28T02:20:18.671193] [INFO ] [MAIN ] NAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:18.697503] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. NAC took 0.4s. Estimated remaining: 11m 21s. Rate: 81.3 symbols/min [2025-09-28T02:20:18.735678] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:18.926543] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:18.943540] [DEBUG] [LOCAL ] NAD: Loaded 34318 existing records from primary storage. [2025-09-28T02:20:18.943958] [INFO ] [MAIN ] NAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:18.944102] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAD took 0.4s. Estimated remaining: 11m 20s. Rate: 81.4 symbols/min [2025-09-28T02:20:19.008693] [DEBUG] [LOCAL ] NAN: Loaded 9084 existing records from primary storage. [2025-09-28T02:20:19.035167] [INFO ] [MAIN ] NAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:19.058602] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAN took 0.3s. Estimated remaining: 11m 19s. Rate: 81.4 symbols/min [2025-09-28T02:20:19.178356] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:19.262479] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-28T02:20:19.264834] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-28T02:20:19.343596] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:19.367332] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-28T02:20:19.375061] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-28T02:20:19.421140] [DEBUG] [LOCAL ] NAT: Loaded 49859 existing records from primary storage. [2025-09-28T02:20:19.421665] [INFO ] [MAIN ] NAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:19.421771] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAT took 0.5s. Estimated remaining: 11m 18s. Rate: 81.4 symbols/min [2025-09-28T02:20:19.542886] [DEBUG] [LOCAL ] NATL: Loaded 33367 existing records from primary storage. [2025-09-28T02:20:19.563959] [INFO ] [MAIN ] NATL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:19.585864] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NATL took 0.5s. Estimated remaining: 11m 17s. Rate: 81.5 symbols/min [2025-09-28T02:20:19.670759] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:19.754199] [DEBUG] [LOCAL ] NAZ: Loaded 2703 existing records from primary storage. [2025-09-28T02:20:19.780463] [INFO ] [MAIN ] NAZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:19.787878] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NAZ took 0.4s. Estimated remaining: 11m 16s. Rate: 81.5 symbols/min [2025-09-28T02:20:19.822715] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:19.828005] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-28T02:20:19.866072] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-28T02:20:19.991270] [DEBUG] [LOCAL ] NBB: Loaded 8967 existing records from primary storage. [2025-09-28T02:20:19.998678] [INFO ] [MAIN ] NBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:20.019502] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:20.015407] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NBB took 0.4s. Estimated remaining: 11m 15s. Rate: 81.6 symbols/min [2025-09-28T02:20:20.212807] [DEBUG] [LOCAL ] NBHC: Loaded 23530 existing records from primary storage. [2025-09-28T02:20:20.234502] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:20.234973] [INFO ] [MAIN ] NBHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:20.235188] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NBHC took 0.4s. Estimated remaining: 11m 14s. Rate: 81.6 symbols/min [2025-09-28T02:20:20.433182] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-28T02:20:20.437852] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:20.439828] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-28T02:20:20.454254] [DEBUG] [LOCAL ] NBR: Loaded 35286 existing records from primary storage. [2025-09-28T02:20:20.454993] [INFO ] [MAIN ] NBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:20.455113] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NBR took 0.4s. Estimated remaining: 11m 12s. Rate: 81.6 symbols/min [2025-09-28T02:20:20.679619] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:20.682138] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-28T02:20:20.688353] [DEBUG] [LOCAL ] NBXG: Loaded 22794 existing records from primary storage. [2025-09-28T02:20:20.690075] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-28T02:20:20.690421] [INFO ] [MAIN ] NBXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:20.691469] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBXG took 0.5s. Estimated remaining: 11m 11s. Rate: 81.7 symbols/min [2025-09-28T02:20:20.705847] [DEBUG] [LOCAL ] NC: Loaded 1933 existing records from primary storage. [2025-09-28T02:20:20.775163] [INFO ] [MAIN ] NC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:20.802910] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NC took 0.3s. Estimated remaining: 11m 10s. Rate: 81.7 symbols/min [2025-09-28T02:20:20.997497] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:21.045365] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-28T02:20:21.085402] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-28T02:20:21.083539] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:21.097322] [DEBUG] [LOCAL ] NCA: Loaded 10178 existing records from primary storage. [2025-09-28T02:20:21.097764] [INFO ] [MAIN ] NCA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:21.097877] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NCA took 0.4s. Estimated remaining: 11m 9s. Rate: 81.8 symbols/min [2025-09-28T02:20:21.247015] [DEBUG] [LOCAL ] NCDL: Loaded 21828 existing records from primary storage. [2025-09-28T02:20:21.258187] [INFO ] [MAIN ] NCDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:21.263469] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NCDL took 0.5s. Estimated remaining: 11m 8s. Rate: 81.8 symbols/min [2025-09-28T02:20:21.446933] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:21.533836] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:21.575952] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-28T02:20:21.576630] [DEBUG] [LOCAL ] NCV: Loaded 13602 existing records from primary storage. [2025-09-28T02:20:21.578499] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-28T02:20:21.579268] [INFO ] [MAIN ] NCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:21.580492] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCV took 0.3s. Estimated remaining: 11m 7s. Rate: 81.8 symbols/min [2025-09-28T02:20:21.693208] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-09-28T02:20:21.713395] [INFO ] [MAIN ] NCLH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:21.713589] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCLH took 0.6s. Estimated remaining: 11m 6s. Rate: 81.9 symbols/min [2025-09-28T02:20:21.893737] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:21.936057] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-28T02:20:21.958990] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-28T02:20:22.039139] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:22.046351] [DEBUG] [LOCAL ] NCZ: Loaded 11998 existing records from primary storage. [2025-09-28T02:20:22.046972] [INFO ] [MAIN ] NCZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:22.047091] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCZ took 0.5s. Estimated remaining: 11m 5s. Rate: 81.9 symbols/min [2025-09-28T02:20:22.165391] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-28T02:20:22.182984] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-28T02:20:22.195767] [DEBUG] [LOCAL ] NDMO: Loaded 16978 existing records from primary storage. [2025-09-28T02:20:22.206527] [INFO ] [MAIN ] NDMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:22.228074] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NDMO took 0.5s. Estimated remaining: 11m 4s. Rate: 82.0 symbols/min [2025-09-28T02:20:22.257627] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:22.447711] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:22.488489] [DEBUG] [LOCAL ] NE: Loaded 53157 existing records from primary storage. [2025-09-28T02:20:22.488927] [INFO ] [MAIN ] NE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:22.489033] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. NE took 0.4s. Estimated remaining: 11m 3s. Rate: 82.0 symbols/min [2025-09-28T02:20:22.699689] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:22.701116] [DEBUG] [LOCAL ] NEA: Loaded 35808 existing records from primary storage. [2025-09-28T02:20:22.701408] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-09-28T02:20:22.701806] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-09-28T02:20:22.702165] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-28T02:20:22.701994] [INFO ] [MAIN ] NEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:22.702262] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-28T02:20:22.702811] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NEA took 0.5s. Estimated remaining: 11m 2s. Rate: 82.0 symbols/min [2025-09-28T02:20:22.702961] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-09-28T02:20:22.708514] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-28T02:20:22.759011] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-28T02:20:22.809235] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-28T02:20:23.086232] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:23.128075] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-09-28T02:20:23.168817] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-09-28T02:20:23.226020] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-28T02:20:23.256302] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-28T02:20:23.272233] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-09-28T02:20:23.336442] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:23.337020] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-28T02:20:23.336758] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-28T02:20:23.432857] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-28T02:20:23.479516] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-28T02:20:23.473498] [INFO ] [REMOTE ] MXE: Full fetch complete (2667 records). [2025-09-28T02:20:23.486839] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-28T02:20:23.503540] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-28T02:20:23.957105] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:20:23.981827] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:23.982001] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:20:23.982312] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-28T02:20:23.983322] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:20:23.983419] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-28T02:20:23.983541] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-28T02:20:23.983626] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-28T02:20:23.983733] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-28T02:20:23.983837] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. MXE took 8.5s. Estimated remaining: 11m 2s. Rate: 82.0 symbols/min [2025-09-28T02:20:24.170905] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:24.233936] [DEBUG] [LOCAL ] NET: Loaded 53808 existing records from primary storage. [2025-09-28T02:20:24.234389] [INFO ] [MAIN ] NET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:24.235325] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NET took 0.3s. Estimated remaining: 11m 1s. Rate: 82.0 symbols/min [2025-09-28T02:20:24.435013] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:24.447217] [DEBUG] [LOCAL ] NEU: Loaded 8259 existing records from primary storage. [2025-09-28T02:20:24.447558] [INFO ] [MAIN ] NEU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:24.447690] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEU took 0.2s. Estimated remaining: 10m 60s. Rate: 82.1 symbols/min [2025-09-28T02:20:24.657009] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:24.663392] [DEBUG] [LOCAL ] NEUE: Loaded 2271 existing records from primary storage. [2025-09-28T02:20:24.663765] [INFO ] [MAIN ] NEUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:24.663892] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEUE took 0.2s. Estimated remaining: 10m 58s. Rate: 82.1 symbols/min [2025-09-28T02:20:24.881250] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:24.903389] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-28T02:20:24.911034] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-28T02:20:24.914114] [DEBUG] [LOCAL ] NEXA: Loaded 4307 existing records from primary storage. [2025-09-28T02:20:24.914759] [INFO ] [MAIN ] NEXA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:24.915583] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEXA took 0.3s. Estimated remaining: 10m 57s. Rate: 82.1 symbols/min [2025-09-28T02:20:25.122146] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:25.163266] [DEBUG] [LOCAL ] NFG: Loaded 39084 existing records from primary storage. [2025-09-28T02:20:25.163637] [INFO ] [MAIN ] NFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:25.164346] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NFG took 0.2s. Estimated remaining: 10m 56s. Rate: 82.2 symbols/min [2025-09-28T02:20:25.353557] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:25.377672] [DEBUG] [LOCAL ] NFJ: Loaded 20592 existing records from primary storage. [2025-09-28T02:20:25.378043] [INFO ] [MAIN ] NFJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:25.378170] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NFJ took 0.2s. Estimated remaining: 10m 55s. Rate: 82.2 symbols/min [2025-09-28T02:20:25.599684] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:25.621558] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-28T02:20:25.633306] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-28T02:20:25.681202] [DEBUG] [LOCAL ] NGG: Loaded 46809 existing records from primary storage. [2025-09-28T02:20:25.681590] [INFO ] [MAIN ] NGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:25.682368] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NGG took 0.3s. Estimated remaining: 10m 54s. Rate: 82.2 symbols/min [2025-09-28T02:20:25.879331] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:25.914460] [DEBUG] [LOCAL ] NGL: Loaded 30754 existing records from primary storage. [2025-09-28T02:20:25.914902] [INFO ] [MAIN ] NGL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:25.915520] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NGL took 0.2s. Estimated remaining: 10m 53s. Rate: 82.3 symbols/min [2025-09-28T02:20:26.096548] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-28T02:20:26.136743] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:26.138053] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-28T02:20:26.179783] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-28T02:20:26.191819] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-28T02:20:26.197250] [DEBUG] [LOCAL ] NGS: Loaded 11682 existing records from primary storage. [2025-09-28T02:20:26.198439] [INFO ] [MAIN ] NGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:26.198573] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NGS took 0.3s. Estimated remaining: 10m 52s. Rate: 82.3 symbols/min [2025-09-28T02:20:26.383211] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:26.406339] [DEBUG] [LOCAL ] NGVC: Loaded 22650 existing records from primary storage. [2025-09-28T02:20:26.406710] [INFO ] [MAIN ] NGVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:26.406819] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGVC took 0.2s. Estimated remaining: 10m 51s. Rate: 82.4 symbols/min [2025-09-28T02:20:27.312807] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-28T02:20:27.319977] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-28T02:20:27.811438] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-28T02:20:27.823511] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-28T02:20:28.127678] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-28T02:20:28.139439] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-28T02:20:28.455429] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-28T02:20:28.461235] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-28T02:20:29.514366] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-28T02:20:29.525213] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-28T02:20:29.593213] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-28T02:20:29.599335] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-28T02:20:30.043329] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-28T02:20:30.053935] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-28T02:20:30.375784] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-28T02:20:30.381317] [INFO ] [REMOTE ] MYE: Full fetch complete (36641 records). [2025-09-28T02:20:30.381464] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-28T02:20:30.790303] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-28T02:20:30.790418] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-28T02:20:30.790990] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-28T02:20:30.791086] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-28T02:20:30.792030] [DEBUG] [LOCAL ] MYE: Trimmed 36641 records to 25346 (keeping 200 days of data) [2025-09-28T02:20:30.951040] [DEBUG] [LOCAL ] MYE: Primary data saved (25346 records). [2025-09-28T02:20:30.951208] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-28T02:20:30.951328] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. MYE took 14.4s. Estimated remaining: 10m 53s. Rate: 82.1 symbols/min [2025-09-28T02:20:31.244421] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-28T02:20:31.256208] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-28T02:20:32.266031] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-28T02:20:32.278581] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-28T02:20:32.924975] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-28T02:20:32.938400] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-28T02:20:34.692856] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-28T02:20:34.705564] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-28T02:20:35.107964] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-28T02:20:35.120763] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-28T02:20:36.686552] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-28T02:20:36.698351] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-28T02:20:37.296791] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-28T02:20:37.308268] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-28T02:20:38.550238] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-28T02:20:38.562528] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-28T02:20:39.464008] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-28T02:20:39.477533] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-28T02:20:40.664819] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-28T02:20:40.677081] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-28T02:20:42.014672] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-09-28T02:20:42.028600] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-28T02:20:42.978886] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-28T02:20:42.991137] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-28T02:20:44.275162] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-28T02:20:44.285986] [INFO ] [REMOTE ] NEE: Full fetch complete (77759 records). [2025-09-28T02:20:44.286174] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-28T02:20:44.730079] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-28T02:20:44.730231] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-28T02:20:44.731170] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-28T02:20:44.731261] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-28T02:20:44.733084] [DEBUG] [LOCAL ] NEE: Trimmed 77759 records to 54487 (keeping 200 days of data) [2025-09-28T02:20:45.098820] [DEBUG] [LOCAL ] NEE: Primary data saved (54487 records). [2025-09-28T02:20:45.099028] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-28T02:20:45.099148] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NEE took 22.6s. Estimated remaining: 11m 0s. Rate: 81.1 symbols/min [2025-09-28T02:20:45.476204] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-28T02:20:45.487089] [INFO ] [REMOTE ] NEM: Full fetch complete (77749 records). [2025-09-28T02:20:45.487283] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-28T02:20:45.917145] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-28T02:20:45.917328] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-28T02:20:45.918306] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-28T02:20:45.918394] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-28T02:20:45.920241] [DEBUG] [LOCAL ] NEM: Trimmed 77749 records to 54488 (keeping 200 days of data) [2025-09-28T02:20:46.256057] [DEBUG] [LOCAL ] NEM: Primary data saved (54488 records). [2025-09-28T02:20:46.256246] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-28T02:20:46.256368] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NEM took 23.6s. Estimated remaining: 10m 60s. Rate: 81.0 symbols/min [2025-09-28T02:20:46.914551] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:47.003842] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:47.021840] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-09-28T02:20:47.055465] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-09-28T02:20:47.125612] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:47.104598] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:47.128718] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-28T02:20:47.128921] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-28T02:20:47.132508] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-28T02:20:47.132618] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-28T02:20:47.242806] [DEBUG] [LOCAL ] NIC: Loaded 9026 existing records from primary storage. [2025-09-28T02:20:47.261365] [INFO ] [MAIN ] NIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:47.273763] [DEBUG] [LOCAL ] NGVT: Loaded 24631 existing records from primary storage. [2025-09-28T02:20:47.279784] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NIC took 1.0s. Estimated remaining: 10m 59s. Rate: 81.0 symbols/min [2025-09-28T02:20:47.290959] [DEBUG] [LOCAL ] NHI: Loaded 22283 existing records from primary storage. [2025-09-28T02:20:47.284811] [INFO ] [MAIN ] NGVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:47.324259] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NGVT took 1.1s. Estimated remaining: 10m 58s. Rate: 81.1 symbols/min [2025-09-28T02:20:47.355210] [INFO ] [MAIN ] NHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:47.393809] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NHI took 1.1s. Estimated remaining: 10m 57s. Rate: 81.1 symbols/min [2025-09-28T02:20:47.970299] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:48.129290] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:48.197859] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:48.214877] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:48.224317] [DEBUG] [LOCAL ] NIM: Loaded 4149 existing records from primary storage. [2025-09-28T02:20:48.219030] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-28T02:20:48.225022] [DEBUG] [LOCAL ] NIE: Loaded 11869 existing records from primary storage. [2025-09-28T02:20:48.225560] [INFO ] [MAIN ] NIE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:48.226922] [INFO ] [MAIN ] NIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:48.227060] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NIE took 0.9s. Estimated remaining: 10m 56s. Rate: 81.1 symbols/min [2025-09-28T02:20:48.251054] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIM took 0.9s. Estimated remaining: 10m 55s. Rate: 81.2 symbols/min [2025-09-28T02:20:48.471253] [DEBUG] [LOCAL ] NINE: Loaded 28624 existing records from primary storage. [2025-09-28T02:20:48.522517] [INFO ] [MAIN ] NINE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:48.526983] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NINE took 1.1s. Estimated remaining: 10m 54s. Rate: 81.2 symbols/min [2025-09-28T02:20:48.576244] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:48.720851] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:48.751467] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-28T02:20:48.763522] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-28T02:20:48.780731] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-28T02:20:48.789510] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-28T02:20:48.803077] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-28T02:20:48.803218] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-28T02:20:48.964190] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:49.195080] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-09-28T02:20:49.213681] [INFO ] [MAIN ] NIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:49.228673] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NIO took 1.0s. Estimated remaining: 10m 53s. Rate: 81.2 symbols/min [2025-09-28T02:20:49.493705] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:49.513918] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-28T02:20:49.507867] [DEBUG] [LOCAL ] NJR: Loaded 38739 existing records from primary storage. [2025-09-28T02:20:49.536920] [INFO ] [MAIN ] NJR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:49.552315] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NJR took 1.0s. Estimated remaining: 10m 52s. Rate: 81.2 symbols/min [2025-09-28T02:20:49.593469] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:49.648578] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-28T02:20:49.676106] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-28T02:20:49.700427] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-28T02:20:49.706143] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-28T02:20:49.749507] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-28T02:20:49.782330] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-28T02:20:49.782006] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:49.822456] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:20:49.839128] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-28T02:20:49.877623] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:20:49.893622] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-09-28T02:20:49.914039] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:20:49.914260] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-28T02:20:49.936345] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-28T02:20:49.963366] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-28T02:20:49.975843] [DEBUG] [LOCAL ] NKX: Loaded 13801 existing records from primary storage. [2025-09-28T02:20:50.012635] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-28T02:20:50.051433] [INFO ] [MAIN ] NKX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:50.051747] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NIQ took 1.8s. Estimated remaining: 10m 51s. Rate: 81.2 symbols/min [2025-09-28T02:20:50.080170] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NKX took 0.5s. Estimated remaining: 10m 50s. Rate: 81.3 symbols/min [2025-09-28T02:20:50.635141] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-28T02:20:50.679825] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:50.666309] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:50.700638] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-28T02:20:50.717124] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-28T02:20:50.716823] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-28T02:20:50.715838] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:50.716509] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-28T02:20:50.720340] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-28T02:20:50.720487] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-28T02:20:50.720709] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-28T02:20:50.720816] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-28T02:20:50.852555] [DEBUG] [LOCAL ] NLOP: Loaded 11997 existing records from primary storage. [2025-09-28T02:20:50.864076] [INFO ] [MAIN ] NLOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:50.874565] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NLOP took 0.7s. Estimated remaining: 10m 50s. Rate: 81.3 symbols/min [2025-09-28T02:20:51.270957] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:51.340075] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:51.340557] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-28T02:20:51.393567] [DEBUG] [LOCAL ] NLY: Loaded 54358 existing records from primary storage. [2025-09-28T02:20:51.393989] [INFO ] [MAIN ] NLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:51.394092] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NLY took 0.5s. Estimated remaining: 10m 49s. Rate: 81.3 symbols/min [2025-09-28T02:20:51.576520] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:51.592185] [DEBUG] [LOCAL ] NMAI: Loaded 13181 existing records from primary storage. [2025-09-28T02:20:51.592478] [INFO ] [MAIN ] NMAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:51.592580] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NMAI took 0.2s. Estimated remaining: 10m 48s. Rate: 81.3 symbols/min [2025-09-28T02:20:51.773353] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:51.773601] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-28T02:20:51.773697] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-28T02:20:51.773811] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-28T02:20:51.773883] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-28T02:20:51.773972] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-28T02:20:51.774043] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-28T02:20:52.090959] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-28T02:20:52.108722] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-28T02:20:52.167270] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:52.167623] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-28T02:20:52.391301] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:20:52.392086] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-28T02:20:52.394473] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-28T02:20:52.394625] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:20:52.405526] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-09-28T02:20:52.406112] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-28T02:20:52.406208] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:20:52.407155] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-28T02:20:52.407262] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-28T02:20:52.407348] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-28T02:20:52.407448] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-28T02:20:52.407547] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NMAX took 0.8s. Estimated remaining: 10m 47s. Rate: 81.3 symbols/min [2025-09-28T02:20:52.604747] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:52.624379] [DEBUG] [LOCAL ] NMCO: Loaded 16803 existing records from primary storage. [2025-09-28T02:20:52.624875] [INFO ] [MAIN ] NMCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:52.630340] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-28T02:20:52.630478] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NMCO took 0.2s. Estimated remaining: 10m 46s. Rate: 81.4 symbols/min [2025-09-28T02:20:52.633160] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-28T02:20:52.834384] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:52.844850] [DEBUG] [LOCAL ] NMG: Loaded 7913 existing records from primary storage. [2025-09-28T02:20:52.845214] [INFO ] [MAIN ] NMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:52.845319] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NMG took 0.2s. Estimated remaining: 10m 45s. Rate: 81.4 symbols/min [2025-09-28T02:20:53.032475] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:53.038398] [DEBUG] [LOCAL ] NMI: Loaded 4091 existing records from primary storage. [2025-09-28T02:20:53.038669] [INFO ] [MAIN ] NMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:53.038774] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMI took 0.2s. Estimated remaining: 10m 44s. Rate: 81.5 symbols/min [2025-09-28T02:20:53.228517] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:53.247469] [DEBUG] [LOCAL ] NMM: Loaded 14470 existing records from primary storage. [2025-09-28T02:20:53.247858] [INFO ] [MAIN ] NMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:53.247968] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMM took 0.2s. Estimated remaining: 10m 43s. Rate: 81.5 symbols/min [2025-09-28T02:20:53.310600] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-28T02:20:53.332521] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-28T02:20:53.452225] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:53.488923] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-09-28T02:20:53.501389] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-28T02:20:53.541823] [DEBUG] [LOCAL ] NMR: Loaded 35569 existing records from primary storage. [2025-09-28T02:20:53.542235] [INFO ] [MAIN ] NMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:53.542344] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMR took 0.3s. Estimated remaining: 10m 42s. Rate: 81.5 symbols/min [2025-09-28T02:20:53.729201] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:53.734793] [DEBUG] [LOCAL ] NMS: Loaded 2893 existing records from primary storage. [2025-09-28T02:20:53.735024] [INFO ] [MAIN ] NMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:53.735130] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMS took 0.2s. Estimated remaining: 10m 41s. Rate: 81.6 symbols/min [2025-09-28T02:20:53.939359] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:53.945558] [DEBUG] [LOCAL ] NMT: Loaded 2884 existing records from primary storage. [2025-09-28T02:20:53.945865] [INFO ] [MAIN ] NMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:53.945970] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMT took 0.2s. Estimated remaining: 10m 40s. Rate: 81.6 symbols/min [2025-09-28T02:20:54.037946] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-28T02:20:54.071789] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-28T02:20:54.151430] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:54.182991] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-28T02:20:54.194180] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-28T02:20:54.216778] [DEBUG] [LOCAL ] NMZ: Loaded 21872 existing records from primary storage. [2025-09-28T02:20:54.217143] [INFO ] [MAIN ] NMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:54.217258] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMZ took 0.3s. Estimated remaining: 10m 39s. Rate: 81.6 symbols/min [2025-09-28T02:20:54.406736] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:54.419573] [DEBUG] [LOCAL ] NNI: Loaded 10159 existing records from primary storage. [2025-09-28T02:20:54.419906] [INFO ] [MAIN ] NNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:54.420011] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NNI took 0.2s. Estimated remaining: 10m 38s. Rate: 81.7 symbols/min [2025-09-28T02:20:54.606785] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:54.654776] [DEBUG] [LOCAL ] NNN: Loaded 49151 existing records from primary storage. [2025-09-28T02:20:54.655230] [INFO ] [MAIN ] NNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:54.655334] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NNN took 0.2s. Estimated remaining: 10m 37s. Rate: 81.7 symbols/min [2025-09-28T02:20:54.803358] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-28T02:20:54.828464] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-28T02:20:54.856762] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:54.864575] [DEBUG] [LOCAL ] NNY: Loaded 5750 existing records from primary storage. [2025-09-28T02:20:54.864863] [INFO ] [MAIN ] NNY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:54.864964] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNY took 0.2s. Estimated remaining: 10m 36s. Rate: 81.8 symbols/min [2025-09-28T02:20:55.057932] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:55.076480] [DEBUG] [LOCAL ] NOA: Loaded 16497 existing records from primary storage. [2025-09-28T02:20:55.076927] [INFO ] [MAIN ] NOA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:55.077039] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NOA took 0.2s. Estimated remaining: 10m 35s. Rate: 81.8 symbols/min [2025-09-28T02:20:55.267014] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:55.288872] [DEBUG] [LOCAL ] NOAH: Loaded 20358 existing records from primary storage. [2025-09-28T02:20:55.289219] [INFO ] [MAIN ] NOAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:55.289326] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NOAH took 0.2s. Estimated remaining: 10m 33s. Rate: 81.8 symbols/min [2025-09-28T02:20:55.483248] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:55.489226] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-28T02:20:55.491351] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-28T02:20:55.546807] [DEBUG] [LOCAL ] NOC: Loaded 43141 existing records from primary storage. [2025-09-28T02:20:55.547291] [INFO ] [MAIN ] NOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:55.549061] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NOC took 0.3s. Estimated remaining: 10m 32s. Rate: 81.9 symbols/min [2025-09-28T02:20:55.751046] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:55.795317] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-28T02:20:55.806969] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-28T02:20:55.848202] [DEBUG] [LOCAL ] NOG: Loaded 51932 existing records from primary storage. [2025-09-28T02:20:55.848611] [INFO ] [MAIN ] NOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:55.848745] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOG took 0.3s. Estimated remaining: 10m 32s. Rate: 81.9 symbols/min [2025-09-28T02:20:56.041000] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:56.107266] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-09-28T02:20:56.108028] [INFO ] [MAIN ] NOK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:56.108374] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOK took 0.3s. Estimated remaining: 10m 30s. Rate: 81.9 symbols/min [2025-09-28T02:20:56.243813] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-28T02:20:56.297870] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-28T02:20:56.321687] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:56.323163] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-28T02:20:56.323432] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-28T02:20:56.323627] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-28T02:20:56.323951] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-28T02:20:56.324064] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-28T02:20:56.324218] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-28T02:20:56.474249] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-28T02:20:56.549769] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-28T02:20:56.765313] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:20:56.765715] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-28T02:20:57.060906] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-28T02:20:57.063294] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-28T02:20:57.226726] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-28T02:20:57.228072] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-28T02:20:57.807311] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-28T02:20:57.808355] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-28T02:20:57.832798] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-28T02:20:57.834694] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-28T02:20:58.177923] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-28T02:20:58.179043] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-28T02:20:58.439762] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-28T02:20:58.450765] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-28T02:20:58.619758] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-28T02:20:58.632967] [INFO ] [REMOTE ] NL: Full fetch complete (6922 records). [2025-09-28T02:20:58.652479] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-28T02:20:58.652284] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-28T02:20:58.657636] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-28T02:20:58.696365] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-28T02:20:58.788562] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-28T02:20:58.878793] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:20:58.879105] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:20:58.879202] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:20:58.879311] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-28T02:20:58.879452] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-28T02:20:58.879550] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-28T02:20:58.879690] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-28T02:20:58.879833] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NL took 8.8s. Estimated remaining: 10m 31s. Rate: 81.8 symbols/min [2025-09-28T02:20:59.061438] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:59.107260] [DEBUG] [LOCAL ] NOMD: Loaded 42016 existing records from primary storage. [2025-09-28T02:20:59.107676] [INFO ] [MAIN ] NOMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:59.110304] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NOMD took 0.2s. Estimated remaining: 10m 30s. Rate: 81.8 symbols/min [2025-09-28T02:20:59.210388] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-28T02:20:59.223187] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-28T02:20:59.299500] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:59.346023] [DEBUG] [LOCAL ] NOTE: Loaded 43143 existing records from primary storage. [2025-09-28T02:20:59.346387] [INFO ] [MAIN ] NOTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:59.347072] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOTE took 0.2s. Estimated remaining: 10m 29s. Rate: 81.9 symbols/min [2025-09-28T02:20:59.523419] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:59.583952] [DEBUG] [LOCAL ] NOV: Loaded 53961 existing records from primary storage. [2025-09-28T02:20:59.584364] [INFO ] [MAIN ] NOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:20:59.585003] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NOV took 0.2s. Estimated remaining: 10m 28s. Rate: 81.9 symbols/min [2025-09-28T02:20:59.695208] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-28T02:20:59.700748] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-28T02:20:59.780196] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:20:59.780413] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-09-28T02:20:59.780496] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-09-28T02:20:59.780665] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-28T02:20:59.780743] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-28T02:20:59.780847] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-28T02:20:59.780920] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-28T02:21:00.155500] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-28T02:21:00.163247] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-28T02:21:00.161498] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:21:00.163720] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-28T02:21:00.629837] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-28T02:21:00.643457] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-28T02:21:00.751120] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-28T02:21:00.752325] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-28T02:21:01.323519] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-28T02:21:01.324894] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-28T02:21:01.358353] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-09-28T02:21:01.372036] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-28T02:21:01.807307] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-28T02:21:01.808842] [INFO ] [REMOTE ] NOM: Full fetch complete (1626 records). [2025-09-28T02:21:01.808966] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-28T02:21:02.022029] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-28T02:21:02.022497] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:21:02.022587] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:21:02.022715] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-28T02:21:02.022832] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-28T02:21:02.022915] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-28T02:21:02.023032] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-28T02:21:02.023144] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NOM took 5.9s. Estimated remaining: 10m 28s. Rate: 81.8 symbols/min [2025-09-28T02:21:02.232109] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:02.232839] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-28T02:21:02.233872] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-28T02:21:02.234218] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-28T02:21:02.234345] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-28T02:21:02.234661] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-28T02:21:02.234741] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-28T02:21:02.589207] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-28T02:21:02.646323] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-28T02:21:02.652137] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-28T02:21:02.722669] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:21:02.724183] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-28T02:21:02.724580] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-28T02:21:02.938780] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:21:02.939178] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-28T02:21:02.939346] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:21:02.939437] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-09-28T02:21:02.939508] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:21:02.939586] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-28T02:21:02.939710] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-28T02:21:02.939802] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-28T02:21:02.939897] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-28T02:21:02.939987] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NPB took 0.9s. Estimated remaining: 10m 27s. Rate: 81.8 symbols/min [2025-09-28T02:21:03.134813] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:03.154463] [DEBUG] [LOCAL ] NPCT: Loaded 17114 existing records from primary storage. [2025-09-28T02:21:03.154828] [INFO ] [MAIN ] NPCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:03.154938] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NPCT took 0.2s. Estimated remaining: 10m 26s. Rate: 81.8 symbols/min [2025-09-28T02:21:04.054074] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-28T02:21:04.065849] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-28T02:21:04.461514] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-28T02:21:04.474694] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-28T02:21:05.079601] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-28T02:21:05.089935] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-28T02:21:06.371240] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-28T02:21:06.383346] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-28T02:21:06.691636] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-28T02:21:06.703919] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-28T02:21:06.758285] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-28T02:21:06.768687] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-28T02:21:08.147898] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-28T02:21:08.159131] [INFO ] [REMOTE ] NI: Full fetch complete (77267 records). [2025-09-28T02:21:08.159405] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-28T02:21:08.636341] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-09-28T02:21:08.636609] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-09-28T02:21:08.637758] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-09-28T02:21:08.637929] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-09-28T02:21:08.640084] [DEBUG] [LOCAL ] NI: Trimmed 77267 records to 54201 (keeping 200 days of data) [2025-09-28T02:21:08.774894] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-28T02:21:08.795201] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-28T02:21:09.031379] [DEBUG] [LOCAL ] NI: Primary data saved (54201 records). [2025-09-28T02:21:09.031597] [INFO ] [MAIN ] NI: Full history saved. [2025-09-28T02:21:09.031772] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NI took 22.8s. Estimated remaining: 10m 29s. Rate: 81.4 symbols/min [2025-09-28T02:21:09.161351] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-28T02:21:09.173525] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-28T02:21:11.097974] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-28T02:21:11.109535] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-28T02:21:11.913853] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-28T02:21:11.926350] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-28T02:21:13.624035] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-28T02:21:13.635147] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-28T02:21:14.382063] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-28T02:21:14.394282] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-28T02:21:15.511150] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-28T02:21:15.524251] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-28T02:21:16.735709] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-28T02:21:16.746543] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-28T02:21:16.746805] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-28T02:21:16.957057] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:21:16.957890] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:21:16.957972] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:21:16.958055] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-28T02:21:16.958193] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-28T02:21:16.958276] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-28T02:21:16.958360] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-28T02:21:16.958477] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NKE took 27.7s. Estimated remaining: 10m 32s. Rate: 80.9 symbols/min [2025-09-28T02:21:17.790587] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-28T02:21:17.801627] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-28T02:21:20.035945] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-28T02:21:20.047632] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-28T02:21:22.026017] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-28T02:21:22.035709] [INFO ] [REMOTE ] NOW: Full fetch complete (70754 records). [2025-09-28T02:21:22.035928] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-28T02:21:22.467075] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-09-28T02:21:22.467215] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-09-28T02:21:22.468105] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-09-28T02:21:22.468197] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-09-28T02:21:22.469972] [DEBUG] [LOCAL ] NOW: Trimmed 70754 records to 49444 (keeping 200 days of data) [2025-09-28T02:21:22.823460] [DEBUG] [LOCAL ] NOW: Primary data saved (49444 records). [2025-09-28T02:21:22.823726] [INFO ] [MAIN ] NOW: Full history saved. [2025-09-28T02:21:22.823861] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NOW took 23.2s. Estimated remaining: 10m 34s. Rate: 80.5 symbols/min [2025-09-28T02:21:23.470782] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:23.567935] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:23.558307] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:23.592610] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-28T02:21:23.632271] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:23.635063] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-28T02:21:23.635748] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-28T02:21:23.636019] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-28T02:21:23.636964] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-28T02:21:23.640985] [DEBUG] [LOCAL ] NPK: Loaded 8120 existing records from primary storage. [2025-09-28T02:21:23.641204] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-28T02:21:23.644606] [INFO ] [MAIN ] NPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:23.676728] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPK took 0.9s. Estimated remaining: 10m 33s. Rate: 80.5 symbols/min [2025-09-28T02:21:23.782176] [DEBUG] [LOCAL ] NPFD: Loaded 9814 existing records from primary storage. [2025-09-28T02:21:23.826969] [INFO ] [MAIN ] NPFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:23.855435] [DEBUG] [LOCAL ] NPO: Loaded 13019 existing records from primary storage. [2025-09-28T02:21:23.876347] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPFD took 1.1s. Estimated remaining: 10m 32s. Rate: 80.6 symbols/min [2025-09-28T02:21:23.892411] [INFO ] [MAIN ] NPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:23.921032] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPO took 1.1s. Estimated remaining: 10m 31s. Rate: 80.6 symbols/min [2025-09-28T02:21:24.270994] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:24.531128] [DEBUG] [LOCAL ] NPV: Loaded 5070 existing records from primary storage. [2025-09-28T02:21:24.557280] [INFO ] [MAIN ] NPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:24.556729] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:24.565405] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPV took 0.9s. Estimated remaining: 10m 30s. Rate: 80.6 symbols/min [2025-09-28T02:21:24.617902] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:24.784384] [DEBUG] [LOCAL ] NQP: Loaded 9406 existing records from primary storage. [2025-09-28T02:21:24.806806] [INFO ] [MAIN ] NQP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:24.822911] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:21:24.829282] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-28T02:21:24.828626] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NQP took 0.9s. Estimated remaining: 10m 29s. Rate: 80.7 symbols/min [2025-09-28T02:21:25.054505] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:25.187906] [DEBUG] [LOCAL ] NPWR: Loaded 43857 existing records from primary storage. [2025-09-28T02:21:25.193736] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:25.194465] [INFO ] [MAIN ] NPWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:25.204696] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NPWR took 1.3s. Estimated remaining: 10m 28s. Rate: 80.7 symbols/min [2025-09-28T02:21:25.325298] [DEBUG] [LOCAL ] NREF: Loaded 7957 existing records from primary storage. [2025-09-28T02:21:25.340434] [DEBUG] [LOCAL ] NRDY: Loaded 33402 existing records from primary storage. [2025-09-28T02:21:25.339424] [INFO ] [MAIN ] NREF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:25.340836] [INFO ] [MAIN ] NRDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:25.341347] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NREF took 0.5s. Estimated remaining: 10m 27s. Rate: 80.7 symbols/min [2025-09-28T02:21:25.357273] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NRDY took 0.7s. Estimated remaining: 10m 26s. Rate: 80.8 symbols/min [2025-09-28T02:21:25.527795] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:25.641790] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-09-28T02:21:25.670378] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-09-28T02:21:25.717435] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-28T02:21:25.736928] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-28T02:21:25.811761] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:25.811884] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-28T02:21:25.836053] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-28T02:21:25.835003] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-28T02:21:25.833971] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:25.840576] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-28T02:21:26.011254] [DEBUG] [LOCAL ] NRK: Loaded 19991 existing records from primary storage. [2025-09-28T02:21:26.039135] [INFO ] [MAIN ] NRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:26.099949] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NRK took 0.7s. Estimated remaining: 10m 25s. Rate: 80.8 symbols/min [2025-09-28T02:21:26.125979] [DEBUG] [LOCAL ] NRGV: Loaded 43716 existing records from primary storage. [2025-09-28T02:21:26.154505] [INFO ] [MAIN ] NRGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:26.223225] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRGV took 0.9s. Estimated remaining: 10m 24s. Rate: 80.8 symbols/min [2025-09-28T02:21:26.511074] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:26.584717] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:21:26.610803] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-28T02:21:26.672257] [DEBUG] [LOCAL ] NRP: Loaded 4114 existing records from primary storage. [2025-09-28T02:21:26.677943] [INFO ] [MAIN ] NRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:26.693488] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRP took 0.6s. Estimated remaining: 10m 23s. Rate: 80.8 symbols/min [2025-09-28T02:21:26.827126] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:26.946242] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:26.950035] [DEBUG] [LOCAL ] NRT: Loaded 4994 existing records from primary storage. [2025-09-28T02:21:26.950615] [INFO ] [MAIN ] NRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:26.951076] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRT took 0.6s. Estimated remaining: 10m 22s. Rate: 80.9 symbols/min [2025-09-28T02:21:27.033815] [DEBUG] [LOCAL ] NRUC: Loaded 3136 existing records from primary storage. [2025-09-28T02:21:27.069722] [INFO ] [MAIN ] NRUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:27.076105] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRUC took 0.4s. Estimated remaining: 10m 21s. Rate: 80.9 symbols/min [2025-09-28T02:21:27.196283] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:27.383243] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:27.384845] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-28T02:21:27.385339] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-09-28T02:21:27.392755] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-09-28T02:21:27.393387] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-28T02:21:27.393701] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-28T02:21:27.394772] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-28T02:21:27.394921] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-28T02:21:27.394998] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-28T02:21:27.711506] [DEBUG] [LOCAL ] NSA: Loaded 45528 existing records from primary storage. [2025-09-28T02:21:27.740297] [INFO ] [MAIN ] NSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:27.758531] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NSA took 0.8s. Estimated remaining: 10m 21s. Rate: 80.9 symbols/min [2025-09-28T02:21:27.992502] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:21:28.009473] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-28T02:21:28.073325] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:28.129800] [DEBUG] [LOCAL ] NSP: Loaded 35480 existing records from primary storage. [2025-09-28T02:21:28.130133] [INFO ] [MAIN ] NSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:28.130290] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NSP took 0.4s. Estimated remaining: 10m 20s. Rate: 80.9 symbols/min [2025-09-28T02:21:28.316940] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:28.340865] [DEBUG] [LOCAL ] NTB: Loaded 20927 existing records from primary storage. [2025-09-28T02:21:28.341159] [INFO ] [MAIN ] NTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:28.341292] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NTB took 0.2s. Estimated remaining: 10m 19s. Rate: 81.0 symbols/min [2025-09-28T02:21:28.535378] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:28.536947] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-28T02:21:28.537046] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-28T02:21:28.537281] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-28T02:21:28.537598] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-28T02:21:28.537732] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-28T02:21:28.537820] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-28T02:21:28.750391] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-28T02:21:28.800447] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-28T02:21:28.952551] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-28T02:21:29.003106] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-28T02:21:29.049546] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:21:29.050439] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-28T02:21:29.493950] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-28T02:21:29.494846] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-28T02:21:29.919986] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-28T02:21:29.931009] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-28T02:21:30.109739] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-28T02:21:30.110985] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-28T02:21:30.335211] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-28T02:21:30.344074] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-28T02:21:30.516814] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-28T02:21:30.518202] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-28T02:21:30.851322] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-28T02:21:30.862604] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-28T02:21:30.968719] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-28T02:21:30.969776] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-28T02:21:31.429156] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-28T02:21:31.430638] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-28T02:21:31.823723] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-28T02:21:31.843553] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-28T02:21:31.866605] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-28T02:21:31.875532] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-28T02:21:32.432960] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-28T02:21:32.435550] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-28T02:21:32.566607] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-28T02:21:32.577419] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-28T02:21:32.899235] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-28T02:21:32.900297] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-28T02:21:33.175879] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-28T02:21:33.185791] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-28T02:21:33.249715] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-28T02:21:33.259604] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-28T02:21:33.352744] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-28T02:21:33.353966] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-28T02:21:33.795595] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-28T02:21:33.796790] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-28T02:21:34.251165] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-28T02:21:34.265302] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-28T02:21:34.265003] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-28T02:21:34.266161] [INFO ] [REMOTE ] NTEST: Full fetch complete (1986 records). [2025-09-28T02:21:34.266323] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-28T02:21:34.467886] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-28T02:21:34.468306] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:21:34.468384] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:21:34.468460] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-28T02:21:34.468566] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-28T02:21:34.468665] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-28T02:21:34.468763] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-28T02:21:34.468883] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NTEST took 6.1s. Estimated remaining: 10m 21s. Rate: 80.6 symbols/min [2025-09-28T02:21:34.655545] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:34.693129] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-28T02:21:34.705240] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-28T02:21:34.769922] [DEBUG] [LOCAL ] NTR: Loaded 53356 existing records from primary storage. [2025-09-28T02:21:34.770390] [INFO ] [MAIN ] NTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:34.771550] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTR took 0.3s. Estimated remaining: 10m 20s. Rate: 80.6 symbols/min [2025-09-28T02:21:34.963478] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:34.989557] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-28T02:21:34.999327] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-28T02:21:35.046159] [DEBUG] [LOCAL ] NTST: Loaded 44211 existing records from primary storage. [2025-09-28T02:21:35.046529] [INFO ] [MAIN ] NTST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:35.047197] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NTST took 0.3s. Estimated remaining: 10m 19s. Rate: 80.7 symbols/min [2025-09-28T02:21:35.225020] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:35.283475] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-09-28T02:21:35.283911] [INFO ] [MAIN ] NU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:35.284476] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NU took 0.2s. Estimated remaining: 10m 18s. Rate: 80.7 symbols/min [2025-09-28T02:21:35.460887] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:35.461105] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-28T02:21:35.461176] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-28T02:21:35.461289] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-28T02:21:35.461360] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-28T02:21:35.461441] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-28T02:21:35.461511] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-28T02:21:35.855607] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:21:35.856060] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-28T02:21:36.254359] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-28T02:21:36.266114] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-28T02:21:36.404042] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-28T02:21:36.414201] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-28T02:21:36.761696] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-28T02:21:36.772792] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-28T02:21:37.210462] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-28T02:21:37.221192] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-28T02:21:37.893390] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-28T02:21:37.908942] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-28T02:21:38.294791] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-28T02:21:38.307052] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-28T02:21:38.524282] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-28T02:21:38.535455] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-28T02:21:38.610100] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-28T02:21:38.620984] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-28T02:21:39.218854] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-28T02:21:39.226426] [INFO ] [REMOTE ] NPKI: Full fetch complete (53554 records). [2025-09-28T02:21:39.226603] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-28T02:21:39.436291] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:21:39.436932] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:21:39.437012] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:21:39.437094] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-28T02:21:39.437195] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-28T02:21:39.437269] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-28T02:21:39.437352] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-28T02:21:39.437458] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NPKI took 16.6s. Estimated remaining: 10m 19s. Rate: 80.5 symbols/min [2025-09-28T02:21:39.619904] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:39.671945] [DEBUG] [LOCAL ] NUS: Loaded 37005 existing records from primary storage. [2025-09-28T02:21:39.672452] [INFO ] [MAIN ] NUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:39.672941] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NUS took 0.2s. Estimated remaining: 10m 18s. Rate: 80.5 symbols/min [2025-09-28T02:21:39.860298] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:39.885239] [DEBUG] [LOCAL ] NUV: Loaded 23576 existing records from primary storage. [2025-09-28T02:21:39.885581] [INFO ] [MAIN ] NUV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:39.885732] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NUV took 0.2s. Estimated remaining: 10m 17s. Rate: 80.5 symbols/min [2025-09-28T02:21:40.073203] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:40.104838] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-28T02:21:40.115812] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-28T02:21:40.198952] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-28T02:21:40.200339] [DEBUG] [LOCAL ] NUVB: Loaded 51998 existing records from primary storage. [2025-09-28T02:21:40.211069] [INFO ] [MAIN ] NUVB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:40.211870] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUVB took 0.3s. Estimated remaining: 10m 16s. Rate: 80.6 symbols/min [2025-09-28T02:21:40.217769] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-28T02:21:40.403608] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:40.414499] [DEBUG] [LOCAL ] NUW: Loaded 7512 existing records from primary storage. [2025-09-28T02:21:40.414802] [INFO ] [MAIN ] NUW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:40.414906] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUW took 0.2s. Estimated remaining: 10m 15s. Rate: 80.6 symbols/min [2025-09-28T02:21:40.602728] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:40.639471] [DEBUG] [LOCAL ] NVG: Loaded 27703 existing records from primary storage. [2025-09-28T02:21:40.639875] [INFO ] [MAIN ] NVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:40.640446] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NVG took 0.2s. Estimated remaining: 10m 14s. Rate: 80.6 symbols/min [2025-09-28T02:21:40.798417] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-28T02:21:40.849997] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-28T02:21:40.892703] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:40.935497] [DEBUG] [LOCAL ] NVGS: Loaded 31403 existing records from primary storage. [2025-09-28T02:21:40.935938] [INFO ] [MAIN ] NVGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:40.936047] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NVGS took 0.3s. Estimated remaining: 10m 13s. Rate: 80.7 symbols/min [2025-09-28T02:21:41.173376] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:41.233134] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-09-28T02:21:41.233523] [INFO ] [MAIN ] NVO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:41.234178] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NVO took 0.3s. Estimated remaining: 10m 12s. Rate: 80.7 symbols/min [2025-09-28T02:21:41.419111] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:41.440751] [DEBUG] [LOCAL ] NVR: Loaded 19323 existing records from primary storage. [2025-09-28T02:21:41.441068] [INFO ] [MAIN ] NVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:41.441171] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVR took 0.2s. Estimated remaining: 10m 11s. Rate: 80.7 symbols/min [2025-09-28T02:21:41.636699] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:41.715073] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-28T02:21:41.716457] [DEBUG] [LOCAL ] NVRI: Loaded 39367 existing records from primary storage. [2025-09-28T02:21:41.728777] [INFO ] [MAIN ] NVRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:41.729314] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-28T02:21:41.730125] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVRI took 0.3s. Estimated remaining: 10m 10s. Rate: 80.8 symbols/min [2025-09-28T02:21:41.916158] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:41.987283] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-28T02:21:42.016104] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-28T02:21:42.020450] [DEBUG] [LOCAL ] NVS: Loaded 52338 existing records from primary storage. [2025-09-28T02:21:42.021189] [INFO ] [MAIN ] NVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:42.021941] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVS took 0.3s. Estimated remaining: 10m 9s. Rate: 80.8 symbols/min [2025-09-28T02:21:42.220092] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:42.287579] [DEBUG] [LOCAL ] NVST: Loaded 52381 existing records from primary storage. [2025-09-28T02:21:42.288145] [INFO ] [MAIN ] NVST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:42.288834] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVST took 0.3s. Estimated remaining: 10m 8s. Rate: 80.8 symbols/min [2025-09-28T02:21:42.477029] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:42.531114] [DEBUG] [LOCAL ] NVT: Loaded 52330 existing records from primary storage. [2025-09-28T02:21:42.531564] [INFO ] [MAIN ] NVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:42.532198] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVT took 0.2s. Estimated remaining: 10m 7s. Rate: 80.9 symbols/min [2025-09-28T02:21:42.719890] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:42.775040] [DEBUG] [LOCAL ] NWG: Loaded 52318 existing records from primary storage. [2025-09-28T02:21:42.775430] [INFO ] [MAIN ] NWG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:42.776017] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NWG took 0.2s. Estimated remaining: 10m 6s. Rate: 80.9 symbols/min [2025-09-28T02:21:42.962713] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:42.996401] [DEBUG] [LOCAL ] NWN: Loaded 27222 existing records from primary storage. [2025-09-28T02:21:42.996894] [INFO ] [MAIN ] NWN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:42.997010] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NWN took 0.2s. Estimated remaining: 10m 5s. Rate: 80.9 symbols/min [2025-09-28T02:21:43.211599] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-28T02:21:43.243294] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:43.260196] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-28T02:21:43.297507] [DEBUG] [LOCAL ] NX: Loaded 33894 existing records from primary storage. [2025-09-28T02:21:43.297909] [INFO ] [MAIN ] NX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:43.298474] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NX took 0.3s. Estimated remaining: 10m 4s. Rate: 81.0 symbols/min [2025-09-28T02:21:43.482983] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:43.517098] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-28T02:21:43.520246] [DEBUG] [LOCAL ] NXC: Loaded 4313 existing records from primary storage. [2025-09-28T02:21:43.531581] [INFO ] [MAIN ] NXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:43.531951] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NXC took 0.2s. Estimated remaining: 10m 3s. Rate: 81.0 symbols/min [2025-09-28T02:21:43.532560] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-28T02:21:44.105559] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-28T02:21:44.118416] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-28T02:21:45.009438] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-28T02:21:45.020989] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-28T02:21:45.272479] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-28T02:21:45.282891] [INFO ] [REMOTE ] NSC: Full fetch complete (71082 records). [2025-09-28T02:21:45.283133] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-28T02:21:45.728747] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-09-28T02:21:45.728916] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-09-28T02:21:45.729847] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-09-28T02:21:45.730004] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-09-28T02:21:45.732479] [DEBUG] [LOCAL ] NSC: Trimmed 71082 records to 49879 (keeping 200 days of data) [2025-09-28T02:21:45.762908] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-28T02:21:45.839837] [INFO ] [REMOTE ] NRG: Full fetch complete (76576 records). [2025-09-28T02:21:45.866213] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-28T02:21:46.331831] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-09-28T02:21:46.332913] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-09-28T02:21:46.334269] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-09-28T02:21:46.334616] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-09-28T02:21:46.339533] [DEBUG] [LOCAL ] NRG: Trimmed 76576 records to 53697 (keeping 200 days of data) [2025-09-28T02:21:46.798716] [DEBUG] [LOCAL ] NSC: Primary data saved (49879 records). [2025-09-28T02:21:46.799435] [INFO ] [MAIN ] NSC: Full history saved. [2025-09-28T02:21:46.799958] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NSC took 19.7s. Estimated remaining: 10m 3s. Rate: 80.8 symbols/min [2025-09-28T02:21:46.888998] [DEBUG] [LOCAL ] NRG: Primary data saved (53697 records). [2025-09-28T02:21:46.889171] [INFO ] [MAIN ] NRG: Full history saved. [2025-09-28T02:21:46.889287] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NRG took 21.7s. Estimated remaining: 10m 2s. Rate: 80.9 symbols/min [2025-09-28T02:21:47.061018] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-28T02:21:47.072338] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-28T02:21:49.031269] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-28T02:21:49.042316] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-28T02:21:51.049905] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-28T02:21:51.062046] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-28T02:21:53.032683] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-28T02:21:53.044097] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-28T02:21:55.095748] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-28T02:21:55.106614] [INFO ] [REMOTE ] NUE: Full fetch complete (74902 records). [2025-09-28T02:21:55.106967] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-28T02:21:55.331048] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:21:55.331862] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:21:55.331944] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:21:55.332026] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-28T02:21:55.332168] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-28T02:21:55.332263] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-28T02:21:55.332350] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-28T02:21:55.332503] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NUE took 20.0s. Estimated remaining: 10m 6s. Rate: 80.3 symbols/min [2025-09-28T02:21:56.068937] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:56.110920] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-28T02:21:56.128309] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:56.166787] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:56.155408] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-28T02:21:56.169136] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-28T02:21:56.169904] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-28T02:21:56.170020] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-28T02:21:56.170076] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-28T02:21:56.168730] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:56.296305] [DEBUG] [LOCAL ] NXG: Loaded 10647 existing records from primary storage. [2025-09-28T02:21:56.332795] [INFO ] [MAIN ] NXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:56.344163] [DEBUG] [LOCAL ] NXDT: Loaded 16531 existing records from primary storage. [2025-09-28T02:21:56.344369] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXG took 1.0s. Estimated remaining: 10m 5s. Rate: 80.3 symbols/min [2025-09-28T02:21:56.377325] [INFO ] [MAIN ] NXDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:56.410751] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXDT took 1.1s. Estimated remaining: 10m 4s. Rate: 80.4 symbols/min [2025-09-28T02:21:56.909913] [DEBUG] [LOCAL ] NXE: Loaded 53762 existing records from primary storage. [2025-09-28T02:21:56.937742] [INFO ] [MAIN ] NXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:56.982207] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:57.015165] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXE took 1.7s. Estimated remaining: 10m 3s. Rate: 80.4 symbols/min [2025-09-28T02:21:57.009696] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:57.115409] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:21:57.132159] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-28T02:21:57.145859] [DEBUG] [LOCAL ] NXN: Loaded 2376 existing records from primary storage. [2025-09-28T02:21:57.168290] [INFO ] [MAIN ] NXN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:57.193932] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXN took 0.8s. Estimated remaining: 10m 2s. Rate: 80.4 symbols/min [2025-09-28T02:21:57.334584] [DEBUG] [LOCAL ] NXJ: Loaded 15066 existing records from primary storage. [2025-09-28T02:21:57.380405] [INFO ] [MAIN ] NXJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:57.401112] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXJ took 1.0s. Estimated remaining: 10m 1s. Rate: 80.5 symbols/min [2025-09-28T02:21:57.395487] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:57.416338] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:21:57.479485] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-28T02:21:57.542147] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:21:57.588307] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-09-28T02:21:57.618971] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:57.632587] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:21:57.645545] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-28T02:21:57.677822] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-28T02:21:57.677698] [DEBUG] [LOCAL ] NXP: Loaded 12465 existing records from primary storage. [2025-09-28T02:21:57.702183] [INFO ] [MAIN ] NXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:57.706041] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-28T02:21:57.702407] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXP took 0.7s. Estimated remaining: 10m 0s. Rate: 80.5 symbols/min [2025-09-28T02:21:57.733088] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:57.754567] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-28T02:21:57.766401] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-28T02:21:57.788013] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-28T02:21:57.777438] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXDR took 2.4s. Estimated remaining: 9m 59s. Rate: 80.5 symbols/min [2025-09-28T02:21:57.826929] [DEBUG] [LOCAL ] NXRT: Loaded 19307 existing records from primary storage. [2025-09-28T02:21:57.871753] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-28T02:21:57.854606] [INFO ] [MAIN ] NXRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:57.910638] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NXRT took 0.7s. Estimated remaining: 9m 58s. Rate: 80.6 symbols/min [2025-09-28T02:21:57.910801] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-28T02:21:57.936614] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-28T02:21:58.056287] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-28T02:21:58.170109] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:58.498282] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:58.531799] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:58.543285] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-28T02:21:58.587246] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-28T02:21:58.592764] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-28T02:21:58.631890] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-28T02:21:58.651331] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-28T02:21:58.651921] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-28T02:21:58.860794] [DEBUG] [LOCAL ] NYT: Loaded 50645 existing records from primary storage. [2025-09-28T02:21:58.931087] [INFO ] [MAIN ] NYT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:58.964683] [DEBUG] [LOCAL ] NZF: Loaded 29361 existing records from primary storage. [2025-09-28T02:21:58.975277] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NYT took 1.2s. Estimated remaining: 9m 57s. Rate: 80.6 symbols/min [2025-09-28T02:21:59.011975] [INFO ] [MAIN ] NZF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:59.079218] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NZF took 1.2s. Estimated remaining: 9m 56s. Rate: 80.6 symbols/min [2025-09-28T02:21:59.139754] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:21:59.255800] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-28T02:21:59.609316] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:59.682272] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:21:59.713917] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-28T02:21:59.717917] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:59.740463] [DEBUG] [LOCAL ] OBK: Loaded 16512 existing records from primary storage. [2025-09-28T02:21:59.740860] [INFO ] [MAIN ] OBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:59.740975] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. OBK took 0.6s. Estimated remaining: 9m 55s. Rate: 80.6 symbols/min [2025-09-28T02:21:59.949633] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:21:59.967283] [DEBUG] [LOCAL ] OBDC: Loaded 52426 existing records from primary storage. [2025-09-28T02:21:59.967840] [INFO ] [MAIN ] OBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:21:59.967959] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. OBDC took 0.9s. Estimated remaining: 9m 54s. Rate: 80.6 symbols/min [2025-09-28T02:22:00.167943] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:00.168292] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-28T02:22:00.170616] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-28T02:22:00.191819] [DEBUG] [LOCAL ] OCFT: Loaded 8916 existing records from primary storage. [2025-09-28T02:22:00.192107] [INFO ] [MAIN ] OCFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:00.192193] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OCFT took 0.2s. Estimated remaining: 9m 53s. Rate: 80.7 symbols/min [2025-09-28T02:22:00.321953] [DEBUG] [LOCAL ] OC: Loaded 45369 existing records from primary storage. [2025-09-28T02:22:00.343240] [INFO ] [MAIN ] OC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:00.354374] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OC took 0.6s. Estimated remaining: 9m 52s. Rate: 80.7 symbols/min [2025-09-28T02:22:00.459373] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:00.617824] [DEBUG] [LOCAL ] ODC: Loaded 8633 existing records from primary storage. [2025-09-28T02:22:00.613862] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:00.618307] [INFO ] [MAIN ] ODC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:00.618531] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. ODC took 0.4s. Estimated remaining: 9m 51s. Rate: 80.8 symbols/min [2025-09-28T02:22:00.756086] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-28T02:22:00.757588] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-28T02:22:00.826392] [DEBUG] [LOCAL ] ODV: Loaded 26258 existing records from primary storage. [2025-09-28T02:22:00.846731] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:00.847018] [INFO ] [MAIN ] ODV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:00.847211] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. ODV took 0.5s. Estimated remaining: 9m 50s. Rate: 80.8 symbols/min [2025-09-28T02:22:01.051384] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:01.069824] [DEBUG] [LOCAL ] OEC: Loaded 37689 existing records from primary storage. [2025-09-28T02:22:01.070258] [INFO ] [MAIN ] OEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:01.070472] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. OEC took 0.5s. Estimated remaining: 9m 49s. Rate: 80.8 symbols/min [2025-09-28T02:22:01.221553] [DEBUG] [LOCAL ] OFG: Loaded 22393 existing records from primary storage. [2025-09-28T02:22:01.238058] [INFO ] [MAIN ] OFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:01.248447] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. OFG took 0.4s. Estimated remaining: 9m 48s. Rate: 80.9 symbols/min [2025-09-28T02:22:01.327672] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:01.327892] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-28T02:22:01.403280] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-28T02:22:01.505909] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:01.543708] [DEBUG] [LOCAL ] OGE: Loaded 47046 existing records from primary storage. [2025-09-28T02:22:01.544143] [INFO ] [MAIN ] OGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:01.544309] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OGE took 0.5s. Estimated remaining: 9m 47s. Rate: 80.9 symbols/min [2025-09-28T02:22:01.768332] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:01.772008] [DEBUG] [LOCAL ] OGN: Loaded 53882 existing records from primary storage. [2025-09-28T02:22:01.773160] [INFO ] [MAIN ] OGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:01.773959] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OGN took 0.5s. Estimated remaining: 9m 46s. Rate: 80.9 symbols/min [2025-09-28T02:22:01.992358] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-28T02:22:02.013202] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-28T02:22:01.998374] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:02.015361] [DEBUG] [LOCAL ] OGS: Loaded 34591 existing records from primary storage. [2025-09-28T02:22:02.016563] [INFO ] [MAIN ] OGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:02.016751] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGS took 0.5s. Estimated remaining: 9m 45s. Rate: 81.0 symbols/min [2025-09-28T02:22:02.218936] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:02.264329] [DEBUG] [LOCAL ] OHI: Loaded 52824 existing records from primary storage. [2025-09-28T02:22:02.264926] [INFO ] [MAIN ] OHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:02.265958] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OHI took 0.5s. Estimated remaining: 9m 44s. Rate: 81.0 symbols/min [2025-09-28T02:22:02.448467] [DEBUG] [LOCAL ] OI: Loaded 48011 existing records from primary storage. [2025-09-28T02:22:02.467489] [INFO ] [MAIN ] OI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:02.467806] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OI took 0.5s. Estimated remaining: 9m 43s. Rate: 81.0 symbols/min [2025-09-28T02:22:02.497334] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:02.537396] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-28T02:22:02.590099] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-28T02:22:02.744969] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-09-28T02:22:02.745942] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:02.762105] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-28T02:22:02.746445] [DEBUG] [LOCAL ] OIA: Loaded 14218 existing records from primary storage. [2025-09-28T02:22:02.762775] [INFO ] [MAIN ] OIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:02.763020] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OIA took 0.5s. Estimated remaining: 9m 43s. Rate: 81.1 symbols/min [2025-09-28T02:22:02.971770] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:02.986517] [DEBUG] [LOCAL ] OII: Loaded 43406 existing records from primary storage. [2025-09-28T02:22:02.987013] [INFO ] [MAIN ] OII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:02.987212] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OII took 0.5s. Estimated remaining: 9m 42s. Rate: 81.1 symbols/min [2025-09-28T02:22:03.080950] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-28T02:22:03.108084] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-28T02:22:03.204235] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:03.217957] [DEBUG] [LOCAL ] OIS: Loaded 41135 existing records from primary storage. [2025-09-28T02:22:03.218464] [INFO ] [MAIN ] OIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:03.219280] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OIS took 0.5s. Estimated remaining: 9m 41s. Rate: 81.1 symbols/min [2025-09-28T02:22:03.403337] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:03.403631] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-09-28T02:22:03.403730] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-09-28T02:22:03.403843] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-28T02:22:03.403915] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-28T02:22:03.403998] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-28T02:22:03.404068] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-28T02:22:03.573476] [DEBUG] [LOCAL ] OKE: Loaded 54316 existing records from primary storage. [2025-09-28T02:22:03.610104] [INFO ] [MAIN ] OKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:03.649496] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-28T02:22:03.686188] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OKE took 0.7s. Estimated remaining: 9m 40s. Rate: 81.2 symbols/min [2025-09-28T02:22:03.692848] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-28T02:22:03.994244] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:22:04.010470] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-28T02:22:04.031971] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:04.087521] [DEBUG] [LOCAL ] OLN: Loaded 52512 existing records from primary storage. [2025-09-28T02:22:04.087937] [INFO ] [MAIN ] OLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:04.088039] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OLN took 0.4s. Estimated remaining: 9m 39s. Rate: 81.2 symbols/min [2025-09-28T02:22:04.204936] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-28T02:22:04.209132] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-28T02:22:04.296161] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:04.307998] [DEBUG] [LOCAL ] OLP: Loaded 9963 existing records from primary storage. [2025-09-28T02:22:04.308324] [INFO ] [MAIN ] OLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:04.308469] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OLP took 0.2s. Estimated remaining: 9m 38s. Rate: 81.2 symbols/min [2025-09-28T02:22:04.492712] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:04.546714] [DEBUG] [LOCAL ] OMC: Loaded 54068 existing records from primary storage. [2025-09-28T02:22:04.547117] [INFO ] [MAIN ] OMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:04.547252] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OMC took 0.2s. Estimated remaining: 9m 37s. Rate: 81.2 symbols/min [2025-09-28T02:22:04.666718] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-28T02:22:04.673717] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-28T02:22:04.747486] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:04.793806] [DEBUG] [LOCAL ] OMF: Loaded 46898 existing records from primary storage. [2025-09-28T02:22:04.794162] [INFO ] [MAIN ] OMF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:04.794266] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OMF took 0.2s. Estimated remaining: 9m 36s. Rate: 81.3 symbols/min [2025-09-28T02:22:04.980222] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:05.028760] [DEBUG] [LOCAL ] OMI: Loaded 46583 existing records from primary storage. [2025-09-28T02:22:05.029241] [INFO ] [MAIN ] OMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:05.029363] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OMI took 0.2s. Estimated remaining: 9m 35s. Rate: 81.3 symbols/min [2025-09-28T02:22:05.217511] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:05.220839] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-28T02:22:05.222417] [INFO ] [REMOTE ] NYC: Full fetch complete (1919 records). [2025-09-28T02:22:05.222978] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-28T02:22:05.341570] [DEBUG] [LOCAL ] ONIT: Loaded 7871 existing records from primary storage. [2025-09-28T02:22:05.346602] [INFO ] [MAIN ] ONIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:05.357320] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. ONIT took 0.3s. Estimated remaining: 9m 34s. Rate: 81.3 symbols/min [2025-09-28T02:22:05.494176] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-28T02:22:05.526606] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:22:05.557285] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:22:05.676199] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-28T02:22:05.717768] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:05.717846] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-28T02:22:05.719540] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.96 seconds). [2025-09-28T02:22:05.720227] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-28T02:22:05.720407] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-28T02:22:05.720553] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. NYC took 8.3s. Estimated remaining: 9m 33s. Rate: 81.4 symbols/min [2025-09-28T02:22:05.772223] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-28T02:22:05.934787] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:05.945985] [DEBUG] [LOCAL ] ONL: Loaded 31806 existing records from primary storage. [2025-09-28T02:22:05.946452] [INFO ] [MAIN ] ONL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:05.946560] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. ONL took 0.6s. Estimated remaining: 9m 32s. Rate: 81.4 symbols/min [2025-09-28T02:22:06.132244] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:06.177183] [DEBUG] [LOCAL ] ONON: Loaded 54392 existing records from primary storage. [2025-09-28T02:22:06.177621] [INFO ] [MAIN ] ONON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:06.178251] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. ONON took 0.5s. Estimated remaining: 9m 31s. Rate: 81.4 symbols/min [2025-09-28T02:22:06.193768] [DEBUG] [LOCAL ] ONTF: Loaded 23187 existing records from primary storage. [2025-09-28T02:22:06.225112] [INFO ] [MAIN ] ONTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:06.270931] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONTF took 0.3s. Estimated remaining: 9m 30s. Rate: 81.5 symbols/min [2025-09-28T02:22:06.388541] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:06.440791] [DEBUG] [LOCAL ] ONTO: Loaded 47339 existing records from primary storage. [2025-09-28T02:22:06.441180] [INFO ] [MAIN ] ONTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:06.441771] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONTO took 0.3s. Estimated remaining: 9m 29s. Rate: 81.5 symbols/min [2025-09-28T02:22:06.805943] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-09-28T02:22:06.817754] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-28T02:22:08.040013] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-28T02:22:08.050811] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-28T02:22:09.437902] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-28T02:22:09.449074] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-28T02:22:10.656463] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-28T02:22:10.668367] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-28T02:22:11.628854] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-28T02:22:11.639334] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-28T02:22:12.975961] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-28T02:22:12.988095] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-28T02:22:14.500583] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-28T02:22:14.512978] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-28T02:22:15.635905] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-28T02:22:15.648097] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-28T02:22:17.273150] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-28T02:22:17.284974] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-28T02:22:18.141153] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-28T02:22:18.152928] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-28T02:22:19.811403] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-28T02:22:19.823170] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-28T02:22:20.884035] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-28T02:22:20.897623] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-28T02:22:22.443406] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-28T02:22:22.455073] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-28T02:22:23.597598] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-28T02:22:23.610722] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-28T02:22:25.233336] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-28T02:22:25.245923] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-28T02:22:25.672875] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-28T02:22:25.688814] [INFO ] [REMOTE ] O: Full fetch complete (77559 records). [2025-09-28T02:22:25.689073] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-28T02:22:25.908372] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:22:25.909167] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:22:25.909246] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:22:25.909325] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-28T02:22:25.909445] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-28T02:22:25.909522] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-28T02:22:25.909615] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-28T02:22:25.909757] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. O took 28.0s. Estimated remaining: 9m 37s. Rate: 80.2 symbols/min [2025-09-28T02:22:27.989098] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-28T02:22:28.001231] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-28T02:22:30.897754] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-09-28T02:22:30.910685] [INFO ] [REMOTE ] OKLO: Full fetch complete (77993 records). [2025-09-28T02:22:30.910901] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-28T02:22:31.362240] [DEBUG] [VALIDATOR ] OKLO: All expected trading days are present. [2025-09-28T02:22:31.362560] [DEBUG] [VALIDATOR ] OKLO: Primary data validation passed. [2025-09-28T02:22:31.363516] [INFO ] [MAIN ] OKLO: Fetched primary data is valid. [2025-09-28T02:22:31.363608] [DEBUG] [LOCAL ] OKLO: Saving primary data. [2025-09-28T02:22:31.365422] [DEBUG] [LOCAL ] OKLO: Trimmed 77993 records to 54599 (keeping 200 days of data) [2025-09-28T02:22:31.731989] [DEBUG] [LOCAL ] OKLO: Primary data saved (54599 records). [2025-09-28T02:22:31.732217] [INFO ] [MAIN ] OKLO: Full history saved. [2025-09-28T02:22:31.732609] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. OKLO took 28.5s. Estimated remaining: 9m 39s. Rate: 79.9 symbols/min [2025-09-28T02:22:32.368899] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:32.560591] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:32.593085] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:32.594554] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:32.613182] [DEBUG] [LOCAL ] OPP: Loaded 11678 existing records from primary storage. [2025-09-28T02:22:32.613805] [INFO ] [MAIN ] OPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:32.614121] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPP took 0.9s. Estimated remaining: 9m 38s. Rate: 79.9 symbols/min [2025-09-28T02:22:32.712108] [DEBUG] [LOCAL ] OOMA: Loaded 19260 existing records from primary storage. [2025-09-28T02:22:32.712705] [INFO ] [MAIN ] OOMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:32.740406] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OOMA took 1.0s. Estimated remaining: 9m 37s. Rate: 79.9 symbols/min [2025-09-28T02:22:32.790114] [DEBUG] [LOCAL ] OPAD: Loaded 20793 existing records from primary storage. [2025-09-28T02:22:32.813560] [INFO ] [MAIN ] OPAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:32.928212] [DEBUG] [LOCAL ] OPFI: Loaded 47258 existing records from primary storage. [2025-09-28T02:22:32.927123] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OPAD took 1.2s. Estimated remaining: 9m 36s. Rate: 80.0 symbols/min [2025-09-28T02:22:33.059688] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:33.011309] [INFO ] [MAIN ] OPFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:33.086469] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-28T02:22:33.100693] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPFI took 1.4s. Estimated remaining: 9m 35s. Rate: 80.0 symbols/min [2025-09-28T02:22:33.116399] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-28T02:22:33.192849] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-28T02:22:33.215445] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:33.255259] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-28T02:22:33.330729] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-28T02:22:33.422757] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-28T02:22:33.434043] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:33.627104] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:33.807536] [DEBUG] [LOCAL ] OR: Loaded 46786 existing records from primary storage. [2025-09-28T02:22:33.828866] [INFO ] [MAIN ] OR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:33.835727] [DEBUG] [LOCAL ] ORA: Loaded 33001 existing records from primary storage. [2025-09-28T02:22:33.848827] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. OR took 1.1s. Estimated remaining: 9m 34s. Rate: 80.0 symbols/min [2025-09-28T02:22:33.869753] [INFO ] [MAIN ] ORA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:33.962927] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. ORA took 1.0s. Estimated remaining: 9m 33s. Rate: 80.1 symbols/min [2025-09-28T02:22:34.265053] [DEBUG] [LOCAL ] ORC: Loaded 53083 existing records from primary storage. [2025-09-28T02:22:34.376380] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:22:34.407754] [INFO ] [MAIN ] ORC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:34.413149] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-28T02:22:34.433953] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. ORC took 1.3s. Estimated remaining: 9m 32s. Rate: 80.1 symbols/min [2025-09-28T02:22:34.462922] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:34.460770] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:34.487390] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-28T02:22:34.488193] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-28T02:22:34.480739] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-28T02:22:34.504301] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-28T02:22:34.509729] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-28T02:22:34.504247] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-28T02:22:34.523567] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-28T02:22:34.523470] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-28T02:22:34.556273] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-28T02:22:34.551018] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-28T02:22:34.556430] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-28T02:22:34.556581] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-28T02:22:34.927789] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:35.339510] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-28T02:22:35.474285] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-28T02:22:35.476309] [DEBUG] [LOCAL ] ORN: Loaded 31979 existing records from primary storage. [2025-09-28T02:22:35.493877] [INFO ] [MAIN ] ORN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:35.497946] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:22:35.513997] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-28T02:22:35.508451] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORN took 1.0s. Estimated remaining: 9m 32s. Rate: 80.1 symbols/min [2025-09-28T02:22:35.617516] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:22:35.650556] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-28T02:22:35.774067] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:35.830898] [DEBUG] [LOCAL ] OSCR: Loaded 54502 existing records from primary storage. [2025-09-28T02:22:35.831298] [INFO ] [MAIN ] OSCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:35.832131] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. OSCR took 0.3s. Estimated remaining: 9m 31s. Rate: 80.1 symbols/min [2025-09-28T02:22:36.015707] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:36.015917] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-28T02:22:36.015991] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-28T02:22:36.016109] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-28T02:22:36.016183] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-28T02:22:36.016269] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-28T02:22:36.016339] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-28T02:22:36.301016] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-28T02:22:36.330051] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-28T02:22:36.420342] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:22:36.420750] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-28T02:22:37.024626] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-28T02:22:37.026730] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-28T02:22:37.149182] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-28T02:22:37.159346] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-28T02:22:37.639929] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-28T02:22:37.641713] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-28T02:22:38.138107] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-28T02:22:38.149105] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-28T02:22:38.176019] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-28T02:22:38.178362] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-28T02:22:38.320034] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-28T02:22:38.331754] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-28T02:22:38.718573] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-28T02:22:38.721598] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-28T02:22:38.801372] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-28T02:22:38.811845] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-28T02:22:39.148865] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-28T02:22:39.152039] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-28T02:22:39.316942] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-28T02:22:39.326115] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-28T02:22:39.928392] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-28T02:22:39.931108] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-28T02:22:40.178116] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-28T02:22:40.188613] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-28T02:22:40.449143] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-28T02:22:40.461705] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-28T02:22:40.494204] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-28T02:22:40.503150] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-28T02:22:40.627811] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-28T02:22:40.630047] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-28T02:22:41.422866] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-28T02:22:41.425402] [INFO ] [REMOTE ] OPY: Full fetch complete (10014 records). [2025-09-28T02:22:41.425510] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-28T02:22:41.627436] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:22:41.627962] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:22:41.628093] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:22:41.628172] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-28T02:22:41.628288] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-28T02:22:41.628362] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-28T02:22:41.628443] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-28T02:22:41.628546] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. OPY took 9.0s. Estimated remaining: 9m 33s. Rate: 79.8 symbols/min [2025-09-28T02:22:41.826366] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:41.826588] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-28T02:22:41.826906] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-28T02:22:41.827026] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-28T02:22:41.827099] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-28T02:22:41.827184] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-28T02:22:41.827255] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-28T02:22:42.247580] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:22:42.267600] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-28T02:22:42.271453] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-28T02:22:42.310187] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-28T02:22:42.312412] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-28T02:22:42.322927] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-28T02:22:42.518299] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:22:42.518691] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-28T02:22:42.518802] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:22:42.518900] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-09-28T02:22:42.518990] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:22:42.519090] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-28T02:22:42.519216] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-28T02:22:42.519312] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-28T02:22:42.519423] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-28T02:22:42.519529] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. OTF took 0.9s. Estimated remaining: 9m 32s. Rate: 79.7 symbols/min [2025-09-28T02:22:42.716630] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:42.774052] [DEBUG] [LOCAL ] OTIS: Loaded 53481 existing records from primary storage. [2025-09-28T02:22:42.774445] [INFO ] [MAIN ] OTIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:42.775415] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. OTIS took 0.3s. Estimated remaining: 9m 31s. Rate: 79.8 symbols/min [2025-09-28T02:22:42.962422] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:42.992262] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-28T02:22:43.003315] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-28T02:22:43.052297] [DEBUG] [LOCAL ] OUT: Loaded 48630 existing records from primary storage. [2025-09-28T02:22:43.052733] [INFO ] [MAIN ] OUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:43.053284] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OUT took 0.3s. Estimated remaining: 9m 30s. Rate: 79.8 symbols/min [2025-09-28T02:22:43.231224] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:43.290071] [DEBUG] [LOCAL ] OVV: Loaded 54295 existing records from primary storage. [2025-09-28T02:22:43.290469] [INFO ] [MAIN ] OVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:43.290997] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OVV took 0.2s. Estimated remaining: 9m 29s. Rate: 79.8 symbols/min [2025-09-28T02:22:43.482973] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:43.543084] [DEBUG] [LOCAL ] OWL: Loaded 54335 existing records from primary storage. [2025-09-28T02:22:43.543472] [INFO ] [MAIN ] OWL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:43.544005] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OWL took 0.3s. Estimated remaining: 9m 28s. Rate: 79.9 symbols/min [2025-09-28T02:22:43.740021] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:43.775563] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-28T02:22:43.780105] [DEBUG] [LOCAL ] OWLT: Loaded 9099 existing records from primary storage. [2025-09-28T02:22:43.791099] [INFO ] [MAIN ] OWLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:43.791386] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OWLT took 0.2s. Estimated remaining: 9m 27s. Rate: 79.9 symbols/min [2025-09-28T02:22:43.791786] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-28T02:22:43.987131] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:44.018310] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-28T02:22:44.028704] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-28T02:22:44.060043] [DEBUG] [LOCAL ] OXM: Loaded 33928 existing records from primary storage. [2025-09-28T02:22:44.060401] [INFO ] [MAIN ] OXM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:44.060954] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OXM took 0.3s. Estimated remaining: 9m 26s. Rate: 79.9 symbols/min [2025-09-28T02:22:44.243077] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:44.243301] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-28T02:22:44.243379] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-28T02:22:44.243497] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-28T02:22:44.243571] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-28T02:22:44.243682] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-28T02:22:44.243762] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-28T02:22:44.627834] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:22:44.628195] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-28T02:22:45.292445] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-28T02:22:45.303467] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-28T02:22:45.409767] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-28T02:22:45.421551] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-28T02:22:45.646339] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-28T02:22:45.655843] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-28T02:22:46.595314] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-28T02:22:46.606205] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-28T02:22:46.965245] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-28T02:22:46.977423] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-28T02:22:47.293571] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-28T02:22:47.302838] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-28T02:22:48.011011] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-28T02:22:48.022603] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-28T02:22:48.293014] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-28T02:22:48.304861] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-28T02:22:48.777486] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-28T02:22:48.787327] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-28T02:22:49.288451] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-28T02:22:49.299352] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-28T02:22:49.616125] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-28T02:22:49.626822] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-28T02:22:50.390986] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-28T02:22:50.400855] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-28T02:22:50.436564] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-28T02:22:50.449569] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-28T02:22:51.198694] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-28T02:22:51.208516] [INFO ] [REMOTE ] ORI: Full fetch complete (70200 records). [2025-09-28T02:22:51.208743] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-28T02:22:51.417928] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:22:51.418879] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:22:51.418969] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:22:51.419052] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-28T02:22:51.419159] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-28T02:22:51.419243] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-28T02:22:51.419342] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-28T02:22:51.419457] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. ORI took 17.4s. Estimated remaining: 9m 28s. Rate: 79.5 symbols/min [2025-09-28T02:22:51.671079] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:51.738063] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-28T02:22:51.750267] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-28T02:22:51.767522] [DEBUG] [LOCAL ] PAAS: Loaded 54383 existing records from primary storage. [2025-09-28T02:22:51.768013] [INFO ] [MAIN ] PAAS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:51.768578] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. PAAS took 0.3s. Estimated remaining: 9m 27s. Rate: 79.5 symbols/min [2025-09-28T02:22:51.999241] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:52.016584] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-28T02:22:52.025489] [INFO ] [REMOTE ] OSK: Full fetch complete (61451 records). [2025-09-28T02:22:52.025681] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-28T02:22:52.147073] [DEBUG] [LOCAL ] PAC: Loaded 11725 existing records from primary storage. [2025-09-28T02:22:52.147898] [INFO ] [MAIN ] PAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:52.159982] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. PAC took 0.4s. Estimated remaining: 9m 26s. Rate: 79.6 symbols/min [2025-09-28T02:22:52.374744] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:22:52.390941] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:22:52.441587] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:52.441710] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:22:52.442497] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-28T02:22:52.442590] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-28T02:22:52.442691] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-28T02:22:52.442774] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-28T02:22:52.442882] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. OSK took 16.6s. Estimated remaining: 9m 25s. Rate: 79.6 symbols/min [2025-09-28T02:22:52.657127] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:52.659268] [DEBUG] [LOCAL ] PACK: Loaded 32471 existing records from primary storage. [2025-09-28T02:22:52.659931] [INFO ] [MAIN ] PACK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:52.660520] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PACK took 0.5s. Estimated remaining: 9m 24s. Rate: 79.6 symbols/min [2025-09-28T02:22:52.868254] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:52.913502] [DEBUG] [LOCAL ] PACS: Loaded 34761 existing records from primary storage. [2025-09-28T02:22:52.916810] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-28T02:22:52.929578] [INFO ] [MAIN ] PACS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:52.931281] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PACS took 0.5s. Estimated remaining: 9m 23s. Rate: 79.7 symbols/min [2025-09-28T02:22:52.950964] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-28T02:22:53.068243] [DEBUG] [LOCAL ] PAG: Loaded 22217 existing records from primary storage. [2025-09-28T02:22:53.069065] [INFO ] [MAIN ] PAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:53.079897] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PAG took 0.4s. Estimated remaining: 9m 22s. Rate: 79.7 symbols/min [2025-09-28T02:22:53.228498] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:53.258137] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-09-28T02:22:53.264324] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-09-28T02:22:53.285244] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-28T02:22:53.302240] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-28T02:22:53.310295] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-09-28T02:22:53.316522] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-28T02:22:53.401529] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:53.514144] [DEBUG] [LOCAL ] PAI: Loaded 2758 existing records from primary storage. [2025-09-28T02:22:53.525558] [INFO ] [MAIN ] PAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:22:53.553135] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PAI took 0.5s. Estimated remaining: 9m 22s. Rate: 79.7 symbols/min [2025-09-28T02:22:53.922537] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:22:53.932178] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-28T02:22:53.953106] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:22:53.954148] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-28T02:22:53.954226] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-28T02:22:53.954338] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-28T02:22:53.954411] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-28T02:22:53.954497] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-28T02:22:53.954569] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-28T02:22:54.344599] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:22:54.345155] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-28T02:23:04.623433] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:23:04.623843] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-28T02:23:04.623937] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:23:04.624016] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-09-28T02:23:04.624087] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:23:04.624164] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-28T02:23:04.624296] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-28T02:23:04.624378] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-28T02:23:04.624476] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-28T02:23:04.624564] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PAII took 11.0s. Estimated remaining: 9m 26s. Rate: 79.0 symbols/min [2025-09-28T02:23:04.810845] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:04.840755] [DEBUG] [LOCAL ] PAM: Loaded 28420 existing records from primary storage. [2025-09-28T02:23:04.841118] [INFO ] [MAIN ] PAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:04.841225] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAM took 0.2s. Estimated remaining: 9m 25s. Rate: 79.1 symbols/min [2025-09-28T02:23:05.033946] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:05.069153] [DEBUG] [LOCAL ] PAR: Loaded 33188 existing records from primary storage. [2025-09-28T02:23:05.069499] [INFO ] [MAIN ] PAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:05.070071] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAR took 0.2s. Estimated remaining: 9m 24s. Rate: 79.1 symbols/min [2025-09-28T02:23:05.264103] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:05.316603] [DEBUG] [LOCAL ] PARR: Loaded 49062 existing records from primary storage. [2025-09-28T02:23:05.317050] [INFO ] [MAIN ] PARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:05.317636] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PARR took 0.2s. Estimated remaining: 9m 23s. Rate: 79.1 symbols/min [2025-09-28T02:23:05.512319] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:05.582432] [DEBUG] [LOCAL ] PATH: Loaded 54457 existing records from primary storage. [2025-09-28T02:23:05.582976] [INFO ] [MAIN ] PATH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:05.583614] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PATH took 0.3s. Estimated remaining: 9m 22s. Rate: 79.2 symbols/min [2025-09-28T02:23:05.770730] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:05.795077] [DEBUG] [LOCAL ] PAXS: Loaded 21210 existing records from primary storage. [2025-09-28T02:23:05.795414] [INFO ] [MAIN ] PAXS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:05.795520] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PAXS took 0.2s. Estimated remaining: 9m 21s. Rate: 79.2 symbols/min [2025-09-28T02:23:05.984350] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:06.025552] [DEBUG] [LOCAL ] PAY: Loaded 38892 existing records from primary storage. [2025-09-28T02:23:06.025949] [INFO ] [MAIN ] PAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:06.026547] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PAY took 0.2s. Estimated remaining: 9m 20s. Rate: 79.2 symbols/min [2025-09-28T02:23:06.223971] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:06.266605] [DEBUG] [LOCAL ] PAYC: Loaded 36903 existing records from primary storage. [2025-09-28T02:23:06.267053] [INFO ] [MAIN ] PAYC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:06.267571] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PAYC took 0.2s. Estimated remaining: 9m 19s. Rate: 79.3 symbols/min [2025-09-28T02:23:06.429916] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (12.50 seconds). [2025-09-28T02:23:06.492178] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:06.503778] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-09-28T02:23:06.503625] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-28T02:23:06.503886] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-09-28T02:23:06.504752] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-28T02:23:06.504842] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-28T02:23:06.504952] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-09-28T02:23:06.505044] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-28T02:23:06.908263] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:23:06.909192] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-28T02:23:06.947185] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (14.00 seconds). [2025-09-28T02:23:06.959795] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-28T02:23:07.062025] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (15.31 seconds). [2025-09-28T02:23:07.074531] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-28T02:23:08.231246] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-28T02:23:08.242568] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-28T02:23:08.336620] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-28T02:23:08.343940] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-28T02:23:09.530006] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-28T02:23:09.543019] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-28T02:23:09.581978] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-28T02:23:09.591638] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-28T02:23:09.670775] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-28T02:23:09.683451] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-28T02:23:09.735121] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-28T02:23:09.745989] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-28T02:23:10.976463] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-28T02:23:10.984021] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-28T02:23:11.531385] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-28T02:23:11.542913] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-28T02:23:12.259589] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-28T02:23:12.270073] [INFO ] [REMOTE ] ORCL: Full fetch complete (77532 records). [2025-09-28T02:23:12.300070] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-28T02:23:12.302264] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-28T02:23:12.374986] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-28T02:23:12.537910] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:23:12.538916] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:23:12.539091] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:23:12.539203] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-28T02:23:12.539358] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-28T02:23:12.539592] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-28T02:23:12.563062] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-28T02:23:12.563432] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. ORCL took 38.7s. Estimated remaining: 9m 20s. Rate: 78.9 symbols/min [2025-09-28T02:23:12.571205] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-28T02:23:12.688109] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-28T02:23:12.779424] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:12.814824] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-28T02:23:12.827087] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-28T02:23:12.870710] [DEBUG] [LOCAL ] PBA: Loaded 49665 existing records from primary storage. [2025-09-28T02:23:12.871101] [INFO ] [MAIN ] PBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:12.872215] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PBA took 0.3s. Estimated remaining: 9m 19s. Rate: 79.0 symbols/min [2025-09-28T02:23:13.056135] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:13.115731] [DEBUG] [LOCAL ] PBF: Loaded 53866 existing records from primary storage. [2025-09-28T02:23:13.116147] [INFO ] [MAIN ] PBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:13.116691] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PBF took 0.2s. Estimated remaining: 9m 18s. Rate: 79.0 symbols/min [2025-09-28T02:23:13.298318] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:13.333816] [DEBUG] [LOCAL ] PBH: Loaded 32156 existing records from primary storage. [2025-09-28T02:23:13.334189] [INFO ] [MAIN ] PBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:13.334751] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PBH took 0.2s. Estimated remaining: 9m 17s. Rate: 79.0 symbols/min [2025-09-28T02:23:14.480735] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-28T02:23:14.493005] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-28T02:23:14.573985] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-28T02:23:14.587888] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-28T02:23:14.614216] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-28T02:23:14.624858] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-28T02:23:16.231329] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-28T02:23:16.243575] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-28T02:23:17.052484] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-28T02:23:17.070306] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-28T02:23:17.901212] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-28T02:23:17.920862] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-28T02:23:19.364445] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-28T02:23:19.391195] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-28T02:23:19.418574] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-28T02:23:19.432776] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-28T02:23:19.458748] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (4.83 seconds). [2025-09-28T02:23:19.468616] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-28T02:23:20.818428] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-28T02:23:20.827967] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-28T02:23:21.006687] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-28T02:23:21.017562] [INFO ] [REMOTE ] PAGS: Full fetch complete (76329 records). [2025-09-28T02:23:21.017783] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-28T02:23:21.462322] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-28T02:23:21.462685] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-28T02:23:21.463914] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-28T02:23:21.464210] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-28T02:23:21.476595] [DEBUG] [LOCAL ] PAGS: Trimmed 76329 records to 53447 (keeping 200 days of data) [2025-09-28T02:23:21.495547] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-28T02:23:21.593964] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-28T02:23:21.613123] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-28T02:23:21.942914] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:23:21.956823] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:23:21.962193] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:23:21.962543] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-28T02:23:21.965104] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-28T02:23:21.973577] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-28T02:23:21.974668] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-28T02:23:21.975183] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. OXY took 37.9s. Estimated remaining: 9m 20s. Rate: 78.5 symbols/min [2025-09-28T02:23:22.061623] [DEBUG] [LOCAL ] PAGS: Primary data saved (53447 records). [2025-09-28T02:23:22.061854] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-28T02:23:22.062006] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PAGS took 29.1s. Estimated remaining: 9m 19s. Rate: 78.6 symbols/min [2025-09-28T02:23:22.456745] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-28T02:23:22.467747] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-28T02:23:24.153029] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-28T02:23:24.162938] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-28T02:23:25.787054] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-28T02:23:25.797756] [INFO ] [REMOTE ] PB: Full fetch complete (58162 records). [2025-09-28T02:23:25.797984] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-28T02:23:26.251169] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-28T02:23:26.251398] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-28T02:23:26.252406] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-28T02:23:26.252569] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-28T02:23:26.258792] [DEBUG] [LOCAL ] PB: Trimmed 58162 records to 42025 (keeping 200 days of data) [2025-09-28T02:23:26.538708] [DEBUG] [LOCAL ] PB: Primary data saved (42025 records). [2025-09-28T02:23:26.538873] [INFO ] [MAIN ] PB: Full history saved. [2025-09-28T02:23:26.539104] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. PB took 20.3s. Estimated remaining: 9m 20s. Rate: 78.3 symbols/min [2025-09-28T02:23:27.219315] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:27.365410] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:27.343836] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:27.385557] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:27.426845] [DEBUG] [LOCAL ] PCF: Loaded 8720 existing records from primary storage. [2025-09-28T02:23:27.427516] [INFO ] [MAIN ] PCF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:27.427638] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PCF took 0.9s. Estimated remaining: 9m 19s. Rate: 78.3 symbols/min [2025-09-28T02:23:27.539324] [DEBUG] [LOCAL ] PBT: Loaded 17533 existing records from primary storage. [2025-09-28T02:23:27.581583] [INFO ] [MAIN ] PBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:27.617797] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PBT took 1.1s. Estimated remaining: 9m 18s. Rate: 78.4 symbols/min [2025-09-28T02:23:27.704713] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:27.745385] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-09-28T02:23:27.790269] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-09-28T02:23:27.792037] [DEBUG] [LOCAL ] PBR: Loaded 54492 existing records from primary storage. [2025-09-28T02:23:27.832936] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-28T02:23:27.845610] [INFO ] [MAIN ] PBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:27.845958] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-28T02:23:27.862194] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PBR took 1.3s. Estimated remaining: 9m 17s. Rate: 78.4 symbols/min [2025-09-28T02:23:27.868211] [DEBUG] [LOCAL ] PBI: Loaded 50788 existing records from primary storage. [2025-09-28T02:23:27.879046] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-28T02:23:27.891063] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-28T02:23:27.903140] [INFO ] [MAIN ] PBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:27.924304] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PBI took 1.4s. Estimated remaining: 9m 16s. Rate: 78.4 symbols/min [2025-09-28T02:23:28.023417] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:28.381061] [DEBUG] [LOCAL ] PCM: Loaded 6857 existing records from primary storage. [2025-09-28T02:23:28.437599] [INFO ] [MAIN ] PCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:28.515430] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PCM took 0.9s. Estimated remaining: 9m 15s. Rate: 78.4 symbols/min [2025-09-28T02:23:28.503445] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:28.623398] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:28.986245] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:29.031543] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:23:29.032499] [DEBUG] [LOCAL ] PCN: Loaded 24709 existing records from primary storage. [2025-09-28T02:23:29.033193] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-28T02:23:29.033342] [INFO ] [MAIN ] PCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:29.036968] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCN took 1.2s. Estimated remaining: 9m 14s. Rate: 78.5 symbols/min [2025-09-28T02:23:29.189739] [DEBUG] [LOCAL ] PCQ: Loaded 12298 existing records from primary storage. [2025-09-28T02:23:29.191083] [DEBUG] [LOCAL ] PCOR: Loaded 48849 existing records from primary storage. [2025-09-28T02:23:29.217876] [INFO ] [MAIN ] PCQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:29.212547] [INFO ] [MAIN ] PCOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:29.223240] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCQ took 0.6s. Estimated remaining: 9m 13s. Rate: 78.5 symbols/min [2025-09-28T02:23:29.250446] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PCOR took 1.2s. Estimated remaining: 9m 12s. Rate: 78.5 symbols/min [2025-09-28T02:23:29.292701] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:29.648850] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:29.699277] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:29.699904] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-28T02:23:29.700025] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-28T02:23:29.700242] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-28T02:23:29.700350] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-28T02:23:29.700605] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-28T02:23:29.700736] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-28T02:23:29.822296] [DEBUG] [LOCAL ] PD: Loaded 48580 existing records from primary storage. [2025-09-28T02:23:29.843265] [INFO ] [MAIN ] PD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:29.849323] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PD took 0.8s. Estimated remaining: 9m 11s. Rate: 78.6 symbols/min [2025-09-28T02:23:30.283016] [DEBUG] [LOCAL ] PDI: Loaded 50909 existing records from primary storage. [2025-09-28T02:23:30.333230] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:30.324420] [INFO ] [MAIN ] PDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:30.354888] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PDI took 1.1s. Estimated remaining: 9m 11s. Rate: 78.6 symbols/min [2025-09-28T02:23:30.393089] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:23:30.405501] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-28T02:23:30.629201] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:30.642732] [DEBUG] [LOCAL ] PDM: Loaded 40354 existing records from primary storage. [2025-09-28T02:23:30.643263] [INFO ] [MAIN ] PDM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:30.643427] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PDM took 0.8s. Estimated remaining: 9m 10s. Rate: 78.6 symbols/min [2025-09-28T02:23:30.750632] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-28T02:23:30.764820] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-28T02:23:30.851838] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:30.866382] [DEBUG] [LOCAL ] PDO: Loaded 32146 existing records from primary storage. [2025-09-28T02:23:30.866795] [INFO ] [MAIN ] PDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:30.866935] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDO took 0.5s. Estimated remaining: 9m 9s. Rate: 78.6 symbols/min [2025-09-28T02:23:30.998189] [DEBUG] [LOCAL ] PDS: Loaded 18297 existing records from primary storage. [2025-09-28T02:23:31.025084] [INFO ] [MAIN ] PDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:31.074973] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDS took 0.4s. Estimated remaining: 9m 8s. Rate: 78.7 symbols/min [2025-09-28T02:23:31.079323] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:31.120277] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-28T02:23:31.166879] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-28T02:23:31.243096] [DEBUG] [LOCAL ] PDT: Loaded 17549 existing records from primary storage. [2025-09-28T02:23:31.274246] [INFO ] [MAIN ] PDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:31.305102] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:31.305263] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDT took 0.4s. Estimated remaining: 9m 7s. Rate: 78.7 symbols/min [2025-09-28T02:23:31.453134] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-28T02:23:31.535585] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-28T02:23:31.582399] [DEBUG] [LOCAL ] PDX: Loaded 14514 existing records from primary storage. [2025-09-28T02:23:31.615219] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:31.615814] [INFO ] [MAIN ] PDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:31.616092] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDX took 0.5s. Estimated remaining: 9m 6s. Rate: 78.7 symbols/min [2025-09-28T02:23:31.730181] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-28T02:23:31.732061] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-28T02:23:31.831030] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:31.831305] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-09-28T02:23:31.831397] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-09-28T02:23:31.831544] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-28T02:23:31.831621] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-28T02:23:31.831784] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-28T02:23:31.831868] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-28T02:23:31.960877] [DEBUG] [LOCAL ] PEB: Loaded 51448 existing records from primary storage. [2025-09-28T02:23:31.982261] [INFO ] [MAIN ] PEB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:32.015985] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PEB took 0.7s. Estimated remaining: 9m 5s. Rate: 78.8 symbols/min [2025-09-28T02:23:32.239981] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-28T02:23:32.264445] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-28T02:23:32.372978] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:32.473946] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:23:32.474862] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-28T02:23:32.504759] [DEBUG] [LOCAL ] PEN: Loaded 30842 existing records from primary storage. [2025-09-28T02:23:32.505103] [INFO ] [MAIN ] PEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:32.505206] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PEN took 0.5s. Estimated remaining: 9m 4s. Rate: 78.8 symbols/min [2025-09-28T02:23:32.697889] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:32.700840] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-28T02:23:32.702394] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-28T02:23:32.716297] [DEBUG] [LOCAL ] PEO: Loaded 10999 existing records from primary storage. [2025-09-28T02:23:32.716799] [INFO ] [MAIN ] PEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:32.716909] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEO took 0.2s. Estimated remaining: 9m 3s. Rate: 78.8 symbols/min [2025-09-28T02:23:32.897045] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:32.913664] [DEBUG] [LOCAL ] PERF: Loaded 14231 existing records from primary storage. [2025-09-28T02:23:32.914007] [INFO ] [MAIN ] PERF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:32.914114] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PERF took 0.2s. Estimated remaining: 9m 2s. Rate: 78.8 symbols/min [2025-09-28T02:23:33.080627] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-28T02:23:33.110058] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:33.111662] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-28T02:23:33.112125] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-28T02:23:33.112917] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-28T02:23:33.113041] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-28T02:23:33.113096] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-28T02:23:33.113178] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-28T02:23:33.113249] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-28T02:23:33.510702] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:23:33.511222] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-28T02:23:33.638206] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-28T02:23:33.639894] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-28T02:23:33.675573] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-28T02:23:33.687869] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-28T02:23:33.733939] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:23:33.734260] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-28T02:23:33.734351] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:23:33.734425] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-09-28T02:23:33.734495] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:23:33.734570] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-28T02:23:33.734687] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-28T02:23:33.734765] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-28T02:23:33.734858] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-28T02:23:33.734945] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEW took 0.8s. Estimated remaining: 9m 1s. Rate: 78.8 symbols/min [2025-09-28T02:23:33.933236] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:33.941365] [DEBUG] [LOCAL ] PFD: Loaded 5199 existing records from primary storage. [2025-09-28T02:23:33.941631] [INFO ] [MAIN ] PFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:33.941757] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PFD took 0.2s. Estimated remaining: 9m 0s. Rate: 78.9 symbols/min [2025-09-28T02:23:34.151964] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:34.152442] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-09-28T02:23:34.152560] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-09-28T02:23:34.152853] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-28T02:23:34.152981] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-28T02:23:34.153154] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-28T02:23:34.153297] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-28T02:23:34.310044] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-28T02:23:34.355234] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-28T02:23:34.628074] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:23:34.628942] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-28T02:23:34.631404] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-28T02:23:34.644190] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-28T02:23:34.727962] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-28T02:23:34.729039] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-28T02:23:35.086966] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-28T02:23:35.087847] [INFO ] [REMOTE ] PDCC: Full fetch complete (1345 records). [2025-09-28T02:23:35.087971] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-28T02:23:35.287714] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-28T02:23:35.287914] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:23:35.287987] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:23:35.288065] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-28T02:23:35.288163] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-28T02:23:35.288237] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-28T02:23:35.288359] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-28T02:23:35.288489] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PDCC took 6.0s. Estimated remaining: 8m 60s. Rate: 78.8 symbols/min [2025-09-28T02:23:35.484534] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:35.547379] [DEBUG] [LOCAL ] PFGC: Loaded 47650 existing records from primary storage. [2025-09-28T02:23:35.547783] [INFO ] [MAIN ] PFGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:35.548557] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PFGC took 0.3s. Estimated remaining: 8m 59s. Rate: 78.9 symbols/min [2025-09-28T02:23:35.747972] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:35.782989] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-28T02:23:35.794493] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-28T02:23:35.798547] [DEBUG] [LOCAL ] PFH: Loaded 6911 existing records from primary storage. [2025-09-28T02:23:35.799894] [INFO ] [MAIN ] PFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:35.800003] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PFH took 0.3s. Estimated remaining: 8m 58s. Rate: 78.9 symbols/min [2025-09-28T02:23:35.986258] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:36.001624] [DEBUG] [LOCAL ] PFL: Loaded 13959 existing records from primary storage. [2025-09-28T02:23:36.001898] [INFO ] [MAIN ] PFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:36.002043] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFL took 0.2s. Estimated remaining: 8m 57s. Rate: 78.9 symbols/min [2025-09-28T02:23:36.192817] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:36.241594] [DEBUG] [LOCAL ] PFLT: Loaded 44333 existing records from primary storage. [2025-09-28T02:23:36.242014] [INFO ] [MAIN ] PFLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:36.242818] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFLT took 0.2s. Estimated remaining: 8m 56s. Rate: 79.0 symbols/min [2025-09-28T02:23:36.432004] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:36.467933] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-28T02:23:36.485303] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-28T02:23:36.495629] [DEBUG] [LOCAL ] PFN: Loaded 21992 existing records from primary storage. [2025-09-28T02:23:36.495976] [INFO ] [MAIN ] PFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:36.496078] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFN took 0.3s. Estimated remaining: 8m 55s. Rate: 79.0 symbols/min [2025-09-28T02:23:36.716587] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:36.726130] [DEBUG] [LOCAL ] PFO: Loaded 5948 existing records from primary storage. [2025-09-28T02:23:36.726409] [INFO ] [MAIN ] PFO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:36.726529] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFO took 0.2s. Estimated remaining: 8m 54s. Rate: 79.0 symbols/min [2025-09-28T02:23:36.938927] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:36.977792] [DEBUG] [LOCAL ] PFS: Loaded 36188 existing records from primary storage. [2025-09-28T02:23:36.978126] [INFO ] [MAIN ] PFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:36.978737] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFS took 0.3s. Estimated remaining: 8m 53s. Rate: 79.1 symbols/min [2025-09-28T02:23:37.173474] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:37.207253] [DEBUG] [LOCAL ] PFSI: Loaded 29259 existing records from primary storage. [2025-09-28T02:23:37.207721] [INFO ] [MAIN ] PFSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:37.208266] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFSI took 0.2s. Estimated remaining: 8m 52s. Rate: 79.1 symbols/min [2025-09-28T02:23:37.406992] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:37.407805] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-09-28T02:23:37.407971] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-09-28T02:23:37.408268] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-28T02:23:37.408474] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-28T02:23:37.408815] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-28T02:23:37.408890] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-28T02:23:37.507509] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-09-28T02:23:37.562981] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-28T02:23:37.880871] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:23:37.881859] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-28T02:23:37.917859] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-28T02:23:37.931188] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-28T02:23:38.228916] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-28T02:23:38.239820] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-28T02:23:39.887322] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-28T02:23:39.900402] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-28T02:23:40.045281] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-28T02:23:40.057735] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-28T02:23:40.154272] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-28T02:23:40.191763] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-28T02:23:40.198052] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-28T02:23:40.210414] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-28T02:23:41.849327] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-28T02:23:41.861908] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-28T02:23:41.944338] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-28T02:23:41.955997] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-28T02:23:41.998129] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-28T02:23:42.010112] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-28T02:23:42.078971] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-28T02:23:42.090979] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-28T02:23:43.779286] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-28T02:23:43.813302] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-28T02:23:43.816527] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-28T02:23:43.828482] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-28T02:23:43.893572] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-28T02:23:43.904792] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-28T02:23:44.664952] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-28T02:23:44.677937] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-28T02:23:45.664943] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-28T02:23:45.676611] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-28T02:23:45.723309] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-28T02:23:45.735614] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-28T02:23:46.108184] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-28T02:23:46.119991] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-28T02:23:47.261297] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-28T02:23:47.273807] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-28T02:23:47.448015] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-28T02:23:47.460739] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-28T02:23:47.496921] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-28T02:23:47.510209] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-28T02:23:48.413699] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-28T02:23:48.425796] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-28T02:23:49.168238] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-28T02:23:49.180694] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-28T02:23:49.475509] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-28T02:23:49.486556] [INFO ] [REMOTE ] PCG: Full fetch complete (77735 records). [2025-09-28T02:23:49.486783] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-28T02:23:49.915124] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-09-28T02:23:49.915263] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-09-28T02:23:49.916389] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-09-28T02:23:49.916493] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-09-28T02:23:49.918362] [DEBUG] [LOCAL ] PCG: Trimmed 77735 records to 54498 (keeping 200 days of data) [2025-09-28T02:23:50.295214] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-28T02:23:50.310574] [DEBUG] [LOCAL ] PCG: Primary data saved (54498 records). [2025-09-28T02:23:50.311407] [INFO ] [MAIN ] PCG: Full history saved. [2025-09-28T02:23:50.311668] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PCG took 22.9s. Estimated remaining: 8m 56s. Rate: 78.3 symbols/min [2025-09-28T02:23:50.312180] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-28T02:23:50.491854] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-28T02:23:50.556595] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:50.557891] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-28T02:23:50.564802] [DEBUG] [LOCAL ] PGP: Loaded 5515 existing records from primary storage. [2025-09-28T02:23:50.565092] [INFO ] [MAIN ] PGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:50.565196] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PGP took 0.3s. Estimated remaining: 8m 55s. Rate: 78.4 symbols/min [2025-09-28T02:23:50.750556] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:50.750847] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-09-28T02:23:50.750977] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-09-28T02:23:50.751195] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-28T02:23:50.751270] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-28T02:23:50.751354] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-28T02:23:50.751539] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-28T02:23:51.179945] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-28T02:23:51.231780] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:23:51.231956] [INFO ] [REMOTE ] PEG: Full fetch complete (76677 records). [2025-09-28T02:23:51.232452] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-28T02:23:51.233515] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-28T02:23:51.655060] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-09-28T02:23:51.655219] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-09-28T02:23:51.656369] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-09-28T02:23:51.656461] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-09-28T02:23:51.658362] [DEBUG] [LOCAL ] PEG: Trimmed 76677 records to 53893 (keeping 200 days of data) [2025-09-28T02:23:52.002795] [DEBUG] [LOCAL ] PEG: Primary data saved (53893 records). [2025-09-28T02:23:52.002988] [INFO ] [MAIN ] PEG: Full history saved. [2025-09-28T02:23:52.003128] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PEG took 20.4s. Estimated remaining: 8m 55s. Rate: 78.3 symbols/min [2025-09-28T02:23:52.189417] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:52.238038] [DEBUG] [LOCAL ] PGRE: Loaded 47177 existing records from primary storage. [2025-09-28T02:23:52.238410] [INFO ] [MAIN ] PGRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:52.239081] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PGRE took 0.2s. Estimated remaining: 8m 54s. Rate: 78.4 symbols/min [2025-09-28T02:23:52.443222] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:52.454562] [DEBUG] [LOCAL ] PGZ: Loaded 5440 existing records from primary storage. [2025-09-28T02:23:52.454983] [INFO ] [MAIN ] PGZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:52.455134] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PGZ took 0.2s. Estimated remaining: 8m 53s. Rate: 78.4 symbols/min [2025-09-28T02:23:52.637390] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:52.683769] [DEBUG] [LOCAL ] PH: Loaded 39166 existing records from primary storage. [2025-09-28T02:23:52.684255] [INFO ] [MAIN ] PH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:23:52.684904] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PH took 0.2s. Estimated remaining: 8m 52s. Rate: 78.4 symbols/min [2025-09-28T02:23:52.888406] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:23:52.889252] [DEBUG] [LOCAL ] PHD: No existing data file found in primary storage. [2025-09-28T02:23:52.889535] [WARN ] [MAIN ] PHD: No existing data found, performing full refresh instead. [2025-09-28T02:23:52.889820] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-28T02:23:52.890000] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-28T02:23:52.890129] [DEBUG] [LOCAL ] PHD: No primary data file found to delete. [2025-09-28T02:23:52.890260] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-28T02:23:53.069514] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-28T02:23:53.173763] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-28T02:23:53.398947] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (3.09 seconds). [2025-09-28T02:23:53.395624] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:23:53.409763] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-28T02:23:53.412509] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-28T02:23:53.449307] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-28T02:23:53.460879] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-28T02:23:54.199083] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-28T02:23:54.201519] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-28T02:23:54.780975] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-28T02:23:54.784087] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-28T02:23:55.248455] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-28T02:23:55.259607] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-28T02:23:55.440379] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-28T02:23:55.453796] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-28T02:23:55.514380] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-28T02:23:55.517299] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-28T02:23:55.656090] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-28T02:23:55.668838] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-28T02:23:56.077812] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-28T02:23:56.080490] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-28T02:23:56.894716] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-28T02:23:56.898042] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-28T02:23:57.094916] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-28T02:23:57.107334] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-28T02:23:57.460035] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-28T02:23:57.472587] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-28T02:23:57.618175] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-28T02:23:57.620863] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-28T02:23:58.089166] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-28T02:23:58.101532] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-28T02:23:58.472828] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-28T02:23:58.475419] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-28T02:23:59.330003] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-28T02:23:59.348590] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-28T02:23:59.405503] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-28T02:23:59.410114] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-28T02:23:59.588010] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-28T02:23:59.599247] [INFO ] [REMOTE ] PG: Full fetch complete (77785 records). [2025-09-28T02:23:59.599465] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-28T02:24:00.045850] [DEBUG] [VALIDATOR ] PG: All expected trading days are present. [2025-09-28T02:24:00.046039] [DEBUG] [VALIDATOR ] PG: Primary data validation passed. [2025-09-28T02:24:00.047071] [INFO ] [MAIN ] PG: Fetched primary data is valid. [2025-09-28T02:24:00.047164] [DEBUG] [LOCAL ] PG: Saving primary data. [2025-09-28T02:24:00.049279] [DEBUG] [LOCAL ] PG: Trimmed 77785 records to 54532 (keeping 200 days of data) [2025-09-28T02:24:00.175476] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-28T02:24:00.179960] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-28T02:24:00.428576] [DEBUG] [LOCAL ] PG: Primary data saved (54532 records). [2025-09-28T02:24:00.428791] [INFO ] [MAIN ] PG: Full history saved. [2025-09-28T02:24:00.428921] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PG took 23.2s. Estimated remaining: 8m 54s. Rate: 78.0 symbols/min [2025-09-28T02:24:00.818029] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-09-28T02:24:00.828966] [INFO ] [REMOTE ] PFE: Full fetch complete (77979 records). [2025-09-28T02:24:00.829174] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-28T02:24:01.264709] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present. [2025-09-28T02:24:01.270125] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed. [2025-09-28T02:24:01.277292] [INFO ] [MAIN ] PFE: Fetched primary data is valid. [2025-09-28T02:24:01.278248] [DEBUG] [LOCAL ] PFE: Saving primary data. [2025-09-28T02:24:01.278919] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-28T02:24:01.283326] [INFO ] [REMOTE ] PHD: Full fetch complete (14146 records). [2025-09-28T02:24:01.283561] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-28T02:24:01.360495] [DEBUG] [LOCAL ] PFE: Trimmed 77979 records to 54593 (keeping 200 days of data) [2025-09-28T02:24:01.817396] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-28T02:24:01.818049] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-28T02:24:01.818684] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-28T02:24:01.819312] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-28T02:24:01.821554] [DEBUG] [LOCAL ] PHD: Trimmed 14146 records to 10098 (keeping 200 days of data) [2025-09-28T02:24:01.974045] [DEBUG] [LOCAL ] PHD: Primary data saved (10098 records). [2025-09-28T02:24:02.002114] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-28T02:24:02.002678] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PHD took 9.3s. Estimated remaining: 8m 53s. Rate: 77.9 symbols/min [2025-09-28T02:24:02.143365] [DEBUG] [LOCAL ] PFE: Primary data saved (54593 records). [2025-09-28T02:24:02.143556] [INFO ] [MAIN ] PFE: Full history saved. [2025-09-28T02:24:02.143706] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PFE took 28.2s. Estimated remaining: 8m 52s. Rate: 78.0 symbols/min [2025-09-28T02:24:02.211919] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-28T02:24:02.224405] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-28T02:24:04.241235] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-28T02:24:04.257018] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-28T02:24:06.222391] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-28T02:24:06.233764] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-28T02:24:08.334517] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-28T02:24:08.346868] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-28T02:24:10.293730] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-28T02:24:10.306007] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-28T02:24:12.361267] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-28T02:24:12.374178] [INFO ] [REMOTE ] PGR: Full fetch complete (76604 records). [2025-09-28T02:24:12.374384] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-28T02:24:12.811678] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-09-28T02:24:12.811808] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-09-28T02:24:12.812718] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-09-28T02:24:12.812809] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-09-28T02:24:12.814524] [DEBUG] [LOCAL ] PGR: Trimmed 76604 records to 53757 (keeping 200 days of data) [2025-09-28T02:24:13.165837] [DEBUG] [LOCAL ] PGR: Primary data saved (53757 records). [2025-09-28T02:24:13.166138] [INFO ] [MAIN ] PGR: Full history saved. [2025-09-28T02:24:13.166300] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PGR took 22.6s. Estimated remaining: 8m 56s. Rate: 77.4 symbols/min [2025-09-28T02:24:13.745430] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:13.939486] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:13.938079] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:13.973996] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:14.018682] [DEBUG] [LOCAL ] PHI: Loaded 15230 existing records from primary storage. [2025-09-28T02:24:14.019127] [INFO ] [MAIN ] PHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:14.019406] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHI took 0.8s. Estimated remaining: 8m 55s. Rate: 77.4 symbols/min [2025-09-28T02:24:14.136588] [DEBUG] [LOCAL ] PHIN: Loaded 33541 existing records from primary storage. [2025-09-28T02:24:14.189852] [DEBUG] [LOCAL ] PHK: Loaded 26792 existing records from primary storage. [2025-09-28T02:24:14.190194] [INFO ] [MAIN ] PHIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:14.214255] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHIN took 1.0s. Estimated remaining: 8m 54s. Rate: 77.4 symbols/min [2025-09-28T02:24:14.214467] [DEBUG] [LOCAL ] PHG: Loaded 46835 existing records from primary storage. [2025-09-28T02:24:14.220162] [INFO ] [MAIN ] PHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:14.267354] [INFO ] [MAIN ] PHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:14.283441] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHK took 1.1s. Estimated remaining: 8m 53s. Rate: 77.4 symbols/min [2025-09-28T02:24:14.368611] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:14.389520] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-09-28T02:24:14.352167] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHG took 1.1s. Estimated remaining: 8m 52s. Rate: 77.5 symbols/min [2025-09-28T02:24:14.405037] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-09-28T02:24:14.453083] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-28T02:24:14.558506] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-28T02:24:14.728397] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-28T02:24:14.860015] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-28T02:24:14.879001] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:14.878037] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:14.969262] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:15.107341] [DEBUG] [LOCAL ] PIM: Loaded 4814 existing records from primary storage. [2025-09-28T02:24:15.173796] [INFO ] [MAIN ] PIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:15.189759] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PIM took 0.8s. Estimated remaining: 8m 51s. Rate: 77.5 symbols/min [2025-09-28T02:24:15.392931] [DEBUG] [LOCAL ] PHR: Loaded 38045 existing records from primary storage. [2025-09-28T02:24:15.431937] [DEBUG] [LOCAL ] PII: Loaded 49815 existing records from primary storage. [2025-09-28T02:24:15.442826] [INFO ] [MAIN ] PHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:15.474831] [INFO ] [MAIN ] PII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:15.508689] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PHR took 1.3s. Estimated remaining: 8m 50s. Rate: 77.5 symbols/min [2025-09-28T02:24:15.521240] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:24:15.528321] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PII took 1.2s. Estimated remaining: 8m 49s. Rate: 77.6 symbols/min [2025-09-28T02:24:15.548758] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-28T02:24:15.765902] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:15.999981] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:16.019095] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:16.017262] [DEBUG] [LOCAL ] PINE: Loaded 14365 existing records from primary storage. [2025-09-28T02:24:16.019706] [INFO ] [MAIN ] PINE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:16.020458] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PINE took 0.8s. Estimated remaining: 8m 48s. Rate: 77.6 symbols/min [2025-09-28T02:24:16.151827] [DEBUG] [LOCAL ] PIPR: Loaded 15331 existing records from primary storage. [2025-09-28T02:24:16.152934] [INFO ] [MAIN ] PIPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:16.158774] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PIPR took 0.6s. Estimated remaining: 8m 47s. Rate: 77.6 symbols/min [2025-09-28T02:24:16.321798] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:16.460410] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:16.462098] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-09-28T02:24:16.463251] [INFO ] [MAIN ] PINS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:16.463417] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PINS took 0.9s. Estimated remaining: 8m 46s. Rate: 77.6 symbols/min [2025-09-28T02:24:16.558543] [DEBUG] [LOCAL ] PJT: Loaded 22579 existing records from primary storage. [2025-09-28T02:24:16.598422] [INFO ] [MAIN ] PJT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:16.609734] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PJT took 0.6s. Estimated remaining: 8m 45s. Rate: 77.7 symbols/min [2025-09-28T02:24:16.727666] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:16.838012] [DEBUG] [LOCAL ] PK: Loaded 53626 existing records from primary storage. [2025-09-28T02:24:16.873189] [INFO ] [MAIN ] PK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:16.880687] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PK took 0.7s. Estimated remaining: 8m 44s. Rate: 77.7 symbols/min [2025-09-28T02:24:16.924731] [DEBUG] [LOCAL ] PKE: Loaded 12775 existing records from primary storage. [2025-09-28T02:24:16.934472] [INFO ] [MAIN ] PKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:16.951526] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PKE took 0.5s. Estimated remaining: 8m 43s. Rate: 77.7 symbols/min [2025-09-28T02:24:16.934209] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:17.244887] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:17.308992] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:17.342820] [DEBUG] [LOCAL ] PKG: Loaded 39785 existing records from primary storage. [2025-09-28T02:24:17.343485] [INFO ] [MAIN ] PKG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:17.343689] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PKG took 0.7s. Estimated remaining: 8m 42s. Rate: 77.8 symbols/min [2025-09-28T02:24:17.457353] [DEBUG] [LOCAL ] PKX: Loaded 25141 existing records from primary storage. [2025-09-28T02:24:17.482762] [INFO ] [MAIN ] PKX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:17.468310] [DEBUG] [LOCAL ] PKST: Loaded 19461 existing records from primary storage. [2025-09-28T02:24:17.482997] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKX took 0.5s. Estimated remaining: 8m 41s. Rate: 77.8 symbols/min [2025-09-28T02:24:17.528025] [INFO ] [MAIN ] PKST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:17.569909] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKST took 0.7s. Estimated remaining: 8m 40s. Rate: 77.8 symbols/min [2025-09-28T02:24:17.699887] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:17.961766] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:17.982941] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:18.029200] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-28T02:24:18.042588] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-28T02:24:18.063392] [DEBUG] [LOCAL ] PL: Loaded 53894 existing records from primary storage. [2025-09-28T02:24:18.064099] [INFO ] [MAIN ] PL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:18.064515] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PL took 0.7s. Estimated remaining: 8m 39s. Rate: 77.9 symbols/min [2025-09-28T02:24:18.317413] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:18.335758] [DEBUG] [LOCAL ] PLNT: Loaded 49144 existing records from primary storage. [2025-09-28T02:24:18.336404] [INFO ] [MAIN ] PLNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:18.337325] [DEBUG] [LOCAL ] PLD: Loaded 54226 existing records from primary storage. [2025-09-28T02:24:18.337585] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PLNT took 0.7s. Estimated remaining: 8m 38s. Rate: 77.9 symbols/min [2025-09-28T02:24:18.338153] [INFO ] [MAIN ] PLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:18.344921] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PLD took 0.9s. Estimated remaining: 8m 37s. Rate: 77.9 symbols/min [2025-09-28T02:24:18.570288] [DEBUG] [LOCAL ] PLOW: Loaded 20792 existing records from primary storage. [2025-09-28T02:24:18.587770] [INFO ] [MAIN ] PLOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:18.643715] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLOW took 0.6s. Estimated remaining: 8m 36s. Rate: 78.0 symbols/min [2025-09-28T02:24:18.725406] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:18.788819] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:18.825690] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-09-28T02:24:18.826122] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-09-28T02:24:18.867015] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-28T02:24:18.872028] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-28T02:24:18.883283] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-28T02:24:18.899103] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-28T02:24:19.009487] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:19.114912] [DEBUG] [LOCAL ] PLYM: Loaded 33884 existing records from primary storage. [2025-09-28T02:24:19.154478] [INFO ] [MAIN ] PLYM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:19.200368] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLYM took 0.9s. Estimated remaining: 8m 36s. Rate: 78.0 symbols/min [2025-09-28T02:24:19.327910] [DEBUG] [LOCAL ] PML: Loaded 20999 existing records from primary storage. [2025-09-28T02:24:19.428089] [INFO ] [MAIN ] PML: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:19.438670] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PML took 0.8s. Estimated remaining: 8m 35s. Rate: 78.0 symbols/min [2025-09-28T02:24:19.631710] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:24:19.713734] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:19.719300] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-28T02:24:19.815199] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:19.825237] [DEBUG] [LOCAL ] PMM: Loaded 10760 existing records from primary storage. [2025-09-28T02:24:19.825549] [INFO ] [MAIN ] PMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:19.825701] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PMM took 0.6s. Estimated remaining: 8m 34s. Rate: 78.0 symbols/min [2025-09-28T02:24:19.952500] [DEBUG] [LOCAL ] PMO: Loaded 10547 existing records from primary storage. [2025-09-28T02:24:19.969101] [INFO ] [MAIN ] PMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:19.969437] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PMO took 0.5s. Estimated remaining: 8m 33s. Rate: 78.1 symbols/min [2025-09-28T02:24:20.040496] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:20.217220] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:20.217580] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-28T02:24:20.217833] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-28T02:24:20.218057] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-28T02:24:20.218145] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-28T02:24:20.218512] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-28T02:24:20.218920] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-28T02:24:20.306129] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-28T02:24:20.384818] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-28T02:24:20.500420] [DEBUG] [LOCAL ] PMT: Loaded 40798 existing records from primary storage. [2025-09-28T02:24:20.571352] [INFO ] [MAIN ] PMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:20.604789] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PMT took 0.8s. Estimated remaining: 8m 32s. Rate: 78.1 symbols/min [2025-09-28T02:24:20.840533] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:24:20.874321] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-28T02:24:20.910755] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:20.911089] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-28T02:24:20.911167] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-28T02:24:20.911315] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-28T02:24:20.911394] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-28T02:24:20.911499] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-28T02:24:20.911589] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-28T02:24:21.312456] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-28T02:24:21.316817] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:24:21.318307] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-28T02:24:21.319595] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-28T02:24:21.514992] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-28T02:24:21.527597] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-28T02:24:21.530337] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:24:21.530804] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-28T02:24:21.530895] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:24:21.530989] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-09-28T02:24:21.531122] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:24:21.531204] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-28T02:24:21.531329] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-28T02:24:21.531409] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-28T02:24:21.531538] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-28T02:24:21.531632] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMTV took 0.9s. Estimated remaining: 8m 31s. Rate: 78.1 symbols/min [2025-09-28T02:24:21.677602] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-28T02:24:21.709834] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-28T02:24:21.732090] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:21.732379] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-28T02:24:21.732456] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-28T02:24:21.732576] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-28T02:24:21.732680] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-28T02:24:21.732769] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-28T02:24:21.732841] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-28T02:24:22.135659] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:24:22.136094] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-28T02:24:22.221369] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-28T02:24:22.222544] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-28T02:24:22.274228] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-28T02:24:22.285101] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-28T02:24:22.340449] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:24:22.340972] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-28T02:24:22.341069] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:24:22.341160] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-09-28T02:24:22.341289] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:24:22.341369] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-28T02:24:22.341466] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-28T02:24:22.341542] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-28T02:24:22.341628] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-28T02:24:22.341746] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMTW took 0.8s. Estimated remaining: 8m 30s. Rate: 78.1 symbols/min [2025-09-28T02:24:22.532948] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:22.533172] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-09-28T02:24:22.533245] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-09-28T02:24:22.533360] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-28T02:24:22.533431] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-28T02:24:22.533513] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-28T02:24:22.533600] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-28T02:24:22.647975] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-28T02:24:22.660954] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-28T02:24:22.934522] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:24:22.934924] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-28T02:24:23.152633] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-28T02:24:23.153843] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-28T02:24:23.517759] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-28T02:24:23.518878] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-28T02:24:23.599341] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-28T02:24:23.611303] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-28T02:24:23.885769] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-28T02:24:23.887165] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-28T02:24:24.127950] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-28T02:24:24.139727] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-28T02:24:24.160571] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-28T02:24:24.161814] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-28T02:24:24.419115] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-28T02:24:24.420217] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-28T02:24:24.760317] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-28T02:24:24.771415] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-28T02:24:24.945391] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-28T02:24:24.946363] [INFO ] [REMOTE ] PMTU: Full fetch complete (1236 records). [2025-09-28T02:24:24.946466] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-28T02:24:25.141763] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:24:25.142086] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:24:25.142163] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:24:25.142240] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-28T02:24:25.142354] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-28T02:24:25.142431] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-28T02:24:25.142526] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-28T02:24:25.142628] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMTU took 5.1s. Estimated remaining: 8m 30s. Rate: 77.9 symbols/min [2025-09-28T02:24:25.325809] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:25.334771] [DEBUG] [LOCAL ] PNI: Loaded 6782 existing records from primary storage. [2025-09-28T02:24:25.335126] [INFO ] [MAIN ] PNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:25.335252] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PNI took 0.2s. Estimated remaining: 8m 29s. Rate: 78.0 symbols/min [2025-09-28T02:24:25.538229] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:25.573832] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-28T02:24:25.585479] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-28T02:24:25.616854] [DEBUG] [LOCAL ] PNNT: Loaded 33337 existing records from primary storage. [2025-09-28T02:24:25.617386] [INFO ] [MAIN ] PNNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:25.618516] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PNNT took 0.3s. Estimated remaining: 8m 28s. Rate: 78.0 symbols/min [2025-09-28T02:24:25.824045] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:25.824473] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-09-28T02:24:25.824880] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-28T02:24:25.825080] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-28T02:24:25.825242] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-28T02:24:25.825501] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-28T02:24:25.825579] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-28T02:24:25.950808] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-28T02:24:26.004122] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-28T02:24:26.279325] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:24:26.279810] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-28T02:24:26.670609] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-28T02:24:26.682097] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-28T02:24:27.449880] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-28T02:24:27.461911] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-28T02:24:27.703430] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-28T02:24:27.713247] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-28T02:24:28.041791] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-28T02:24:28.053296] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-28T02:24:28.207118] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-28T02:24:28.217676] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-28T02:24:29.415684] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-28T02:24:29.426119] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-28T02:24:29.557165] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-28T02:24:29.601853] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-28T02:24:29.603536] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-28T02:24:29.618471] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-28T02:24:29.862837] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-28T02:24:29.874854] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-28T02:24:30.602007] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-28T02:24:30.612541] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-28T02:24:31.391359] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-28T02:24:31.404413] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-28T02:24:31.621424] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-28T02:24:31.668117] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-28T02:24:31.670335] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-28T02:24:31.683974] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-28T02:24:32.416512] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-28T02:24:32.427715] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-28T02:24:32.934869] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-28T02:24:32.946961] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-28T02:24:33.525971] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-28T02:24:33.558736] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-28T02:24:33.559900] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-28T02:24:33.574635] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-28T02:24:34.116576] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-28T02:24:34.128219] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-28T02:24:34.380164] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-28T02:24:34.392689] [INFO ] [REMOTE ] PHM: Full fetch complete (75030 records). [2025-09-28T02:24:34.392905] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-28T02:24:34.832270] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-09-28T02:24:34.832410] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-09-28T02:24:34.833310] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-09-28T02:24:34.833407] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-09-28T02:24:34.835668] [DEBUG] [LOCAL ] PHM: Trimmed 75030 records to 52386 (keeping 200 days of data) [2025-09-28T02:24:35.193731] [DEBUG] [LOCAL ] PHM: Primary data saved (52386 records). [2025-09-28T02:24:35.194020] [INFO ] [MAIN ] PHM: Full history saved. [2025-09-28T02:24:35.194245] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PHM took 21.2s. Estimated remaining: 8m 31s. Rate: 77.5 symbols/min [2025-09-28T02:24:35.389769] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:35.420142] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-28T02:24:35.431946] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-28T02:24:35.479475] [DEBUG] [LOCAL ] PNW: Loaded 46531 existing records from primary storage. [2025-09-28T02:24:35.479879] [INFO ] [MAIN ] PNW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:35.480754] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNW took 0.3s. Estimated remaining: 8m 30s. Rate: 77.5 symbols/min [2025-09-28T02:24:35.672226] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:35.727150] [DEBUG] [LOCAL ] POR: Loaded 47706 existing records from primary storage. [2025-09-28T02:24:35.727539] [INFO ] [MAIN ] POR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:35.728088] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. POR took 0.2s. Estimated remaining: 8m 29s. Rate: 77.5 symbols/min [2025-09-28T02:24:35.921030] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:35.971353] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-28T02:24:35.997045] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-28T02:24:35.998120] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-28T02:24:36.012145] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-28T02:24:36.043418] [DEBUG] [LOCAL ] POST: Loaded 39494 existing records from primary storage. [2025-09-28T02:24:36.043810] [INFO ] [MAIN ] POST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:36.044347] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. POST took 0.3s. Estimated remaining: 8m 28s. Rate: 77.6 symbols/min [2025-09-28T02:24:36.231474] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:36.287448] [DEBUG] [LOCAL ] PPG: Loaded 51455 existing records from primary storage. [2025-09-28T02:24:36.287856] [INFO ] [MAIN ] PPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:36.288573] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. PPG took 0.2s. Estimated remaining: 8m 27s. Rate: 77.6 symbols/min [2025-09-28T02:24:36.499471] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:36.499759] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-09-28T02:24:36.499837] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-09-28T02:24:36.499954] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-28T02:24:36.500028] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-28T02:24:36.500116] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-28T02:24:36.500185] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-28T02:24:36.888131] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:24:36.888510] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-28T02:24:37.548403] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-28T02:24:37.560843] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-28T02:24:37.588887] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-28T02:24:37.599272] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-28T02:24:38.041007] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-28T02:24:38.053019] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-28T02:24:38.688778] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-28T02:24:38.700770] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-28T02:24:39.421864] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-28T02:24:39.451109] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-28T02:24:39.452678] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-28T02:24:39.465303] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-28T02:24:39.633039] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-28T02:24:39.644327] [INFO ] [REMOTE ] PM: Full fetch complete (77702 records). [2025-09-28T02:24:39.644524] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-28T02:24:40.069576] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-09-28T02:24:40.069722] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-09-28T02:24:40.070623] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-09-28T02:24:40.070731] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-09-28T02:24:40.072394] [DEBUG] [LOCAL ] PM: Trimmed 77702 records to 54445 (keeping 200 days of data) [2025-09-28T02:24:40.426869] [DEBUG] [LOCAL ] PM: Primary data saved (54445 records). [2025-09-28T02:24:40.427050] [INFO ] [MAIN ] PM: Full history saved. [2025-09-28T02:24:40.427170] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. PM took 22.1s. Estimated remaining: 8m 28s. Rate: 77.4 symbols/min [2025-09-28T02:24:40.648682] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:40.654354] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-28T02:24:40.665677] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-28T02:24:40.693449] [DEBUG] [LOCAL ] PPT: Loaded 20342 existing records from primary storage. [2025-09-28T02:24:40.694089] [INFO ] [MAIN ] PPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:40.694197] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. PPT took 0.3s. Estimated remaining: 8m 27s. Rate: 77.4 symbols/min [2025-09-28T02:24:41.032473] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-28T02:24:41.046117] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-28T02:24:41.269742] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-28T02:24:41.280396] [INFO ] [REMOTE ] PNC: Full fetch complete (75498 records). [2025-09-28T02:24:41.280599] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-28T02:24:41.706386] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-09-28T02:24:41.706522] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-09-28T02:24:41.707497] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-09-28T02:24:41.707590] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-09-28T02:24:41.709271] [DEBUG] [LOCAL ] PNC: Trimmed 75498 records to 53000 (keeping 200 days of data) [2025-09-28T02:24:42.068265] [DEBUG] [LOCAL ] PNC: Primary data saved (53000 records). [2025-09-28T02:24:42.068508] [INFO ] [MAIN ] PNC: Full history saved. [2025-09-28T02:24:42.068702] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PNC took 19.7s. Estimated remaining: 8m 26s. Rate: 77.4 symbols/min [2025-09-28T02:24:42.100613] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-28T02:24:42.111597] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-28T02:24:42.689381] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-28T02:24:42.699308] [INFO ] [REMOTE ] PNR: Full fetch complete (69228 records). [2025-09-28T02:24:42.699507] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-28T02:24:43.111814] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present. [2025-09-28T02:24:43.111937] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed. [2025-09-28T02:24:43.112830] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-09-28T02:24:43.112917] [DEBUG] [LOCAL ] PNR: Saving primary data. [2025-09-28T02:24:43.114619] [DEBUG] [LOCAL ] PNR: Trimmed 69228 records to 48589 (keeping 200 days of data) [2025-09-28T02:24:43.419829] [DEBUG] [LOCAL ] PNR: Primary data saved (48589 records). [2025-09-28T02:24:43.420000] [INFO ] [MAIN ] PNR: Full history saved. [2025-09-28T02:24:43.420159] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PNR took 17.8s. Estimated remaining: 8m 26s. Rate: 77.4 symbols/min [2025-09-28T02:24:43.933552] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-28T02:24:43.945132] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-28T02:24:45.797919] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-28T02:24:45.810996] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-28T02:24:47.663514] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-28T02:24:47.676984] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-28T02:24:49.478562] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-28T02:24:49.489991] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-28T02:24:51.445825] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-28T02:24:51.458346] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-28T02:24:53.088568] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-28T02:24:53.101865] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-28T02:24:54.951720] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-28T02:24:54.962637] [INFO ] [REMOTE ] PPL: Full fetch complete (77415 records). [2025-09-28T02:24:54.962898] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-28T02:24:55.406809] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-09-28T02:24:55.407056] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-09-28T02:24:55.408044] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-09-28T02:24:55.408240] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-09-28T02:24:55.419423] [DEBUG] [LOCAL ] PPL: Trimmed 77415 records to 54285 (keeping 200 days of data) [2025-09-28T02:24:55.781762] [DEBUG] [LOCAL ] PPL: Primary data saved (54285 records). [2025-09-28T02:24:55.781968] [INFO ] [MAIN ] PPL: Full history saved. [2025-09-28T02:24:55.782270] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PPL took 19.5s. Estimated remaining: 8m 29s. Rate: 76.7 symbols/min [2025-09-28T02:24:56.461611] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:56.572130] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:56.571079] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:56.546037] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:56.574557] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-28T02:24:56.574826] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-28T02:24:56.574930] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-28T02:24:56.574977] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-28T02:24:56.575028] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-28T02:24:56.575081] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-28T02:24:56.802690] [DEBUG] [LOCAL ] PRG: Loaded 30420 existing records from primary storage. [2025-09-28T02:24:56.855491] [INFO ] [MAIN ] PRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:56.855765] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRG took 1.1s. Estimated remaining: 8m 29s. Rate: 76.7 symbols/min [2025-09-28T02:24:56.876247] [DEBUG] [LOCAL ] PRA: Loaded 35243 existing records from primary storage. [2025-09-28T02:24:56.894160] [INFO ] [MAIN ] PRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:56.971025] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRA took 1.2s. Estimated remaining: 8m 28s. Rate: 76.7 symbols/min [2025-09-28T02:24:57.093278] [DEBUG] [LOCAL ] PR: Loaded 54389 existing records from primary storage. [2025-09-28T02:24:57.174202] [INFO ] [MAIN ] PR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:57.267445] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PR took 1.5s. Estimated remaining: 8m 27s. Rate: 76.8 symbols/min [2025-09-28T02:24:57.380401] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:24:57.427306] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-28T02:24:57.441522] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:57.520494] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:57.655897] [DEBUG] [LOCAL ] PRH: Loaded 4908 existing records from primary storage. [2025-09-28T02:24:57.672539] [INFO ] [MAIN ] PRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:57.688545] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PRH took 0.6s. Estimated remaining: 8m 26s. Rate: 76.8 symbols/min [2025-09-28T02:24:57.692464] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:57.928406] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:57.937835] [DEBUG] [LOCAL ] PRI: Loaded 18636 existing records from primary storage. [2025-09-28T02:24:57.939896] [DEBUG] [LOCAL ] PRGO: Loaded 47634 existing records from primary storage. [2025-09-28T02:24:57.940545] [INFO ] [MAIN ] PRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:57.941074] [INFO ] [MAIN ] PRGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:57.941310] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRGO took 1.1s. Estimated remaining: 8m 25s. Rate: 76.8 symbols/min [2025-09-28T02:24:57.941773] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRI took 0.6s. Estimated remaining: 8m 24s. Rate: 76.8 symbols/min [2025-09-28T02:24:58.017358] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-28T02:24:58.135837] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-28T02:24:58.312959] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:58.384521] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:58.404807] [DEBUG] [LOCAL ] PRIM: Loaded 45072 existing records from primary storage. [2025-09-28T02:24:58.405883] [INFO ] [MAIN ] PRIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:58.406060] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRIM took 0.7s. Estimated remaining: 8m 23s. Rate: 76.9 symbols/min [2025-09-28T02:24:58.544243] [DEBUG] [LOCAL ] PRLB: Loaded 20919 existing records from primary storage. [2025-09-28T02:24:58.594872] [INFO ] [MAIN ] PRLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:58.594365] [DEBUG] [LOCAL ] PRKS: Loaded 43308 existing records from primary storage. [2025-09-28T02:24:58.651239] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:58.651492] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRLB took 0.7s. Estimated remaining: 8m 22s. Rate: 76.9 symbols/min [2025-09-28T02:24:58.652170] [INFO ] [MAIN ] PRKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:58.658382] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRKS took 0.7s. Estimated remaining: 8m 21s. Rate: 76.9 symbols/min [2025-09-28T02:24:58.741311] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-28T02:24:58.794487] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-28T02:24:58.999727] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:59.061509] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:59.090068] [DEBUG] [LOCAL ] PRM: Loaded 45298 existing records from primary storage. [2025-09-28T02:24:59.091720] [INFO ] [MAIN ] PRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:59.092092] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRM took 0.7s. Estimated remaining: 8m 20s. Rate: 77.0 symbols/min [2025-09-28T02:24:59.330412] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:24:59.334696] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-28T02:24:59.335160] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-28T02:24:59.351338] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-28T02:24:59.351536] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-28T02:24:59.351845] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-28T02:24:59.356442] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-28T02:24:59.356269] [DEBUG] [LOCAL ] PRO: Loaded 38444 existing records from primary storage. [2025-09-28T02:24:59.353229] [DEBUG] [LOCAL ] PRMB: Loaded 53928 existing records from primary storage. [2025-09-28T02:24:59.379907] [INFO ] [MAIN ] PRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:59.390674] [INFO ] [MAIN ] PRMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:24:59.417148] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-28T02:24:59.434280] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRO took 0.8s. Estimated remaining: 8m 19s. Rate: 77.0 symbols/min [2025-09-28T02:24:59.447287] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-28T02:24:59.466756] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRMB took 0.8s. Estimated remaining: 8m 18s. Rate: 77.0 symbols/min [2025-09-28T02:25:00.133398] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:00.127027] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:00.139095] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-28T02:25:00.153911] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-28T02:25:00.244621] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:25:00.248402] [DEBUG] [LOCAL ] PRT: Loaded 5402 existing records from primary storage. [2025-09-28T02:25:00.249310] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-28T02:25:00.249583] [INFO ] [MAIN ] PRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:00.250844] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRT took 0.8s. Estimated remaining: 8m 17s. Rate: 77.0 symbols/min [2025-09-28T02:25:00.465294] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:00.482846] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-28T02:25:00.484043] [DEBUG] [LOCAL ] PRU: Loaded 52204 existing records from primary storage. [2025-09-28T02:25:00.484111] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-28T02:25:00.484487] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-28T02:25:00.484582] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-28T02:25:00.484803] [INFO ] [MAIN ] PRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:00.484937] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-28T02:25:00.485118] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-28T02:25:00.485015] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRU took 1.0s. Estimated remaining: 8m 16s. Rate: 77.1 symbols/min [2025-09-28T02:25:00.866862] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:01.090934] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:25:01.105134] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-28T02:25:01.124733] [DEBUG] [LOCAL ] PSA: Loaded 42474 existing records from primary storage. [2025-09-28T02:25:01.125212] [INFO ] [MAIN ] PSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:01.125364] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PSA took 0.6s. Estimated remaining: 8m 15s. Rate: 77.1 symbols/min [2025-09-28T02:25:01.195615] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:25:01.246414] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-28T02:25:01.247585] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-28T02:25:01.263632] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:25:01.295930] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-28T02:25:01.296115] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-09-28T02:25:01.335609] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:01.336026] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:25:01.336517] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-28T02:25:01.336868] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-28T02:25:01.336948] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-28T02:25:01.337047] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-28T02:25:01.337165] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PRSU took 2.2s. Estimated remaining: 8m 14s. Rate: 77.1 symbols/min [2025-09-28T02:25:01.460722] [DEBUG] [LOCAL ] PSBD: Loaded 7130 existing records from primary storage. [2025-09-28T02:25:01.461597] [INFO ] [MAIN ] PSBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:01.477790] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PSBD took 0.4s. Estimated remaining: 8m 13s. Rate: 77.1 symbols/min [2025-09-28T02:25:01.655318] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:01.782928] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:01.786557] [DEBUG] [LOCAL ] PSF: Loaded 6990 existing records from primary storage. [2025-09-28T02:25:01.787758] [INFO ] [MAIN ] PSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:01.788220] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PSF took 0.5s. Estimated remaining: 8m 12s. Rate: 77.2 symbols/min [2025-09-28T02:25:02.066142] [DEBUG] [LOCAL ] PSFE: Loaded 30702 existing records from primary storage. [2025-09-28T02:25:02.079803] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:02.080572] [INFO ] [MAIN ] PSFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:02.081401] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSFE took 0.6s. Estimated remaining: 8m 11s. Rate: 77.2 symbols/min [2025-09-28T02:25:02.363941] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:02.385763] [DEBUG] [LOCAL ] PSN: Loaded 46808 existing records from primary storage. [2025-09-28T02:25:02.386593] [INFO ] [MAIN ] PSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:02.387480] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSN took 0.6s. Estimated remaining: 8m 10s. Rate: 77.2 symbols/min [2025-09-28T02:25:02.602034] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:02.627864] [DEBUG] [LOCAL ] PSO: Loaded 37751 existing records from primary storage. [2025-09-28T02:25:02.629101] [INFO ] [MAIN ] PSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:02.629798] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSO took 0.5s. Estimated remaining: 8m 9s. Rate: 77.2 symbols/min [2025-09-28T02:25:02.874606] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:02.875787] [DEBUG] [LOCAL ] PSQH: Loaded 35426 existing records from primary storage. [2025-09-28T02:25:02.876185] [INFO ] [MAIN ] PSQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:02.877076] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSQH took 0.5s. Estimated remaining: 8m 8s. Rate: 77.3 symbols/min [2025-09-28T02:25:03.016514] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-28T02:25:03.035025] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-28T02:25:03.106799] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:03.152328] [DEBUG] [LOCAL ] PSTG: Loaded 53626 existing records from primary storage. [2025-09-28T02:25:03.152896] [INFO ] [MAIN ] PSTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:03.153006] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSTG took 0.5s. Estimated remaining: 8m 7s. Rate: 77.3 symbols/min [2025-09-28T02:25:03.250910] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-28T02:25:03.279300] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-28T02:25:03.285835] [DEBUG] [LOCAL ] PSTL: Loaded 20585 existing records from primary storage. [2025-09-28T02:25:03.303863] [INFO ] [MAIN ] PSTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:03.330670] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSTL took 0.5s. Estimated remaining: 8m 6s. Rate: 77.3 symbols/min [2025-09-28T02:25:03.368769] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:03.556952] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:03.593774] [DEBUG] [LOCAL ] PTA: Loaded 15299 existing records from primary storage. [2025-09-28T02:25:03.594170] [INFO ] [MAIN ] PTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:03.594292] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PTA took 0.2s. Estimated remaining: 8m 5s. Rate: 77.4 symbols/min [2025-09-28T02:25:03.748478] [DEBUG] [LOCAL ] PSX: Loaded 53912 existing records from primary storage. [2025-09-28T02:25:03.749868] [INFO ] [MAIN ] PSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:03.780090] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-28T02:25:03.804045] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSX took 0.7s. Estimated remaining: 8m 4s. Rate: 77.4 symbols/min [2025-09-28T02:25:03.810389] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-28T02:25:03.892770] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:04.042492] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:04.077705] [DEBUG] [LOCAL ] PTY: Loaded 37902 existing records from primary storage. [2025-09-28T02:25:04.078147] [INFO ] [MAIN ] PTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:04.078977] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PTY took 0.5s. Estimated remaining: 8m 4s. Rate: 77.4 symbols/min [2025-09-28T02:25:04.303019] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:04.309971] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-28T02:25:04.311481] [DEBUG] [LOCAL ] PUK: Loaded 45565 existing records from primary storage. [2025-09-28T02:25:04.314075] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-28T02:25:04.315178] [INFO ] [MAIN ] PUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:04.315421] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PUK took 0.5s. Estimated remaining: 8m 3s. Rate: 77.5 symbols/min [2025-09-28T02:25:04.357889] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-28T02:25:04.372566] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-28T02:25:04.541103] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:04.559936] [DEBUG] [LOCAL ] PUMP: Loaded 50160 existing records from primary storage. [2025-09-28T02:25:04.560450] [INFO ] [MAIN ] PUMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:04.561294] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PUMP took 0.5s. Estimated remaining: 8m 2s. Rate: 77.5 symbols/min [2025-09-28T02:25:04.771629] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:04.793286] [DEBUG] [LOCAL ] PVH: Loaded 51137 existing records from primary storage. [2025-09-28T02:25:04.793955] [INFO ] [MAIN ] PVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:04.797101] [DEBUG] [LOCAL ] PVL: Loaded 4819 existing records from primary storage. [2025-09-28T02:25:04.797294] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PVH took 0.5s. Estimated remaining: 8m 1s. Rate: 77.5 symbols/min [2025-09-28T02:25:04.797587] [INFO ] [MAIN ] PVL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:04.803353] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PVL took 0.2s. Estimated remaining: 7m 60s. Rate: 77.6 symbols/min [2025-09-28T02:25:04.889019] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-28T02:25:05.000412] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-28T02:25:04.934285] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-28T02:25:05.040879] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-28T02:25:05.217178] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:05.241742] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:05.242432] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-09-28T02:25:05.242522] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-09-28T02:25:05.242711] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-28T02:25:05.242902] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-28T02:25:05.243003] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-09-28T02:25:05.243085] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-28T02:25:05.513310] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-28T02:25:05.573497] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-28T02:25:05.635442] [DEBUG] [LOCAL ] PWR: Loaded 48047 existing records from primary storage. [2025-09-28T02:25:05.656092] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-28T02:25:05.687558] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-28T02:25:05.688405] [INFO ] [MAIN ] PWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:05.731086] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PWR took 0.9s. Estimated remaining: 7m 59s. Rate: 77.6 symbols/min [2025-09-28T02:25:05.737888] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:25:05.762940] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-28T02:25:05.928061] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:05.928318] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-09-28T02:25:05.928393] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-09-28T02:25:05.928628] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-28T02:25:05.928730] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-28T02:25:05.928833] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-28T02:25:05.928925] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-28T02:25:06.068999] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-28T02:25:06.106254] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-28T02:25:06.244162] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-28T02:25:06.262025] [INFO ] [REMOTE ] PRCS: Full fetch complete (3804 records). [2025-09-28T02:25:06.292457] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-28T02:25:06.386258] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:25:06.425022] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-28T02:25:06.537836] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-28T02:25:06.577000] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-28T02:25:06.625356] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:25:06.626140] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:25:06.626250] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:25:06.626331] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-28T02:25:06.626459] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-28T02:25:06.626537] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-28T02:25:06.626696] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-28T02:25:06.626803] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PRCS took 10.8s. Estimated remaining: 7m 58s. Rate: 77.6 symbols/min [2025-09-28T02:25:06.844774] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:06.879365] [DEBUG] [LOCAL ] QD: Loaded 28475 existing records from primary storage. [2025-09-28T02:25:06.879773] [INFO ] [MAIN ] QD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:06.879880] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. QD took 0.3s. Estimated remaining: 7m 57s. Rate: 77.6 symbols/min [2025-09-28T02:25:07.104295] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:07.170372] [DEBUG] [LOCAL ] QGEN: Loaded 49874 existing records from primary storage. [2025-09-28T02:25:07.170863] [INFO ] [MAIN ] QGEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:07.171424] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. QGEN took 0.3s. Estimated remaining: 7m 56s. Rate: 77.6 symbols/min [2025-09-28T02:25:07.273018] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-28T02:25:07.287366] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-28T02:25:07.369334] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:07.397283] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-28T02:25:07.406050] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-28T02:25:07.460840] [DEBUG] [LOCAL ] QS: Loaded 54522 existing records from primary storage. [2025-09-28T02:25:07.461285] [INFO ] [MAIN ] QS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:07.461393] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QS took 0.3s. Estimated remaining: 7m 55s. Rate: 77.6 symbols/min [2025-09-28T02:25:07.646229] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:07.704596] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-28T02:25:07.705930] [DEBUG] [LOCAL ] QSR: Loaded 53178 existing records from primary storage. [2025-09-28T02:25:07.707169] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-28T02:25:07.708234] [INFO ] [MAIN ] QSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:07.708778] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QSR took 0.2s. Estimated remaining: 7m 54s. Rate: 77.7 symbols/min [2025-09-28T02:25:07.963108] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-28T02:25:07.964005] [INFO ] [REMOTE ] PRVS: Full fetch complete (1271 records). [2025-09-28T02:25:07.964103] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-28T02:25:08.175839] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-28T02:25:08.176145] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:25:08.176246] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:25:08.176331] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-28T02:25:08.176433] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-28T02:25:08.176508] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-28T02:25:08.176592] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-28T02:25:08.176759] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. PRVS took 7.9s. Estimated remaining: 7m 53s. Rate: 77.7 symbols/min [2025-09-28T02:25:08.751565] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-28T02:25:08.760555] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-28T02:25:09.204931] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-28T02:25:09.216430] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-28T02:25:10.191309] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-28T02:25:10.199342] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-28T02:25:11.361807] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-28T02:25:11.373068] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-28T02:25:11.529294] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-28T02:25:11.536463] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-28T02:25:12.863567] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-28T02:25:12.872456] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-28T02:25:13.858868] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-28T02:25:13.869819] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-28T02:25:14.218906] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-28T02:25:14.227142] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-28T02:25:15.805263] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-28T02:25:15.814460] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-28T02:25:16.628128] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-28T02:25:16.647435] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-28T02:25:17.307465] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-28T02:25:17.316255] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-28T02:25:18.704987] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-28T02:25:18.713614] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-28T02:25:19.046824] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-28T02:25:19.058682] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-28T02:25:19.580423] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-28T02:25:19.586719] [INFO ] [REMOTE ] PX: Full fetch complete (51072 records). [2025-09-28T02:25:19.586889] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-28T02:25:20.024367] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-28T02:25:20.024492] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-28T02:25:20.025202] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-28T02:25:20.025325] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-28T02:25:20.026553] [DEBUG] [LOCAL ] PX: Trimmed 51072 records to 35085 (keeping 200 days of data) [2025-09-28T02:25:20.245633] [DEBUG] [LOCAL ] PX: Primary data saved (35085 records). [2025-09-28T02:25:20.245842] [INFO ] [MAIN ] PX: Full history saved. [2025-09-28T02:25:20.245964] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. PX took 15.4s. Estimated remaining: 7m 57s. Rate: 77.0 symbols/min [2025-09-28T02:25:21.907481] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-28T02:25:21.919604] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-28T02:25:24.587796] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-28T02:25:24.599441] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-28T02:25:27.352927] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-28T02:25:27.366800] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-28T02:25:30.162983] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-28T02:25:30.175511] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-28T02:25:32.895623] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-09-28T02:25:32.907390] [INFO ] [REMOTE ] QBTS: Full fetch complete (77923 records). [2025-09-28T02:25:32.907594] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-28T02:25:33.350090] [DEBUG] [VALIDATOR ] QBTS: All expected trading days are present. [2025-09-28T02:25:33.350245] [DEBUG] [VALIDATOR ] QBTS: Primary data validation passed. [2025-09-28T02:25:33.351386] [INFO ] [MAIN ] QBTS: Fetched primary data is valid. [2025-09-28T02:25:33.351480] [DEBUG] [LOCAL ] QBTS: Saving primary data. [2025-09-28T02:25:33.353622] [DEBUG] [LOCAL ] QBTS: Trimmed 77923 records to 54526 (keeping 200 days of data) [2025-09-28T02:25:33.690888] [DEBUG] [LOCAL ] QBTS: Primary data saved (54526 records). [2025-09-28T02:25:33.691080] [INFO ] [MAIN ] QBTS: Full history saved. [2025-09-28T02:25:33.691215] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. QBTS took 28.0s. Estimated remaining: 8m 0s. Rate: 76.3 symbols/min [2025-09-28T02:25:34.338574] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:34.499554] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:34.551401] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:34.540543] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:34.560609] [DEBUG] [LOCAL ] QVCC: Loaded 9018 existing records from primary storage. [2025-09-28T02:25:34.562385] [INFO ] [MAIN ] QVCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:34.562544] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCC took 0.9s. Estimated remaining: 7m 59s. Rate: 76.3 symbols/min [2025-09-28T02:25:34.566066] [DEBUG] [LOCAL ] QVCD: Loaded 4542 existing records from primary storage. [2025-09-28T02:25:34.566357] [INFO ] [MAIN ] QVCD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:34.571896] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QVCD took 0.8s. Estimated remaining: 7m 58s. Rate: 76.4 symbols/min [2025-09-28T02:25:34.830797] [DEBUG] [LOCAL ] QUAD: Loaded 23938 existing records from primary storage. [2025-09-28T02:25:34.846954] [INFO ] [MAIN ] QUAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:34.915069] [DEBUG] [LOCAL ] QTWO: Loaded 39754 existing records from primary storage. [2025-09-28T02:25:34.898469] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QUAD took 1.2s. Estimated remaining: 7m 57s. Rate: 76.4 symbols/min [2025-09-28T02:25:34.966750] [INFO ] [MAIN ] QTWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:35.033298] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QTWO took 1.3s. Estimated remaining: 7m 56s. Rate: 76.4 symbols/min [2025-09-28T02:25:35.053349] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:35.129353] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:35.437851] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:35.470176] [DEBUG] [LOCAL ] R: Loaded 29775 existing records from primary storage. [2025-09-28T02:25:35.469110] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:35.471186] [INFO ] [MAIN ] R: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:35.471464] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. R took 0.9s. Estimated remaining: 7m 56s. Rate: 76.5 symbols/min [2025-09-28T02:25:35.647180] [DEBUG] [LOCAL ] RA: Loaded 22045 existing records from primary storage. [2025-09-28T02:25:35.648993] [DEBUG] [LOCAL ] QXO: Loaded 53964 existing records from primary storage. [2025-09-28T02:25:35.668929] [INFO ] [MAIN ] RA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:35.649562] [INFO ] [MAIN ] QXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:35.674399] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. RA took 0.7s. Estimated remaining: 7m 55s. Rate: 76.5 symbols/min [2025-09-28T02:25:35.674774] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. QXO took 1.1s. Estimated remaining: 7m 54s. Rate: 76.5 symbols/min [2025-09-28T02:25:35.810367] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:35.892524] [DEBUG] [LOCAL ] RACE: Loaded 33300 existing records from primary storage. [2025-09-28T02:25:35.936398] [INFO ] [MAIN ] RACE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:35.947586] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RACE took 0.9s. Estimated remaining: 7m 53s. Rate: 76.6 symbols/min [2025-09-28T02:25:36.222599] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:36.299539] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:36.302448] [DEBUG] [LOCAL ] RAMP: Loaded 38208 existing records from primary storage. [2025-09-28T02:25:36.315092] [INFO ] [MAIN ] RAMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:36.331038] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RAMP took 0.9s. Estimated remaining: 7m 52s. Rate: 76.6 symbols/min [2025-09-28T02:25:36.393424] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:36.502775] [DEBUG] [LOCAL ] RBC: Loaded 15326 existing records from primary storage. [2025-09-28T02:25:36.522682] [INFO ] [MAIN ] RBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:36.522971] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBC took 0.8s. Estimated remaining: 7m 51s. Rate: 76.6 symbols/min [2025-09-28T02:25:36.708452] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:36.825083] [DEBUG] [LOCAL ] RBA: Loaded 46598 existing records from primary storage. [2025-09-28T02:25:36.857482] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:36.858980] [INFO ] [MAIN ] RBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:36.878287] [DEBUG] [LOCAL ] RBOT: Loaded 5223 existing records from primary storage. [2025-09-28T02:25:36.872507] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBA took 1.2s. Estimated remaining: 7m 50s. Rate: 76.6 symbols/min [2025-09-28T02:25:36.879058] [INFO ] [MAIN ] RBOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:36.885168] [DEBUG] [LOCAL ] RBLX: Loaded 54496 existing records from primary storage. [2025-09-28T02:25:36.912991] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBOT took 0.6s. Estimated remaining: 7m 49s. Rate: 76.7 symbols/min [2025-09-28T02:25:36.923591] [INFO ] [MAIN ] RBLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:36.978158] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBLX took 1.0s. Estimated remaining: 7m 48s. Rate: 76.7 symbols/min [2025-09-28T02:25:37.412804] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:37.455793] [DEBUG] [LOCAL ] RBRK: Loaded 53892 existing records from primary storage. [2025-09-28T02:25:37.455913] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-28T02:25:37.432912] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:37.466413] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-28T02:25:37.481815] [INFO ] [MAIN ] RBRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:37.467431] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-28T02:25:37.507963] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RBRK took 1.0s. Estimated remaining: 7m 47s. Rate: 76.7 symbols/min [2025-09-28T02:25:37.523069] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-28T02:25:37.522617] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:37.547185] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-28T02:25:37.559003] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-28T02:25:37.559307] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-28T02:25:37.564753] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-28T02:25:37.635880] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-28T02:25:37.769320] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-28T02:25:37.792068] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-28T02:25:37.803695] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-28T02:25:37.958832] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:38.166584] [DEBUG] [LOCAL ] RC: Loaded 49676 existing records from primary storage. [2025-09-28T02:25:38.244993] [INFO ] [MAIN ] RC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:38.286818] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RC took 1.4s. Estimated remaining: 7m 46s. Rate: 76.7 symbols/min [2025-09-28T02:25:38.646126] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:25:38.679898] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-28T02:25:38.866242] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:38.904668] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:25:38.905086] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-28T02:25:38.885123] [DEBUG] [LOCAL ] RCI: Loaded 49383 existing records from primary storage. [2025-09-28T02:25:38.898633] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-09-28T02:25:38.906248] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-09-28T02:25:38.906375] [INFO ] [MAIN ] RCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:38.906584] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-28T02:25:38.906834] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RCI took 1.4s. Estimated remaining: 7m 45s. Rate: 76.7 symbols/min [2025-09-28T02:25:38.906964] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-28T02:25:38.985936] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-28T02:25:39.018188] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-28T02:25:39.244272] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:39.294667] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-28T02:25:39.316154] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-28T02:25:39.433765] [DEBUG] [LOCAL ] RCS: Loaded 11593 existing records from primary storage. [2025-09-28T02:25:39.484307] [INFO ] [MAIN ] RCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:39.495418] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCS took 0.6s. Estimated remaining: 7m 44s. Rate: 76.8 symbols/min [2025-09-28T02:25:39.618699] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:25:39.653406] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-28T02:25:39.666854] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-28T02:25:39.682312] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-28T02:25:39.780528] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:39.821922] [DEBUG] [LOCAL ] RCUS: Loaded 43206 existing records from primary storage. [2025-09-28T02:25:39.822338] [INFO ] [MAIN ] RCUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:39.822453] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCUS took 0.3s. Estimated remaining: 7m 43s. Rate: 76.8 symbols/min [2025-09-28T02:25:40.014887] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:40.075910] [DEBUG] [LOCAL ] RDDT: Loaded 54563 existing records from primary storage. [2025-09-28T02:25:40.076381] [INFO ] [MAIN ] RDDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:40.076490] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RDDT took 0.3s. Estimated remaining: 7m 42s. Rate: 76.8 symbols/min [2025-09-28T02:25:40.165499] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-28T02:25:40.196813] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-28T02:25:40.274755] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:40.320635] [DEBUG] [LOCAL ] RDN: Loaded 45976 existing records from primary storage. [2025-09-28T02:25:40.321077] [INFO ] [MAIN ] RDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:40.321770] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RDN took 0.2s. Estimated remaining: 7m 42s. Rate: 76.8 symbols/min [2025-09-28T02:25:40.460662] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-28T02:25:40.500015] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-28T02:25:40.525131] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:40.586719] [DEBUG] [LOCAL ] RDW: Loaded 52794 existing records from primary storage. [2025-09-28T02:25:40.587147] [INFO ] [MAIN ] RDW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:40.587732] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RDW took 0.3s. Estimated remaining: 7m 41s. Rate: 76.9 symbols/min [2025-09-28T02:25:40.784212] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-28T02:25:40.787917] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:40.790492] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-28T02:25:40.841994] [DEBUG] [LOCAL ] RDY: Loaded 47418 existing records from primary storage. [2025-09-28T02:25:40.842429] [INFO ] [MAIN ] RDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:40.843045] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDY took 0.3s. Estimated remaining: 7m 40s. Rate: 76.9 symbols/min [2025-09-28T02:25:40.996817] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-28T02:25:41.013546] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-28T02:25:41.034275] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:41.086211] [DEBUG] [LOCAL ] RELX: Loaded 48567 existing records from primary storage. [2025-09-28T02:25:41.086614] [INFO ] [MAIN ] RELX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:41.087217] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RELX took 0.2s. Estimated remaining: 7m 39s. Rate: 76.9 symbols/min [2025-09-28T02:25:41.278337] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:41.324182] [DEBUG] [LOCAL ] RERE: Loaded 41690 existing records from primary storage. [2025-09-28T02:25:41.324580] [INFO ] [MAIN ] RERE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:41.325235] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RERE took 0.2s. Estimated remaining: 7m 38s. Rate: 77.0 symbols/min [2025-09-28T02:25:41.418628] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-28T02:25:41.451358] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-28T02:25:41.530743] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:41.588538] [DEBUG] [LOCAL ] RES: Loaded 48190 existing records from primary storage. [2025-09-28T02:25:41.589068] [INFO ] [MAIN ] RES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:41.589683] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RES took 0.3s. Estimated remaining: 7m 37s. Rate: 77.0 symbols/min [2025-09-28T02:25:41.786034] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:41.819406] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-28T02:25:41.831792] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-28T02:25:41.846257] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-28T02:25:41.850245] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-28T02:25:41.882115] [DEBUG] [LOCAL ] REVG: Loaded 41461 existing records from primary storage. [2025-09-28T02:25:41.882483] [INFO ] [MAIN ] REVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:41.883093] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. REVG took 0.3s. Estimated remaining: 7m 36s. Rate: 77.0 symbols/min [2025-09-28T02:25:42.002619] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-28T02:25:42.020173] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-28T02:25:42.077379] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:42.095561] [DEBUG] [LOCAL ] REX: Loaded 14221 existing records from primary storage. [2025-09-28T02:25:42.095893] [INFO ] [MAIN ] REX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:42.095995] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. REX took 0.2s. Estimated remaining: 7m 35s. Rate: 77.0 symbols/min [2025-09-28T02:25:42.282502] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:42.338698] [DEBUG] [LOCAL ] REXR: Loaded 52852 existing records from primary storage. [2025-09-28T02:25:42.339137] [INFO ] [MAIN ] REXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:42.339806] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. REXR took 0.2s. Estimated remaining: 7m 34s. Rate: 77.1 symbols/min [2025-09-28T02:25:42.524852] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:42.581595] [DEBUG] [LOCAL ] REZI: Loaded 47576 existing records from primary storage. [2025-09-28T02:25:42.582290] [INFO ] [MAIN ] REZI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:42.582908] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. REZI took 0.2s. Estimated remaining: 7m 33s. Rate: 77.1 symbols/min [2025-09-28T02:25:42.673084] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-28T02:25:42.701781] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-28T02:25:42.783040] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:42.842319] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-09-28T02:25:42.842823] [INFO ] [MAIN ] RF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:42.843439] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. RF took 0.3s. Estimated remaining: 7m 32s. Rate: 77.1 symbols/min [2025-09-28T02:25:42.931132] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-28T02:25:42.961818] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-28T02:25:43.040931] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:43.054348] [DEBUG] [LOCAL ] RFI: Loaded 10550 existing records from primary storage. [2025-09-28T02:25:43.054722] [INFO ] [MAIN ] RFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:43.054848] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. RFI took 0.2s. Estimated remaining: 7m 31s. Rate: 77.2 symbols/min [2025-09-28T02:25:43.242093] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:43.245856] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-28T02:25:43.247922] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-28T02:25:43.259351] [DEBUG] [LOCAL ] RFL: Loaded 11051 existing records from primary storage. [2025-09-28T02:25:43.259710] [INFO ] [MAIN ] RFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:43.259833] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. RFL took 0.2s. Estimated remaining: 7m 30s. Rate: 77.2 symbols/min [2025-09-28T02:25:43.460962] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:43.456875] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-28T02:25:43.463062] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-28T02:25:43.469347] [DEBUG] [LOCAL ] RFM: Loaded 4196 existing records from primary storage. [2025-09-28T02:25:43.469619] [INFO ] [MAIN ] RFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:43.469797] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RFM took 0.2s. Estimated remaining: 7m 29s. Rate: 77.2 symbols/min [2025-09-28T02:25:43.658733] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:43.670219] [DEBUG] [LOCAL ] RFMZ: Loaded 8822 existing records from primary storage. [2025-09-28T02:25:43.670498] [INFO ] [MAIN ] RFMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:43.670601] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFMZ took 0.2s. Estimated remaining: 7m 28s. Rate: 77.3 symbols/min [2025-09-28T02:25:43.835373] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-28T02:25:43.873190] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:43.875277] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-28T02:25:43.910992] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-28T02:25:43.917710] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-28T02:25:43.920130] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-28T02:25:43.933995] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-28T02:25:43.971469] [DEBUG] [LOCAL ] RGA: Loaded 30535 existing records from primary storage. [2025-09-28T02:25:43.972009] [INFO ] [MAIN ] RGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:43.972629] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RGA took 0.3s. Estimated remaining: 7m 27s. Rate: 77.3 symbols/min [2025-09-28T02:25:44.171446] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:44.196578] [DEBUG] [LOCAL ] RGR: Loaded 20706 existing records from primary storage. [2025-09-28T02:25:44.196982] [INFO ] [MAIN ] RGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:44.197122] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RGR took 0.2s. Estimated remaining: 7m 26s. Rate: 77.3 symbols/min [2025-09-28T02:25:44.421436] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-28T02:25:44.443127] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:44.445023] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-28T02:25:44.453336] [DEBUG] [LOCAL ] RGT: Loaded 2885 existing records from primary storage. [2025-09-28T02:25:44.453602] [INFO ] [MAIN ] RGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:44.453759] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RGT took 0.3s. Estimated remaining: 7m 25s. Rate: 77.3 symbols/min [2025-09-28T02:25:44.498268] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-28T02:25:44.500014] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-28T02:25:44.778485] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-28T02:25:44.779399] [INFO ] [REMOTE ] RCB: Full fetch complete (3747 records). [2025-09-28T02:25:44.779498] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-28T02:25:44.987351] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:25:44.987709] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:25:44.987787] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:25:44.987868] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-28T02:25:44.987978] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-28T02:25:44.988057] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-28T02:25:44.988152] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-28T02:25:44.988256] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RCB took 8.1s. Estimated remaining: 7m 24s. Rate: 77.4 symbols/min [2025-09-28T02:25:45.058330] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-28T02:25:45.060026] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-28T02:25:45.630880] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-28T02:25:45.632620] [INFO ] [REMOTE ] RCD: Full fetch complete (6867 records). [2025-09-28T02:25:45.632811] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-28T02:25:45.833667] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:25:45.834047] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:25:45.834177] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:25:45.834420] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-28T02:25:45.834575] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-28T02:25:45.834707] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-28T02:25:45.834958] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-28T02:25:45.835069] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RCD took 8.8s. Estimated remaining: 7m 24s. Rate: 77.3 symbols/min [2025-09-28T02:25:45.864520] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-28T02:25:45.875014] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-28T02:25:48.011937] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-28T02:25:48.023438] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-28T02:25:50.020010] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-28T02:25:50.032338] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-28T02:25:52.104432] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-28T02:25:52.119107] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-28T02:25:52.951076] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-28T02:25:52.962259] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-28T02:25:55.129049] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-28T02:25:55.141471] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-28T02:25:55.934584] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-28T02:25:55.946385] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-28T02:25:57.895818] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-28T02:25:57.906394] [INFO ] [REMOTE ] RCL: Full fetch complete (75410 records). [2025-09-28T02:25:57.906594] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-28T02:25:58.321419] [DEBUG] [VALIDATOR ] RCL: All expected trading days are present. [2025-09-28T02:25:58.321556] [DEBUG] [VALIDATOR ] RCL: Primary data validation passed. [2025-09-28T02:25:58.322431] [INFO ] [MAIN ] RCL: Fetched primary data is valid. [2025-09-28T02:25:58.322526] [DEBUG] [LOCAL ] RCL: Saving primary data. [2025-09-28T02:25:58.324272] [DEBUG] [LOCAL ] RCL: Trimmed 75410 records to 52876 (keeping 200 days of data) [2025-09-28T02:25:58.671200] [DEBUG] [LOCAL ] RCL: Primary data saved (52876 records). [2025-09-28T02:25:58.671402] [INFO ] [MAIN ] RCL: Full history saved. [2025-09-28T02:25:58.671525] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RCL took 20.4s. Estimated remaining: 7m 27s. Rate: 76.7 symbols/min [2025-09-28T02:25:59.326428] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:59.420189] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:59.457335] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-09-28T02:25:59.461677] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:59.481874] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:25:59.482141] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-09-28T02:25:59.483101] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-09-28T02:25:59.485748] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-28T02:25:59.486053] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-28T02:25:59.486216] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-09-28T02:25:59.872946] [DEBUG] [LOCAL ] RH: Loaded 48340 existing records from primary storage. [2025-09-28T02:25:59.902202] [INFO ] [MAIN ] RH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:59.907810] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RH took 1.2s. Estimated remaining: 7m 26s. Rate: 76.7 symbols/min [2025-09-28T02:25:59.901706] [DEBUG] [LOCAL ] RHP: Loaded 42305 existing records from primary storage. [2025-09-28T02:25:59.908083] [DEBUG] [LOCAL ] RHI: Loaded 49995 existing records from primary storage. [2025-09-28T02:25:59.919212] [INFO ] [MAIN ] RHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:59.939200] [INFO ] [MAIN ] RHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:25:59.964860] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RHP took 1.3s. Estimated remaining: 7m 25s. Rate: 76.7 symbols/min [2025-09-28T02:26:00.021896] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RHI took 1.3s. Estimated remaining: 7m 24s. Rate: 76.7 symbols/min [2025-09-28T02:26:00.363211] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:00.471369] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-28T02:26:00.570862] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:00.632851] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:00.649547] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-09-28T02:26:00.672270] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:00.673024] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-09-28T02:26:00.673467] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-28T02:26:00.674129] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-28T02:26:00.674294] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-09-28T02:26:00.674376] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-28T02:26:01.016535] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:26:01.059819] [DEBUG] [LOCAL ] RIG: Loaded 54449 existing records from primary storage. [2025-09-28T02:26:01.061030] [INFO ] [MAIN ] RIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:01.066400] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RIG took 1.2s. Estimated remaining: 7m 23s. Rate: 76.7 symbols/min [2025-09-28T02:26:01.060581] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-28T02:26:01.115399] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:26:01.133682] [DEBUG] [LOCAL ] RITM: Loaded 53589 existing records from primary storage. [2025-09-28T02:26:01.144898] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-09-28T02:26:01.179512] [INFO ] [MAIN ] RITM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:01.184906] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RITM took 1.1s. Estimated remaining: 7m 22s. Rate: 76.8 symbols/min [2025-09-28T02:26:01.186316] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:26:01.223797] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:01.264897] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-28T02:26:01.264345] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-28T02:26:01.332423] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-28T02:26:01.369780] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-09-28T02:26:01.474211] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-09-28T02:26:01.495780] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:01.507412] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RHLD took 2.8s. Estimated remaining: 7m 21s. Rate: 76.8 symbols/min [2025-09-28T02:26:01.660364] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:01.741632] [DEBUG] [LOCAL ] RIV: Loaded 12193 existing records from primary storage. [2025-09-28T02:26:01.756807] [INFO ] [MAIN ] RIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:01.768704] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RIV took 0.7s. Estimated remaining: 7m 21s. Rate: 76.8 symbols/min [2025-09-28T02:26:01.895616] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:02.062188] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:02.080567] [DEBUG] [LOCAL ] RJF: Loaded 47804 existing records from primary storage. [2025-09-28T02:26:02.081587] [INFO ] [MAIN ] RJF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:02.082070] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RJF took 0.8s. Estimated remaining: 7m 20s. Rate: 76.8 symbols/min [2025-09-28T02:26:02.301209] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:02.325453] [DEBUG] [LOCAL ] RKT: Loaded 54501 existing records from primary storage. [2025-09-28T02:26:02.338095] [INFO ] [MAIN ] RKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:02.340313] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RKT took 0.8s. Estimated remaining: 7m 19s. Rate: 76.9 symbols/min [2025-09-28T02:26:02.365915] [DEBUG] [LOCAL ] RL: Loaded 41998 existing records from primary storage. [2025-09-28T02:26:02.421848] [INFO ] [MAIN ] RL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:02.442581] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RL took 0.7s. Estimated remaining: 7m 18s. Rate: 76.9 symbols/min [2025-09-28T02:26:02.657732] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:02.683236] [DEBUG] [LOCAL ] RLI: Loaded 33794 existing records from primary storage. [2025-09-28T02:26:02.695895] [INFO ] [MAIN ] RLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:02.727159] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RLI took 0.6s. Estimated remaining: 7m 17s. Rate: 76.9 symbols/min [2025-09-28T02:26:02.776023] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:02.957686] [DEBUG] [LOCAL ] RLTY: Loaded 11255 existing records from primary storage. [2025-09-28T02:26:02.980332] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:02.996506] [INFO ] [MAIN ] RLTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:02.997218] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RLTY took 0.5s. Estimated remaining: 7m 16s. Rate: 77.0 symbols/min [2025-09-28T02:26:02.999280] [DEBUG] [LOCAL ] RLJ: Loaded 48922 existing records from primary storage. [2025-09-28T02:26:03.033483] [INFO ] [MAIN ] RLJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:03.051209] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLJ took 0.7s. Estimated remaining: 7m 15s. Rate: 77.0 symbols/min [2025-09-28T02:26:03.335104] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:03.459726] [DEBUG] [LOCAL ] RLX: Loaded 48987 existing records from primary storage. [2025-09-28T02:26:03.457878] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:03.460771] [INFO ] [MAIN ] RLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:03.461354] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RLX took 0.7s. Estimated remaining: 7m 14s. Rate: 77.0 symbols/min [2025-09-28T02:26:03.490419] [DEBUG] [LOCAL ] RM: Loaded 7734 existing records from primary storage. [2025-09-28T02:26:03.514149] [INFO ] [MAIN ] RM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:03.560509] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RM took 0.6s. Estimated remaining: 7m 13s. Rate: 77.1 symbols/min [2025-09-28T02:26:03.726015] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:03.709205] [DEBUG] [LOCAL ] RMAX: Loaded 22121 existing records from primary storage. [2025-09-28T02:26:03.772440] [INFO ] [MAIN ] RMAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:03.812887] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RMAX took 0.8s. Estimated remaining: 7m 12s. Rate: 77.1 symbols/min [2025-09-28T02:26:04.096511] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:04.150271] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-28T02:26:04.153610] [DEBUG] [LOCAL ] RMD: Loaded 42855 existing records from primary storage. [2025-09-28T02:26:04.174710] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:04.186956] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-28T02:26:04.188913] [INFO ] [MAIN ] RMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:04.189110] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMD took 0.7s. Estimated remaining: 7m 11s. Rate: 77.1 symbols/min [2025-09-28T02:26:04.232157] [DEBUG] [LOCAL ] RMI: Loaded 4716 existing records from primary storage. [2025-09-28T02:26:04.243122] [INFO ] [MAIN ] RMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:04.254586] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMI took 0.7s. Estimated remaining: 7m 10s. Rate: 77.1 symbols/min [2025-09-28T02:26:04.383610] [DEBUG] [LOCAL ] RMM: Loaded 10624 existing records from primary storage. [2025-09-28T02:26:04.406907] [INFO ] [MAIN ] RMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:04.456015] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMM took 0.6s. Estimated remaining: 7m 9s. Rate: 77.2 symbols/min [2025-09-28T02:26:04.531806] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:04.643087] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:04.722216] [DEBUG] [LOCAL ] RMMZ: Loaded 4875 existing records from primary storage. [2025-09-28T02:26:04.747132] [INFO ] [MAIN ] RMMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:04.747320] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMMZ took 0.6s. Estimated remaining: 7m 8s. Rate: 77.2 symbols/min [2025-09-28T02:26:04.900978] [DEBUG] [LOCAL ] RMT: Loaded 17682 existing records from primary storage. [2025-09-28T02:26:04.900224] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:04.939025] [INFO ] [MAIN ] RMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:04.958166] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMT took 0.7s. Estimated remaining: 7m 7s. Rate: 77.2 symbols/min [2025-09-28T02:26:05.104940] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:05.231856] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:05.245755] [DEBUG] [LOCAL ] RNGR: Loaded 20653 existing records from primary storage. [2025-09-28T02:26:05.246147] [INFO ] [MAIN ] RNGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:05.246253] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RNGR took 0.5s. Estimated remaining: 7m 6s. Rate: 77.3 symbols/min [2025-09-28T02:26:05.379916] [DEBUG] [LOCAL ] RNP: Loaded 15940 existing records from primary storage. [2025-09-28T02:26:05.381680] [DEBUG] [LOCAL ] RNG: Loaded 48830 existing records from primary storage. [2025-09-28T02:26:05.386944] [INFO ] [MAIN ] RNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:05.392535] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNP took 0.4s. Estimated remaining: 7m 5s. Rate: 77.3 symbols/min [2025-09-28T02:26:05.392856] [INFO ] [MAIN ] RNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:05.418943] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNG took 0.8s. Estimated remaining: 7m 4s. Rate: 77.3 symbols/min [2025-09-28T02:26:05.523091] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:05.779278] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:05.862351] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:05.888778] [DEBUG] [LOCAL ] RNR: Loaded 34623 existing records from primary storage. [2025-09-28T02:26:05.894749] [INFO ] [MAIN ] RNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:05.894957] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNR took 0.6s. Estimated remaining: 7m 3s. Rate: 77.4 symbols/min [2025-09-28T02:26:06.073445] [DEBUG] [LOCAL ] RNST: Loaded 37619 existing records from primary storage. [2025-09-28T02:26:06.063850] [DEBUG] [LOCAL ] ROG: Loaded 23367 existing records from primary storage. [2025-09-28T02:26:06.085106] [INFO ] [MAIN ] RNST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:06.096303] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNST took 0.7s. Estimated remaining: 7m 3s. Rate: 77.4 symbols/min [2025-09-28T02:26:06.096088] [INFO ] [MAIN ] ROG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:06.138741] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. ROG took 0.6s. Estimated remaining: 7m 2s. Rate: 77.4 symbols/min [2025-09-28T02:26:06.206401] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:06.575636] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:06.599315] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:06.649023] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-28T02:26:06.662822] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-28T02:26:06.685751] [DEBUG] [LOCAL ] ROK: Loaded 44522 existing records from primary storage. [2025-09-28T02:26:06.686796] [INFO ] [MAIN ] ROK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:06.686934] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. ROK took 0.8s. Estimated remaining: 7m 1s. Rate: 77.4 symbols/min [2025-09-28T02:26:06.855852] [DEBUG] [LOCAL ] RPM: Loaded 41763 existing records from primary storage. [2025-09-28T02:26:06.926764] [INFO ] [MAIN ] RPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:06.931423] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:06.931762] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. RPM took 0.8s. Estimated remaining: 6m 60s. Rate: 77.5 symbols/min [2025-09-28T02:26:06.983215] [DEBUG] [LOCAL ] ROL: Loaded 51031 existing records from primary storage. [2025-09-28T02:26:06.994375] [INFO ] [MAIN ] ROL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:07.008249] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. ROL took 0.9s. Estimated remaining: 6m 59s. Rate: 77.5 symbols/min [2025-09-28T02:26:07.255340] [DEBUG] [LOCAL ] RPT: Loaded 19767 existing records from primary storage. [2025-09-28T02:26:07.302765] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:07.318700] [INFO ] [MAIN ] RPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:07.324274] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPT took 0.6s. Estimated remaining: 6m 58s. Rate: 77.5 symbols/min [2025-09-28T02:26:07.420751] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:07.442301] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-09-28T02:26:07.476893] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-09-28T02:26:07.496574] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-28T02:26:07.496851] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-28T02:26:07.496954] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-09-28T02:26:07.499164] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-28T02:26:07.642872] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:07.704018] [DEBUG] [LOCAL ] RQI: Loaded 29573 existing records from primary storage. [2025-09-28T02:26:07.722102] [INFO ] [MAIN ] RQI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:07.727003] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RQI took 0.8s. Estimated remaining: 6m 57s. Rate: 77.6 symbols/min [2025-09-28T02:26:08.162687] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:08.274262] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:08.275044] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-28T02:26:08.276442] [DEBUG] [LOCAL ] RRX: Loaded 41752 existing records from primary storage. [2025-09-28T02:26:08.278017] [INFO ] [MAIN ] RRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:08.278199] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RRX took 0.9s. Estimated remaining: 6m 56s. Rate: 77.6 symbols/min [2025-09-28T02:26:08.385178] [DEBUG] [LOCAL ] RS: Loaded 25864 existing records from primary storage. [2025-09-28T02:26:08.399773] [INFO ] [MAIN ] RS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:08.413066] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RS took 0.7s. Estimated remaining: 6m 55s. Rate: 77.6 symbols/min [2025-09-28T02:26:08.616140] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:08.707278] [DEBUG] [LOCAL ] RSF: Loaded 4192 existing records from primary storage. [2025-09-28T02:26:08.709230] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:08.710011] [INFO ] [MAIN ] RSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:08.710500] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RSF took 0.4s. Estimated remaining: 6m 54s. Rate: 77.6 symbols/min [2025-09-28T02:26:08.941138] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:08.944567] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-28T02:26:08.956537] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-28T02:26:08.974514] [DEBUG] [LOCAL ] RSG: Loaded 48173 existing records from primary storage. [2025-09-28T02:26:08.974964] [INFO ] [MAIN ] RSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:08.975067] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RSG took 0.6s. Estimated remaining: 6m 53s. Rate: 77.7 symbols/min [2025-09-28T02:26:09.176434] [DEBUG] [LOCAL ] RSI: Loaded 47695 existing records from primary storage. [2025-09-28T02:26:09.188312] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:09.188837] [INFO ] [MAIN ] RSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:09.189385] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RSI took 0.5s. Estimated remaining: 6m 52s. Rate: 77.7 symbols/min [2025-09-28T02:26:09.223243] [DEBUG] [LOCAL ] RSKD: Loaded 34254 existing records from primary storage. [2025-09-28T02:26:09.223635] [INFO ] [MAIN ] RSKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:09.223766] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSKD took 0.2s. Estimated remaining: 6m 51s. Rate: 77.7 symbols/min [2025-09-28T02:26:10.087891] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-28T02:26:10.098600] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-28T02:26:11.179049] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-28T02:26:11.190535] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-28T02:26:11.968613] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-28T02:26:11.979727] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-28T02:26:13.380063] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-28T02:26:13.393449] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-28T02:26:13.449439] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-28T02:26:13.460389] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-28T02:26:15.360841] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-28T02:26:15.373096] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-28T02:26:15.685800] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-28T02:26:15.699683] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-28T02:26:17.262987] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-28T02:26:17.277232] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-28T02:26:17.745454] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-28T02:26:17.757112] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-28T02:26:19.195580] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-28T02:26:19.207494] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-28T02:26:19.951220] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-28T02:26:19.964063] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-28T02:26:20.750209] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-28T02:26:20.761324] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-28T02:26:21.933129] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-28T02:26:21.945034] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-28T02:26:22.684306] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-28T02:26:22.696546] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-28T02:26:24.004943] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-28T02:26:24.016016] [INFO ] [REMOTE ] RIO: Full fetch complete (77354 records). [2025-09-28T02:26:24.016218] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-28T02:26:24.498810] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-28T02:26:24.499101] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-28T02:26:24.500155] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-28T02:26:24.500342] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-28T02:26:24.534211] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-28T02:26:24.545881] [DEBUG] [LOCAL ] RIO: Trimmed 77354 records to 54173 (keeping 200 days of data) [2025-09-28T02:26:24.547095] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-28T02:26:24.892801] [DEBUG] [LOCAL ] RIO: Primary data saved (54173 records). [2025-09-28T02:26:24.892994] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-28T02:26:24.893111] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RIO took 24.9s. Estimated remaining: 6m 55s. Rate: 76.9 symbols/min [2025-09-28T02:26:26.089593] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-28T02:26:26.100019] [INFO ] [REMOTE ] RRC: Full fetch complete (76312 records). [2025-09-28T02:26:26.100215] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-28T02:26:26.564512] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-28T02:26:26.564804] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-28T02:26:26.565785] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-28T02:26:26.565893] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-28T02:26:26.567974] [DEBUG] [LOCAL ] RRC: Trimmed 76312 records to 53554 (keeping 200 days of data) [2025-09-28T02:26:26.904439] [DEBUG] [LOCAL ] RRC: Primary data saved (53554 records). [2025-09-28T02:26:26.904636] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-28T02:26:26.904789] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RRC took 19.9s. Estimated remaining: 6m 55s. Rate: 76.9 symbols/min [2025-09-28T02:26:27.744286] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:27.770845] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:27.776742] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:27.807076] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:27.886499] [DEBUG] [LOCAL ] RVT: Loaded 27362 existing records from primary storage. [2025-09-28T02:26:27.898986] [INFO ] [MAIN ] RVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:27.899267] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVT took 1.0s. Estimated remaining: 6m 54s. Rate: 76.8 symbols/min [2025-09-28T02:26:28.037291] [DEBUG] [LOCAL ] RTO: Loaded 40847 existing records from primary storage. [2025-09-28T02:26:28.064052] [INFO ] [MAIN ] RTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:28.086096] [DEBUG] [LOCAL ] RVLV: Loaded 48453 existing records from primary storage. [2025-09-28T02:26:28.087171] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RTO took 1.2s. Estimated remaining: 6m 53s. Rate: 76.9 symbols/min [2025-09-28T02:26:28.109203] [DEBUG] [LOCAL ] RTX: Loaded 54488 existing records from primary storage. [2025-09-28T02:26:28.114808] [INFO ] [MAIN ] RVLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:28.121429] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RVLV took 1.2s. Estimated remaining: 6m 52s. Rate: 76.9 symbols/min [2025-09-28T02:26:28.128356] [INFO ] [MAIN ] RTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:28.134747] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RTX took 1.2s. Estimated remaining: 6m 51s. Rate: 77.0 symbols/min [2025-09-28T02:26:28.262117] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:28.824164] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:28.828063] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-28T02:26:28.801460] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:28.827565] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:28.828616] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-28T02:26:28.841473] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-28T02:26:28.841676] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-28T02:26:28.844056] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-28T02:26:28.844225] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-28T02:26:28.844588] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-28T02:26:28.844707] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-28T02:26:28.857672] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-28T02:26:28.870781] [DEBUG] [LOCAL ] RVTY: Loaded 48199 existing records from primary storage. [2025-09-28T02:26:28.881840] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-28T02:26:28.903929] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-28T02:26:28.904313] [INFO ] [MAIN ] RVTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:28.904461] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-28T02:26:28.947764] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RVTY took 1.0s. Estimated remaining: 6m 50s. Rate: 77.0 symbols/min [2025-09-28T02:26:29.418093] [DEBUG] [LOCAL ] RWT: Loaded 41352 existing records from primary storage. [2025-09-28T02:26:29.509149] [INFO ] [MAIN ] RWT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:29.579988] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWT took 1.5s. Estimated remaining: 6m 49s. Rate: 77.0 symbols/min [2025-09-28T02:26:29.721886] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:29.783042] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-28T02:26:29.821882] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-28T02:26:29.897293] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-28T02:26:29.997805] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-28T02:26:30.039971] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-28T02:26:30.100878] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:30.050954] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:30.051091] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-28T02:26:30.121233] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-28T02:26:30.137351] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-28T02:26:30.197133] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:30.587400] [DEBUG] [LOCAL ] RXO: Loaded 48520 existing records from primary storage. [2025-09-28T02:26:30.626026] [INFO ] [MAIN ] RXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:30.625792] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:30.626321] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RXO took 1.0s. Estimated remaining: 6m 49s. Rate: 76.9 symbols/min [2025-09-28T02:26:30.626932] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-28T02:26:30.702091] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-28T02:26:30.702324] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-28T02:26:30.754611] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-28T02:26:30.768488] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-28T02:26:30.840726] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:30.894792] [DEBUG] [LOCAL ] RY: Loaded 48606 existing records from primary storage. [2025-09-28T02:26:30.895201] [INFO ] [MAIN ] RY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:30.895336] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RY took 0.3s. Estimated remaining: 6m 48s. Rate: 77.0 symbols/min [2025-09-28T02:26:30.943003] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:26:30.977971] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-28T02:26:30.983201] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:26:30.995077] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-09-28T02:26:31.004004] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:26:31.007306] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-28T02:26:31.007483] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-28T02:26:31.013322] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-28T02:26:31.028826] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-28T02:26:31.034120] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RWTP took 2.0s. Estimated remaining: 6m 47s. Rate: 77.0 symbols/min [2025-09-28T02:26:31.135429] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:31.280993] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:31.307024] [DEBUG] [LOCAL ] RYAM: Loaded 35709 existing records from primary storage. [2025-09-28T02:26:31.307534] [INFO ] [MAIN ] RYAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:31.307697] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RYAM took 0.4s. Estimated remaining: 6m 46s. Rate: 77.0 symbols/min [2025-09-28T02:26:31.351857] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-28T02:26:31.390286] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-28T02:26:31.427370] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-28T02:26:31.442404] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-28T02:26:31.552341] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:31.555422] [DEBUG] [LOCAL ] RYAN: Loaded 44960 existing records from primary storage. [2025-09-28T02:26:31.555977] [INFO ] [MAIN ] RYAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:31.556841] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RYAN took 0.5s. Estimated remaining: 6m 45s. Rate: 77.1 symbols/min [2025-09-28T02:26:31.756798] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:31.759213] [DEBUG] [LOCAL ] RYI: Loaded 21835 existing records from primary storage. [2025-09-28T02:26:31.763338] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-28T02:26:31.763833] [INFO ] [MAIN ] RYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:31.765336] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-28T02:26:31.765897] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYI took 0.5s. Estimated remaining: 6m 44s. Rate: 77.1 symbols/min [2025-09-28T02:26:31.961338] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:31.999702] [DEBUG] [LOCAL ] RZB: Loaded 6291 existing records from primary storage. [2025-09-28T02:26:32.000052] [INFO ] [MAIN ] RZB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:32.000186] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RZB took 0.2s. Estimated remaining: 6m 43s. Rate: 77.1 symbols/min [2025-09-28T02:26:32.001570] [DEBUG] [LOCAL ] RYN: Loaded 46335 existing records from primary storage. [2025-09-28T02:26:32.048499] [INFO ] [MAIN ] RYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:32.087359] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RYN took 0.5s. Estimated remaining: 6m 42s. Rate: 77.2 symbols/min [2025-09-28T02:26:32.193048] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-28T02:26:32.212871] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-28T02:26:32.300753] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-28T02:26:32.331668] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-28T02:26:32.382127] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:32.419275] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:32.431435] [DEBUG] [LOCAL ] RZC: Loaded 6838 existing records from primary storage. [2025-09-28T02:26:32.432159] [INFO ] [MAIN ] RZC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:32.432313] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RZC took 0.4s. Estimated remaining: 6m 41s. Rate: 77.2 symbols/min [2025-09-28T02:26:32.648984] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:32.702579] [DEBUG] [LOCAL ] S: Loaded 54315 existing records from primary storage. [2025-09-28T02:26:32.703230] [INFO ] [MAIN ] S: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:32.703486] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. S took 0.6s. Estimated remaining: 6m 40s. Rate: 77.2 symbols/min [2025-09-28T02:26:32.784179] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-28T02:26:32.826497] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-28T02:26:32.919545] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-28T02:26:32.919283] [DEBUG] [LOCAL ] SA: Loaded 43820 existing records from primary storage. [2025-09-28T02:26:32.947348] [INFO ] [MAIN ] SA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:32.946892] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:32.950217] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-28T02:26:32.948162] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. SA took 0.5s. Estimated remaining: 6m 39s. Rate: 77.2 symbols/min [2025-09-28T02:26:33.066782] [DEBUG] [LOCAL ] SABA: Loaded 9306 existing records from primary storage. [2025-09-28T02:26:33.092053] [INFO ] [MAIN ] SABA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:33.092310] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. SABA took 0.4s. Estimated remaining: 6m 38s. Rate: 77.3 symbols/min [2025-09-28T02:26:33.269045] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:33.385293] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-28T02:26:33.391908] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:33.394424] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-28T02:26:33.421194] [DEBUG] [LOCAL ] SAFE: Loaded 30819 existing records from primary storage. [2025-09-28T02:26:33.427242] [INFO ] [MAIN ] SAFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:33.427411] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SAFE took 0.5s. Estimated remaining: 6m 37s. Rate: 77.3 symbols/min [2025-09-28T02:26:33.494123] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-28T02:26:33.526278] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-28T02:26:33.562487] [DEBUG] [LOCAL ] SAH: Loaded 22368 existing records from primary storage. [2025-09-28T02:26:33.569703] [INFO ] [MAIN ] SAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:33.580432] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. SAH took 0.5s. Estimated remaining: 6m 36s. Rate: 77.3 symbols/min [2025-09-28T02:26:33.720495] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:33.750705] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-28T02:26:33.771237] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-28T02:26:33.776627] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-28T02:26:33.808745] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-28T02:26:33.854344] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-28T02:26:33.847235] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:33.854023] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-28T02:26:33.856535] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-28T02:26:33.858528] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-28T02:26:33.856927] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-28T02:26:33.863834] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-28T02:26:34.145538] [DEBUG] [LOCAL ] SAM: Loaded 21766 existing records from primary storage. [2025-09-28T02:26:34.174230] [INFO ] [MAIN ] SAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:34.187222] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAM took 0.6s. Estimated remaining: 6m 36s. Rate: 77.3 symbols/min [2025-09-28T02:26:34.256116] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-28T02:26:34.339503] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-28T02:26:34.269165] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-28T02:26:34.444841] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-28T02:26:34.458969] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:34.485485] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-28T02:26:34.557353] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:34.612536] [DEBUG] [LOCAL ] SAN: Loaded 53774 existing records from primary storage. [2025-09-28T02:26:34.613010] [INFO ] [MAIN ] SAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:34.613124] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAN took 0.4s. Estimated remaining: 6m 35s. Rate: 77.4 symbols/min [2025-09-28T02:26:34.801363] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:34.858402] [DEBUG] [LOCAL ] SAND: Loaded 52527 existing records from primary storage. [2025-09-28T02:26:34.858891] [INFO ] [MAIN ] SAND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:34.859021] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAND took 0.2s. Estimated remaining: 6m 34s. Rate: 77.4 symbols/min [2025-09-28T02:26:34.944066] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-28T02:26:34.955757] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-28T02:26:35.052826] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:35.056878] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-28T02:26:35.059027] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-28T02:26:35.110845] [DEBUG] [LOCAL ] SAP: Loaded 50800 existing records from primary storage. [2025-09-28T02:26:35.111228] [INFO ] [MAIN ] SAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:35.111863] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAP took 0.3s. Estimated remaining: 6m 33s. Rate: 77.4 symbols/min [2025-09-28T02:26:35.229684] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-28T02:26:35.258501] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-28T02:26:35.308948] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-28T02:26:35.314680] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-28T02:26:35.312790] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:35.335370] [DEBUG] [LOCAL ] SAR: Loaded 16382 existing records from primary storage. [2025-09-28T02:26:35.335676] [INFO ] [MAIN ] SAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:35.335779] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAR took 0.2s. Estimated remaining: 6m 32s. Rate: 77.4 symbols/min [2025-09-28T02:26:35.523126] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:35.577943] [DEBUG] [LOCAL ] SARO: Loaded 49425 existing records from primary storage. [2025-09-28T02:26:35.578326] [INFO ] [MAIN ] SARO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:35.578952] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SARO took 0.2s. Estimated remaining: 6m 31s. Rate: 77.5 symbols/min [2025-09-28T02:26:35.654504] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-28T02:26:35.681419] [INFO ] [REMOTE ] RWTN: Full fetch complete (3130 records). [2025-09-28T02:26:35.690830] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-28T02:26:35.707253] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-28T02:26:35.707849] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-28T02:26:35.898569] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:35.908370] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-28T02:26:35.913691] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-28T02:26:35.926455] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-28T02:26:35.931804] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-28T02:26:35.940028] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-28T02:26:35.939885] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-28T02:26:35.940169] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-28T02:26:35.961815] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-28T02:26:36.135447] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-28T02:26:36.140089] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:26:36.162736] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-28T02:26:36.187411] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:26:36.193784] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:26:36.194308] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-28T02:26:36.194444] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-28T02:26:36.205094] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-28T02:26:36.226054] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-28T02:26:36.266629] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. RWTN took 8.1s. Estimated remaining: 6m 30s. Rate: 77.5 symbols/min [2025-09-28T02:26:36.617435] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-28T02:26:36.667924] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-28T02:26:36.700539] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:36.722027] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-28T02:26:36.726516] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:36.726628] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-28T02:26:36.726886] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-28T02:26:36.726979] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-28T02:26:36.727417] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-28T02:26:36.727588] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-28T02:26:36.727720] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-28T02:26:36.836564] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-28T02:26:36.861099] [INFO ] [REMOTE ] RWTO: Full fetch complete (4801 records). [2025-09-28T02:26:36.876639] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-28T02:26:37.104793] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-28T02:26:37.183899] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-28T02:26:37.242511] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-28T02:26:37.280668] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-28T02:26:37.278375] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:26:37.287977] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:26:37.303756] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:26:37.351203] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-28T02:26:37.375834] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-28T02:26:37.376019] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-28T02:26:37.375683] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:37.376200] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-28T02:26:37.376585] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-28T02:26:37.376826] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. RWTO took 9.2s. Estimated remaining: 6m 30s. Rate: 77.5 symbols/min [2025-09-28T02:26:37.571377] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:37.571733] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-28T02:26:37.571807] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-28T02:26:37.571947] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-28T02:26:37.572020] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-28T02:26:37.572101] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-28T02:26:37.572176] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-28T02:26:37.664233] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-28T02:26:37.689578] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-28T02:26:37.689791] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-28T02:26:37.703292] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-28T02:26:37.865163] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-28T02:26:37.878043] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-28T02:26:37.986076] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:37.986434] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-28T02:26:38.088593] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-28T02:26:38.089747] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-28T02:26:38.191956] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-28T02:26:38.193031] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-28T02:26:38.257255] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-28T02:26:38.258309] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-28T02:26:38.342582] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-28T02:26:38.343721] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-28T02:26:38.377521] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-28T02:26:38.379028] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-28T02:26:38.552417] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-28T02:26:38.553880] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-28T02:26:38.767679] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-28T02:26:38.768784] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-28T02:26:38.810634] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-28T02:26:38.811975] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-28T02:26:38.862469] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-28T02:26:38.864119] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-28T02:26:38.887961] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-28T02:26:38.888841] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-09-28T02:26:38.888968] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-28T02:26:38.889575] [FATAL] [VALIDATOR ] SAJ: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:26:38.889695] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:26:38.889796] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:26:38.889927] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-28T02:26:38.890050] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-28T02:26:38.890147] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-28T02:26:38.890263] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-28T02:26:38.890411] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SAJ took 5.5s. Estimated remaining: 6m 29s. Rate: 77.4 symbols/min [2025-09-28T02:26:39.077703] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:39.073536] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-28T02:26:39.079132] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-28T02:26:39.116300] [DEBUG] [LOCAL ] SB: Loaded 33735 existing records from primary storage. [2025-09-28T02:26:39.116774] [INFO ] [MAIN ] SB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:39.116900] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SB took 0.2s. Estimated remaining: 6m 28s. Rate: 77.4 symbols/min [2025-09-28T02:26:39.190182] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-28T02:26:39.209283] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-28T02:26:39.278626] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-28T02:26:39.312621] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-28T02:26:39.314371] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:39.315341] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-28T02:26:39.315427] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-28T02:26:39.315553] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-28T02:26:39.315639] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-28T02:26:39.315768] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-28T02:26:39.315852] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-28T02:26:39.479034] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-28T02:26:39.498974] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-28T02:26:39.617465] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-28T02:26:39.645252] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-28T02:26:39.734117] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-28T02:26:39.738665] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:26:39.739207] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-28T02:26:39.740352] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-28T02:26:39.933366] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-28T02:26:39.934573] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-28T02:26:39.947811] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:26:39.948122] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-28T02:26:39.948225] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:26:39.948316] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-09-28T02:26:39.948401] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:26:39.948491] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-28T02:26:39.948607] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-28T02:26:39.948725] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-28T02:26:39.948846] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-28T02:26:39.948980] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SBDS took 0.8s. Estimated remaining: 6m 27s. Rate: 77.4 symbols/min [2025-09-28T02:26:40.064073] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-28T02:26:40.065600] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-28T02:26:40.149808] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-28T02:26:40.154076] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:40.155571] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-28T02:26:40.208834] [DEBUG] [LOCAL ] SBH: Loaded 50565 existing records from primary storage. [2025-09-28T02:26:40.209235] [INFO ] [MAIN ] SBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:40.209353] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SBH took 0.3s. Estimated remaining: 6m 26s. Rate: 77.5 symbols/min [2025-09-28T02:26:40.311054] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-28T02:26:40.324763] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-28T02:26:40.404451] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:40.414532] [DEBUG] [LOCAL ] SBI: Loaded 7848 existing records from primary storage. [2025-09-28T02:26:40.414824] [INFO ] [MAIN ] SBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:40.414926] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SBI took 0.2s. Estimated remaining: 6m 26s. Rate: 77.5 symbols/min [2025-09-28T02:26:40.600355] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-28T02:26:40.629353] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:40.632100] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-28T02:26:40.643664] [DEBUG] [LOCAL ] SBR: Loaded 7350 existing records from primary storage. [2025-09-28T02:26:40.643956] [INFO ] [MAIN ] SBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:40.644065] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SBR took 0.2s. Estimated remaining: 6m 25s. Rate: 77.5 symbols/min [2025-09-28T02:26:40.720167] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-28T02:26:40.739293] [INFO ] [REMOTE ] SAT: Full fetch complete (1599 records). [2025-09-28T02:26:40.751973] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-28T02:26:41.000850] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:41.049290] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-28T02:26:41.060313] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-28T02:26:41.058016] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-28T02:26:41.061690] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:26:41.061807] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:26:41.061890] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-28T02:26:41.061979] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-28T02:26:41.062051] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-28T02:26:41.062134] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-28T02:26:41.062236] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SAT took 5.5s. Estimated remaining: 6m 24s. Rate: 77.5 symbols/min [2025-09-28T02:26:41.270848] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:41.292137] [DEBUG] [LOCAL ] SBS: Loaded 50166 existing records from primary storage. [2025-09-28T02:26:41.295800] [INFO ] [MAIN ] SBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:41.295932] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBS took 0.7s. Estimated remaining: 6m 23s. Rate: 77.6 symbols/min [2025-09-28T02:26:41.387767] [DEBUG] [LOCAL ] SBSI: Loaded 14974 existing records from primary storage. [2025-09-28T02:26:41.412325] [INFO ] [MAIN ] SBSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:41.418103] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBSI took 0.4s. Estimated remaining: 6m 22s. Rate: 77.6 symbols/min [2025-09-28T02:26:41.492509] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:26:41.495803] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-28T02:26:41.497593] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-28T02:26:41.557009] [DEBUG] [LOCAL ] SBSW: Loaded 53745 existing records from primary storage. [2025-09-28T02:26:41.557484] [INFO ] [MAIN ] SBSW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:26:41.557592] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBSW took 0.3s. Estimated remaining: 6m 21s. Rate: 77.6 symbols/min [2025-09-28T02:26:41.918765] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-28T02:26:41.919917] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-28T02:26:42.267804] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-28T02:26:42.268786] [INFO ] [REMOTE ] SAZ: Full fetch complete (1809 records). [2025-09-28T02:26:42.268882] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-28T02:26:42.463045] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:26:42.463287] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:26:42.463362] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:26:42.463441] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-28T02:26:42.463543] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-28T02:26:42.463617] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-28T02:26:42.463748] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-28T02:26:42.463869] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SAZ took 5.1s. Estimated remaining: 6m 20s. Rate: 77.6 symbols/min [2025-09-28T02:28:13.761451] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (93.61 seconds). [2025-09-28T02:28:13.762932] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-28T02:28:14.120631] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-28T02:28:14.121864] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-28T02:28:14.703453] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-28T02:28:14.704557] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-28T02:28:15.047130] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-28T02:28:15.047977] [INFO ] [REMOTE ] SAY: Full fetch complete (1412 records). [2025-09-28T02:28:15.048087] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-28T02:28:15.251490] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-28T02:28:15.251752] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:28:15.251827] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:28:15.251909] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-28T02:28:15.252042] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-28T02:28:15.252128] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-28T02:28:15.252212] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-28T02:28:15.252310] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SAY took 1m 39s. Estimated remaining: 6m 43s. Rate: 73.0 symbols/min [2025-09-28T02:28:15.898852] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:16.025050] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:16.075451] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:16.157807] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-28T02:28:16.159460] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:16.160199] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-28T02:28:16.161013] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-28T02:28:16.161102] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-28T02:28:16.161167] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-28T02:28:16.161221] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-28T02:28:16.264533] [DEBUG] [LOCAL ] SCD: Loaded 12749 existing records from primary storage. [2025-09-28T02:28:16.288051] [INFO ] [MAIN ] SCD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:16.310015] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SCD took 1.1s. Estimated remaining: 6m 43s. Rate: 73.0 symbols/min [2025-09-28T02:28:16.608039] [DEBUG] [LOCAL ] SCCO: Loaded 50148 existing records from primary storage. [2025-09-28T02:28:16.663321] [INFO ] [MAIN ] SCCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:16.719638] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-09-28T02:28:16.727598] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCCO took 1.5s. Estimated remaining: 6m 42s. Rate: 73.0 symbols/min [2025-09-28T02:28:16.757241] [INFO ] [MAIN ] SCHW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:16.850438] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCHW took 1.6s. Estimated remaining: 6m 41s. Rate: 73.1 symbols/min [2025-09-28T02:28:16.831384] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:28:16.885027] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:16.920140] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-28T02:28:17.225752] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:17.299411] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-28T02:28:17.304239] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:17.305414] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-28T02:28:17.328396] [DEBUG] [LOCAL ] SCI: Loaded 47257 existing records from primary storage. [2025-09-28T02:28:17.333809] [INFO ] [MAIN ] SCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:17.334106] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCI took 1.0s. Estimated remaining: 6m 40s. Rate: 73.1 symbols/min [2025-09-28T02:28:17.423934] [DEBUG] [LOCAL ] SCL: Loaded 15113 existing records from primary storage. [2025-09-28T02:28:17.430435] [INFO ] [MAIN ] SCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:17.439262] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCL took 0.7s. Estimated remaining: 6m 39s. Rate: 73.1 symbols/min [2025-09-28T02:28:17.634459] [DEBUG] [LOCAL ] SCM: Loaded 20163 existing records from primary storage. [2025-09-28T02:28:17.644574] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-28T02:28:17.689407] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:17.689589] [INFO ] [MAIN ] SCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:17.739444] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCM took 0.8s. Estimated remaining: 6m 38s. Rate: 73.1 symbols/min [2025-09-28T02:28:17.691076] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-28T02:28:17.768129] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:17.992719] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:18.005210] [DEBUG] [LOCAL ] SD: Loaded 29368 existing records from primary storage. [2025-09-28T02:28:18.006044] [INFO ] [MAIN ] SD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:18.006190] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SD took 0.5s. Estimated remaining: 6m 37s. Rate: 73.2 symbols/min [2025-09-28T02:28:18.112390] [DEBUG] [LOCAL ] SCS: Loaded 43834 existing records from primary storage. [2025-09-28T02:28:18.122471] [DEBUG] [LOCAL ] SDHC: Loaded 10686 existing records from primary storage. [2025-09-28T02:28:18.143749] [INFO ] [MAIN ] SDHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:18.135129] [INFO ] [MAIN ] SCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:18.148378] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SDHC took 0.4s. Estimated remaining: 6m 36s. Rate: 73.2 symbols/min [2025-09-28T02:28:18.172024] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-28T02:28:18.215369] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SCS took 0.8s. Estimated remaining: 6m 35s. Rate: 73.2 symbols/min [2025-09-28T02:28:18.217097] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-28T02:28:18.371140] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:18.548360] [DEBUG] [LOCAL ] SDHY: Loaded 10710 existing records from primary storage. [2025-09-28T02:28:18.622843] [INFO ] [MAIN ] SDHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:18.646052] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:18.641607] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SDHY took 0.6s. Estimated remaining: 6m 34s. Rate: 73.2 symbols/min [2025-09-28T02:28:18.622602] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:18.652573] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-09-28T02:28:18.661632] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-28T02:28:18.661833] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-09-28T02:28:18.693077] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-28T02:28:18.694259] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-28T02:28:18.699538] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-28T02:28:18.737107] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-28T02:28:18.756980] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-28T02:28:18.992384] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:19.008688] [DEBUG] [LOCAL ] SDRL: Loaded 42459 existing records from primary storage. [2025-09-28T02:28:19.025100] [INFO ] [MAIN ] SDRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:19.074892] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SDRL took 0.9s. Estimated remaining: 6m 33s. Rate: 73.3 symbols/min [2025-09-28T02:28:19.075049] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-28T02:28:19.130888] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-28T02:28:19.601365] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:19.605262] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-28T02:28:19.607083] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-28T02:28:19.632892] [DEBUG] [LOCAL ] SEE: Loaded 49069 existing records from primary storage. [2025-09-28T02:28:19.696345] [INFO ] [MAIN ] SEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:19.726167] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:28:19.727448] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-28T02:28:19.726393] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SEE took 1.1s. Estimated remaining: 6m 32s. Rate: 73.3 symbols/min [2025-09-28T02:28:19.747357] [DEBUG] [LOCAL ] SEG: Loaded 13887 existing records from primary storage. [2025-09-28T02:28:19.806072] [INFO ] [MAIN ] SEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:19.846594] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SEG took 0.8s. Estimated remaining: 6m 31s. Rate: 73.3 symbols/min [2025-09-28T02:28:20.111225] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:20.172980] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:20.233806] [DEBUG] [LOCAL ] SEM: Loaded 43533 existing records from primary storage. [2025-09-28T02:28:20.247486] [INFO ] [MAIN ] SEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:20.247710] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SEM took 0.4s. Estimated remaining: 6m 30s. Rate: 73.3 symbols/min [2025-09-28T02:28:20.248358] [DEBUG] [LOCAL ] SEI: Loaded 50411 existing records from primary storage. [2025-09-28T02:28:20.297176] [INFO ] [MAIN ] SEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:20.311577] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEI took 0.6s. Estimated remaining: 6m 29s. Rate: 73.4 symbols/min [2025-09-28T02:28:20.578403] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:20.653060] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-28T02:28:20.657293] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:20.661175] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-28T02:28:20.699938] [DEBUG] [LOCAL ] SEMR: Loaded 42184 existing records from primary storage. [2025-09-28T02:28:20.700685] [INFO ] [MAIN ] SEMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:20.700842] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEMR took 0.5s. Estimated remaining: 6m 28s. Rate: 73.4 symbols/min [2025-09-28T02:28:20.932320] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:20.934169] [DEBUG] [LOCAL ] SES: Loaded 52331 existing records from primary storage. [2025-09-28T02:28:20.935092] [INFO ] [MAIN ] SES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:20.935883] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SES took 0.6s. Estimated remaining: 6m 27s. Rate: 73.4 symbols/min [2025-09-28T02:28:21.137365] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:21.145149] [DEBUG] [LOCAL ] SFB: Loaded 4046 existing records from primary storage. [2025-09-28T02:28:21.157745] [INFO ] [MAIN ] SFB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:21.159337] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SFB took 0.2s. Estimated remaining: 6m 26s. Rate: 73.4 symbols/min [2025-09-28T02:28:21.193438] [DEBUG] [LOCAL ] SF: Loaded 42360 existing records from primary storage. [2025-09-28T02:28:21.229556] [INFO ] [MAIN ] SF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:21.272971] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SF took 0.6s. Estimated remaining: 6m 25s. Rate: 73.5 symbols/min [2025-09-28T02:28:21.437868] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-28T02:28:21.478173] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:21.481799] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-28T02:28:21.577733] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:21.588517] [DEBUG] [LOCAL ] SFBS: Loaded 21483 existing records from primary storage. [2025-09-28T02:28:21.588894] [INFO ] [MAIN ] SFBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:21.589021] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SFBS took 0.4s. Estimated remaining: 6m 25s. Rate: 73.5 symbols/min [2025-09-28T02:28:21.780167] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:21.840827] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-28T02:28:21.855992] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-28T02:28:21.861570] [DEBUG] [LOCAL ] SFL: Loaded 46026 existing records from primary storage. [2025-09-28T02:28:21.862326] [INFO ] [MAIN ] SFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:21.862526] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFL took 0.6s. Estimated remaining: 6m 24s. Rate: 73.5 symbols/min [2025-09-28T02:28:22.008576] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-28T02:28:22.078144] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-28T02:28:22.077191] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:22.099131] [DEBUG] [LOCAL ] SG: Loaded 54227 existing records from primary storage. [2025-09-28T02:28:22.100028] [INFO ] [MAIN ] SG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:22.100156] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SG took 0.5s. Estimated remaining: 6m 23s. Rate: 73.5 symbols/min [2025-09-28T02:28:22.310677] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:22.326331] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-28T02:28:22.326456] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-28T02:28:22.326702] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-28T02:28:22.326802] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-28T02:28:22.327922] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-28T02:28:22.328032] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-28T02:28:22.327792] [DEBUG] [LOCAL ] SGHC: Loaded 46435 existing records from primary storage. [2025-09-28T02:28:22.377786] [INFO ] [MAIN ] SGHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:22.401719] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SGHC took 0.5s. Estimated remaining: 6m 22s. Rate: 73.6 symbols/min [2025-09-28T02:28:22.469569] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-28T02:28:22.495958] [INFO ] [REMOTE ] SBXD: Full fetch complete (3078 records). [2025-09-28T02:28:22.520632] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-28T02:28:22.531854] [FATAL] [VALIDATOR ] SBXD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:28:22.558430] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:28:22.584568] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:28:22.665576] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-28T02:28:22.732255] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-28T02:28:22.770133] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-28T02:28:22.785884] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-28T02:28:22.791193] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SBXD took 7.5s. Estimated remaining: 6m 21s. Rate: 73.6 symbols/min [2025-09-28T02:28:22.992485] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:23.159916] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:28:23.211155] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:23.215311] [DEBUG] [LOCAL ] SGU: Loaded 6765 existing records from primary storage. [2025-09-28T02:28:23.216195] [INFO ] [MAIN ] SGU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:23.215724] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-28T02:28:23.216594] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SGU took 0.8s. Estimated remaining: 6m 20s. Rate: 73.6 symbols/min [2025-09-28T02:28:23.425677] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:23.469879] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:28:23.471460] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-28T02:28:23.471720] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:28:23.471372] [DEBUG] [LOCAL ] SHAK: Loaded 49831 existing records from primary storage. [2025-09-28T02:28:23.471968] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-09-28T02:28:23.472139] [INFO ] [MAIN ] SHAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:23.472199] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:28:23.472876] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SHAK took 0.7s. Estimated remaining: 6m 19s. Rate: 73.6 symbols/min [2025-09-28T02:28:23.472470] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-28T02:28:23.479104] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-28T02:28:23.505822] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-28T02:28:23.531041] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-28T02:28:23.580999] [DEBUG] [LOCAL ] SHCO: Loaded 26427 existing records from primary storage. [2025-09-28T02:28:23.597085] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SGI took 1.5s. Estimated remaining: 6m 18s. Rate: 73.7 symbols/min [2025-09-28T02:28:23.602049] [INFO ] [MAIN ] SHCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:23.669035] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHCO took 0.5s. Estimated remaining: 6m 17s. Rate: 73.7 symbols/min [2025-09-28T02:28:23.738814] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:24.015613] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:24.106636] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:24.166253] [DEBUG] [LOCAL ] SHEL: Loaded 54451 existing records from primary storage. [2025-09-28T02:28:24.164677] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-28T02:28:24.177074] [INFO ] [MAIN ] SHEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:24.178623] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHEL took 0.7s. Estimated remaining: 6m 16s. Rate: 73.7 symbols/min [2025-09-28T02:28:24.191201] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-28T02:28:24.289539] [DEBUG] [LOCAL ] SHG: Loaded 27307 existing records from primary storage. [2025-09-28T02:28:24.302197] [INFO ] [MAIN ] SHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:24.302817] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHG took 0.7s. Estimated remaining: 6m 15s. Rate: 73.7 symbols/min [2025-09-28T02:28:24.440001] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:24.531503] [DEBUG] [LOCAL ] SHO: Loaded 50552 existing records from primary storage. [2025-09-28T02:28:24.545221] [DEBUG] [LOCAL ] SHOC: Loaded 3747 existing records from primary storage. [2025-09-28T02:28:24.550764] [INFO ] [MAIN ] SHOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:24.556101] [INFO ] [MAIN ] SHO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:24.556278] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SHO took 0.8s. Estimated remaining: 6m 14s. Rate: 73.8 symbols/min [2025-09-28T02:28:24.667623] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:24.571898] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SHOC took 0.4s. Estimated remaining: 6m 13s. Rate: 73.8 symbols/min [2025-09-28T02:28:24.946541] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:24.958359] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-28T02:28:24.963727] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-28T02:28:24.963890] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-28T02:28:24.963974] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-28T02:28:24.974472] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-28T02:28:24.990065] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-28T02:28:25.079860] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:25.194126] [DEBUG] [LOCAL ] SHW: Loaded 51174 existing records from primary storage. [2025-09-28T02:28:25.221498] [INFO ] [MAIN ] SHW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:25.226900] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHW took 0.9s. Estimated remaining: 6m 12s. Rate: 73.8 symbols/min [2025-09-28T02:28:25.626923] [DEBUG] [LOCAL ] SID: Loaded 42834 existing records from primary storage. [2025-09-28T02:28:25.706893] [INFO ] [MAIN ] SID: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:25.711104] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:25.718257] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SID took 1.0s. Estimated remaining: 6m 11s. Rate: 73.8 symbols/min [2025-09-28T02:28:25.717817] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:28:25.731275] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-28T02:28:25.916524] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:25.954362] [DEBUG] [LOCAL ] SIG: Loaded 47111 existing records from primary storage. [2025-09-28T02:28:25.955167] [INFO ] [MAIN ] SIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:25.955331] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SIG took 0.7s. Estimated remaining: 6m 10s. Rate: 73.9 symbols/min [2025-09-28T02:28:26.046236] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:28:26.068087] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-28T02:28:26.079057] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:28:26.088568] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-09-28T02:28:26.088850] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:28:26.094880] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-28T02:28:26.144317] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-28T02:28:26.163024] [DEBUG] [LOCAL ] SII: Loaded 23644 existing records from primary storage. [2025-09-28T02:28:26.163226] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-28T02:28:26.165300] [INFO ] [MAIN ] SII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:26.181363] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SII took 0.5s. Estimated remaining: 6m 9s. Rate: 73.9 symbols/min [2025-09-28T02:28:26.183856] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-28T02:28:26.204809] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SI took 1.6s. Estimated remaining: 6m 8s. Rate: 73.9 symbols/min [2025-09-28T02:28:26.191602] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:26.340628] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-28T02:28:26.400184] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-28T02:28:26.430036] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:26.455429] [DEBUG] [LOCAL ] SILA: Loaded 31635 existing records from primary storage. [2025-09-28T02:28:26.455840] [INFO ] [MAIN ] SILA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:26.456021] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SILA took 0.5s. Estimated remaining: 6m 8s. Rate: 74.0 symbols/min [2025-09-28T02:28:26.498515] [DEBUG] [LOCAL ] SITC: Loaded 42233 existing records from primary storage. [2025-09-28T02:28:26.499042] [INFO ] [MAIN ] SITC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:26.499151] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SITC took 0.3s. Estimated remaining: 6m 7s. Rate: 74.0 symbols/min [2025-09-28T02:28:28.674235] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-28T02:28:28.685807] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-28T02:28:30.631812] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-28T02:28:30.643240] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-28T02:28:32.876009] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-28T02:28:32.887800] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-28T02:28:34.825371] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-28T02:28:34.836537] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-28T02:28:37.026246] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-28T02:28:37.038193] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-28T02:28:39.040272] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-28T02:28:39.052138] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-28T02:28:41.062184] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-28T02:28:41.073271] [INFO ] [REMOTE ] SE: Full fetch complete (77065 records). [2025-09-28T02:28:41.073519] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-28T02:28:41.511573] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-09-28T02:28:41.511722] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-09-28T02:28:41.512596] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-09-28T02:28:41.512706] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-09-28T02:28:41.514487] [DEBUG] [LOCAL ] SE: Trimmed 77065 records to 54140 (keeping 200 days of data) [2025-09-28T02:28:41.847495] [DEBUG] [LOCAL ] SE: Primary data saved (54140 records). [2025-09-28T02:28:41.847723] [INFO ] [MAIN ] SE: Full history saved. [2025-09-28T02:28:41.847884] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SE took 23.6s. Estimated remaining: 6m 9s. Rate: 73.3 symbols/min [2025-09-28T02:28:42.561312] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:42.576346] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:42.641250] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:42.671216] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:42.699892] [DEBUG] [LOCAL ] SJT: Loaded 22419 existing records from primary storage. [2025-09-28T02:28:42.700254] [INFO ] [MAIN ] SJT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:42.700372] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SJT took 0.9s. Estimated remaining: 6m 8s. Rate: 73.3 symbols/min [2025-09-28T02:28:42.869460] [DEBUG] [LOCAL ] SITE: Loaded 35513 existing records from primary storage. [2025-09-28T02:28:42.894137] [INFO ] [MAIN ] SITE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:42.912490] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SITE took 1.1s. Estimated remaining: 6m 7s. Rate: 73.3 symbols/min [2025-09-28T02:28:42.924934] [DEBUG] [LOCAL ] SKE: Loaded 36252 existing records from primary storage. [2025-09-28T02:28:42.990743] [INFO ] [MAIN ] SKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:42.990512] [DEBUG] [LOCAL ] SJM: Loaded 50877 existing records from primary storage. [2025-09-28T02:28:43.012856] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SKE took 1.1s. Estimated remaining: 6m 6s. Rate: 73.4 symbols/min [2025-09-28T02:28:43.014364] [INFO ] [MAIN ] SJM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:43.014166] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:43.037077] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SJM took 1.2s. Estimated remaining: 6m 5s. Rate: 73.4 symbols/min [2025-09-28T02:28:43.327941] [DEBUG] [LOCAL ] SKIL: Loaded 6395 existing records from primary storage. [2025-09-28T02:28:43.353237] [INFO ] [MAIN ] SKIL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:43.420576] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKIL took 0.7s. Estimated remaining: 6m 4s. Rate: 73.4 symbols/min [2025-09-28T02:28:43.533467] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:43.594077] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:43.603762] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:43.763795] [DEBUG] [LOCAL ] SKLZ: Loaded 12122 existing records from primary storage. [2025-09-28T02:28:43.799847] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:43.798142] [INFO ] [MAIN ] SKLZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:43.800545] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKLZ took 0.9s. Estimated remaining: 6m 4s. Rate: 73.4 symbols/min [2025-09-28T02:28:43.951508] [DEBUG] [LOCAL ] SKM: Loaded 35557 existing records from primary storage. [2025-09-28T02:28:43.958752] [DEBUG] [LOCAL ] SKT: Loaded 43227 existing records from primary storage. [2025-09-28T02:28:43.974689] [INFO ] [MAIN ] SKM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:44.005914] [INFO ] [MAIN ] SKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:44.020086] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKM took 1.0s. Estimated remaining: 6m 3s. Rate: 73.5 symbols/min [2025-09-28T02:28:44.053243] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKT took 1.0s. Estimated remaining: 6m 2s. Rate: 73.5 symbols/min [2025-09-28T02:28:44.060498] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:44.197003] [DEBUG] [LOCAL ] SKY: Loaded 38305 existing records from primary storage. [2025-09-28T02:28:44.305595] [INFO ] [MAIN ] SKY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:44.347615] [DEBUG] [LOCAL ] SKYH: Loaded 16851 existing records from primary storage. [2025-09-28T02:28:44.393290] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKY took 0.9s. Estimated remaining: 6m 1s. Rate: 73.5 symbols/min [2025-09-28T02:28:44.393057] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:44.393499] [INFO ] [MAIN ] SKYH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:44.442058] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SKYH took 0.6s. Estimated remaining: 5m 60s. Rate: 73.6 symbols/min [2025-09-28T02:28:44.602965] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:44.871441] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:44.891855] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:44.937701] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-09-28T02:28:44.939264] [DEBUG] [LOCAL ] SLF: Loaded 39426 existing records from primary storage. [2025-09-28T02:28:44.939667] [INFO ] [MAIN ] SLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:44.940557] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLB took 0.9s. Estimated remaining: 5m 59s. Rate: 73.6 symbols/min [2025-09-28T02:28:44.941105] [INFO ] [MAIN ] SLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:44.946962] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLF took 0.9s. Estimated remaining: 5m 58s. Rate: 73.6 symbols/min [2025-09-28T02:28:45.334969] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:45.341592] [DEBUG] [LOCAL ] SLGN: Loaded 41039 existing records from primary storage. [2025-09-28T02:28:45.421972] [DEBUG] [LOCAL ] SLG: Loaded 46130 existing records from primary storage. [2025-09-28T02:28:45.400833] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-28T02:28:45.422538] [INFO ] [MAIN ] SLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:45.420969] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:45.422716] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLG took 1.0s. Estimated remaining: 5m 57s. Rate: 73.6 symbols/min [2025-09-28T02:28:45.422290] [INFO ] [MAIN ] SLGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:45.422172] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-28T02:28:45.448254] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-28T02:28:45.436224] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLGN took 1.0s. Estimated remaining: 5m 56s. Rate: 73.7 symbols/min [2025-09-28T02:28:45.465409] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-28T02:28:45.536236] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-28T02:28:45.594451] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-28T02:28:45.853195] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:45.980161] [DEBUG] [LOCAL ] SLQT: Loaded 44370 existing records from primary storage. [2025-09-28T02:28:46.010879] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:46.056809] [INFO ] [MAIN ] SLQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:46.064690] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SLQT took 1.1s. Estimated remaining: 5m 55s. Rate: 73.7 symbols/min [2025-09-28T02:28:46.298460] [DEBUG] [LOCAL ] SLVM: Loaded 28332 existing records from primary storage. [2025-09-28T02:28:46.354549] [INFO ] [MAIN ] SLVM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:46.431058] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SLVM took 1.0s. Estimated remaining: 5m 54s. Rate: 73.7 symbols/min [2025-09-28T02:28:46.584264] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:28:46.603920] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:46.661348] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-28T02:28:46.650593] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-28T02:28:46.676242] [DEBUG] [LOCAL ] SM: Loaded 53080 existing records from primary storage. [2025-09-28T02:28:46.677574] [INFO ] [MAIN ] SM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:46.677816] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-28T02:28:46.677740] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SM took 1.2s. Estimated remaining: 5m 53s. Rate: 73.7 symbols/min [2025-09-28T02:28:46.717128] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-28T02:28:46.759280] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-28T02:28:46.778727] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-28T02:28:46.827283] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-28T02:28:46.827150] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:47.011482] [DEBUG] [LOCAL ] SMBK: Loaded 8332 existing records from primary storage. [2025-09-28T02:28:47.088320] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:47.088678] [INFO ] [MAIN ] SMBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:47.128576] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SMBK took 0.7s. Estimated remaining: 5m 52s. Rate: 73.7 symbols/min [2025-09-28T02:28:47.122341] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-28T02:28:47.181343] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-28T02:28:47.348943] [DEBUG] [LOCAL ] SMC: Loaded 11630 existing records from primary storage. [2025-09-28T02:28:47.388571] [INFO ] [MAIN ] SMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:47.388879] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SMC took 0.7s. Estimated remaining: 5m 51s. Rate: 73.8 symbols/min [2025-09-28T02:28:47.655878] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:28:47.677264] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-28T02:28:47.675094] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-28T02:28:47.712115] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-28T02:28:47.720685] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:47.804008] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:47.859851] [DEBUG] [LOCAL ] SMG: Loaded 44546 existing records from primary storage. [2025-09-28T02:28:47.873536] [INFO ] [MAIN ] SMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:47.873685] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SMG took 0.5s. Estimated remaining: 5m 50s. Rate: 73.8 symbols/min [2025-09-28T02:28:47.874473] [DEBUG] [LOCAL ] SMFG: Loaded 48771 existing records from primary storage. [2025-09-28T02:28:47.907999] [INFO ] [MAIN ] SMFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:47.935062] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMFG took 0.8s. Estimated remaining: 5m 49s. Rate: 73.8 symbols/min [2025-09-28T02:28:48.006191] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:28:48.039513] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-28T02:28:48.107372] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:28:48.162808] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-09-28T02:28:48.193696] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:28:48.214044] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-28T02:28:48.203138] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:48.235341] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-28T02:28:48.263286] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:48.263388] [DEBUG] [LOCAL ] SMHI: No existing data file found in primary storage. [2025-09-28T02:28:48.259243] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-28T02:28:48.264232] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-28T02:28:48.264020] [WARN ] [MAIN ] SMHI: No existing data found, performing full refresh instead. [2025-09-28T02:28:48.264463] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-28T02:28:48.264678] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMA took 2.2s. Estimated remaining: 5m 49s. Rate: 73.8 symbols/min [2025-09-28T02:28:48.264564] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-28T02:28:48.270228] [DEBUG] [LOCAL ] SMHI: No primary data file found to delete. [2025-09-28T02:28:48.270458] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-28T02:28:48.338983] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-28T02:28:48.378360] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-28T02:28:48.599890] [DEBUG] [LOCAL ] SMP: Loaded 19999 existing records from primary storage. [2025-09-28T02:28:48.645149] [INFO ] [MAIN ] SMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:48.696811] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMP took 0.7s. Estimated remaining: 5m 48s. Rate: 73.9 symbols/min [2025-09-28T02:28:48.777689] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:48.809967] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-28T02:28:48.832576] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-09-28T02:28:48.855286] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-09-28T02:28:48.834058] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-28T02:28:48.883760] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-28T02:28:48.915043] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-28T02:28:48.945052] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-28T02:28:48.950506] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-28T02:28:48.960404] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:28:49.019757] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-28T02:28:49.270789] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:49.401865] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-28T02:28:49.450457] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-28T02:28:49.559869] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:28:49.560342] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-28T02:28:49.577235] [DEBUG] [LOCAL ] SMRT: Loaded 44707 existing records from primary storage. [2025-09-28T02:28:49.577691] [INFO ] [MAIN ] SMRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:49.577820] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMRT took 0.8s. Estimated remaining: 5m 47s. Rate: 73.9 symbols/min [2025-09-28T02:28:49.756992] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:49.793576] [DEBUG] [LOCAL ] SMWB: Loaded 33137 existing records from primary storage. [2025-09-28T02:28:49.793930] [INFO ] [MAIN ] SMWB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:49.794415] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMWB took 0.2s. Estimated remaining: 5m 46s. Rate: 73.9 symbols/min [2025-09-28T02:28:49.882096] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-28T02:28:49.908512] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-28T02:28:49.989512] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:50.045220] [DEBUG] [LOCAL ] SN: Loaded 50487 existing records from primary storage. [2025-09-28T02:28:50.045638] [INFO ] [MAIN ] SN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:50.046245] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SN took 0.3s. Estimated remaining: 5m 45s. Rate: 73.9 symbols/min [2025-09-28T02:28:50.228200] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:50.258202] [DEBUG] [LOCAL ] SNA: Loaded 26608 existing records from primary storage. [2025-09-28T02:28:50.258539] [INFO ] [MAIN ] SNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:50.258670] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SNA took 0.2s. Estimated remaining: 5m 44s. Rate: 73.9 symbols/min [2025-09-28T02:28:50.319515] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-28T02:28:50.354622] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-28T02:28:50.451829] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:50.474728] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-28T02:28:50.482118] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-28T02:28:50.540700] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-09-28T02:28:50.541273] [INFO ] [MAIN ] SNAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:50.542021] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SNAP took 0.3s. Estimated remaining: 5m 43s. Rate: 74.0 symbols/min [2025-09-28T02:28:50.719782] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:50.728610] [DEBUG] [LOCAL ] SNDA: Loaded 4732 existing records from primary storage. [2025-09-28T02:28:50.728959] [INFO ] [MAIN ] SNDA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:50.729070] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SNDA took 0.2s. Estimated remaining: 5m 42s. Rate: 74.0 symbols/min [2025-09-28T02:28:50.828083] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-28T02:28:50.840774] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-28T02:28:50.925197] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:50.972442] [DEBUG] [LOCAL ] SNDR: Loaded 41368 existing records from primary storage. [2025-09-28T02:28:50.972914] [INFO ] [MAIN ] SNDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:50.973511] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SNDR took 0.2s. Estimated remaining: 5m 41s. Rate: 74.0 symbols/min [2025-09-28T02:28:51.157917] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:51.158173] [DEBUG] [LOCAL ] SNN: No existing data file found in primary storage. [2025-09-28T02:28:51.158252] [WARN ] [MAIN ] SNN: No existing data found, performing full refresh instead. [2025-09-28T02:28:51.158385] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-28T02:28:51.158462] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-28T02:28:51.158551] [DEBUG] [LOCAL ] SNN: No primary data file found to delete. [2025-09-28T02:28:51.158627] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-28T02:28:51.247514] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-28T02:28:51.273184] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-28T02:28:51.569154] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:28:51.569865] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-28T02:28:51.631732] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-28T02:28:51.636937] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-28T02:28:51.720942] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-28T02:28:51.722014] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1060 records). [2025-09-28T02:28:51.722113] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-28T02:28:51.917439] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:28:51.918190] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:28:51.918495] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:28:51.918594] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-28T02:28:51.918814] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-28T02:28:51.918920] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-28T02:28:51.919075] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-28T02:28:51.919249] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SLNZ took 7.0s. Estimated remaining: 5m 40s. Rate: 74.0 symbols/min [2025-09-28T02:28:52.084818] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-28T02:28:52.134982] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-28T02:28:52.166821] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:52.227420] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-09-28T02:28:52.227894] [INFO ] [MAIN ] SNOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:52.228000] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNOW took 0.3s. Estimated remaining: 5m 40s. Rate: 74.0 symbols/min [2025-09-28T02:28:52.416728] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:52.465924] [DEBUG] [LOCAL ] SNV: Loaded 49633 existing records from primary storage. [2025-09-28T02:28:52.466381] [INFO ] [MAIN ] SNV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:52.466974] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNV took 0.2s. Estimated remaining: 5m 39s. Rate: 74.1 symbols/min [2025-09-28T02:28:52.654000] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:52.678376] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-28T02:28:52.683066] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-28T02:28:52.720936] [DEBUG] [LOCAL ] SNX: Loaded 40540 existing records from primary storage. [2025-09-28T02:28:52.721579] [INFO ] [MAIN ] SNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:52.722296] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNX took 0.3s. Estimated remaining: 5m 38s. Rate: 74.1 symbols/min [2025-09-28T02:28:52.917852] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:52.975358] [DEBUG] [LOCAL ] SO: Loaded 54383 existing records from primary storage. [2025-09-28T02:28:52.975862] [INFO ] [MAIN ] SO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:52.976489] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SO took 0.3s. Estimated remaining: 5m 37s. Rate: 74.1 symbols/min [2025-09-28T02:28:53.161443] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:53.189159] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-28T02:28:53.198549] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-28T02:28:53.237350] [DEBUG] [LOCAL ] SOBO: Loaded 40211 existing records from primary storage. [2025-09-28T02:28:53.237763] [INFO ] [MAIN ] SOBO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:53.238289] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SOBO took 0.3s. Estimated remaining: 5m 36s. Rate: 74.1 symbols/min [2025-09-28T02:28:53.426831] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:28:53.482803] [DEBUG] [LOCAL ] SOC: Loaded 51041 existing records from primary storage. [2025-09-28T02:28:53.483461] [INFO ] [MAIN ] SOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:28:53.484216] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SOC took 0.2s. Estimated remaining: 5m 35s. Rate: 74.2 symbols/min [2025-09-28T02:28:53.721321] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-28T02:28:53.726137] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-28T02:28:54.580322] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-28T02:28:54.591343] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-28T02:28:54.642229] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-28T02:28:54.651309] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-28T02:28:54.854315] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-28T02:28:54.859891] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-28T02:28:55.961870] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-28T02:28:55.970316] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-28T02:28:55.982959] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-28T02:28:55.986815] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-28T02:28:56.969733] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-28T02:28:56.974028] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-28T02:28:57.027428] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-28T02:28:57.038332] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-28T02:28:57.276313] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-28T02:28:57.285820] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-28T02:28:57.924708] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-28T02:28:57.929875] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-28T02:28:58.764114] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-28T02:28:58.774941] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-28T02:28:58.817927] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-28T02:28:58.821737] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-28T02:28:59.505366] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-28T02:28:59.525129] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-28T02:28:59.524893] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-28T02:28:59.528956] [INFO ] [REMOTE ] SMHI: Full fetch complete (23897 records). [2025-09-28T02:28:59.529066] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-28T02:28:59.910998] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-28T02:28:59.911152] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-28T02:28:59.911880] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-28T02:28:59.911970] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-28T02:28:59.912817] [DEBUG] [LOCAL ] SMHI: Trimmed 23897 records to 13885 (keeping 200 days of data) [2025-09-28T02:28:59.993201] [DEBUG] [LOCAL ] SMHI: Primary data saved (13885 records). [2025-09-28T02:28:59.993455] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-28T02:28:59.993609] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SMHI took 12.1s. Estimated remaining: 5m 35s. Rate: 73.9 symbols/min [2025-09-28T02:29:00.367125] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-28T02:29:00.378486] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-28T02:29:01.810228] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-28T02:29:01.823585] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-28T02:29:02.073204] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-28T02:29:02.084685] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-28T02:29:03.769526] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-28T02:29:03.780603] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-28T02:29:04.505903] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-28T02:29:04.517940] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-28T02:29:05.464818] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-28T02:29:05.476580] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-28T02:29:06.976950] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-28T02:29:06.988586] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-28T02:29:07.144713] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-28T02:29:07.153960] [INFO ] [REMOTE ] SNN: Full fetch complete (63179 records). [2025-09-28T02:29:07.154221] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-28T02:29:07.573402] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-28T02:29:07.573543] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-28T02:29:07.574453] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-28T02:29:07.574545] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-28T02:29:07.576194] [DEBUG] [LOCAL ] SNN: Trimmed 63179 records to 45037 (keeping 200 days of data) [2025-09-28T02:29:07.872227] [DEBUG] [LOCAL ] SNN: Primary data saved (45037 records). [2025-09-28T02:29:07.872750] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-28T02:29:07.873208] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SNN took 16.9s. Estimated remaining: 5m 36s. Rate: 73.6 symbols/min [2025-09-28T02:29:09.944289] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-09-28T02:29:09.961490] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-28T02:29:12.742278] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-28T02:29:12.756287] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-28T02:29:15.554209] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-09-28T02:29:15.566454] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-09-28T02:29:15.566726] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-28T02:29:16.040128] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-09-28T02:29:16.040339] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-09-28T02:29:16.041373] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-09-28T02:29:16.041504] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-09-28T02:29:16.046447] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 54577 (keeping 200 days of data) [2025-09-28T02:29:16.410739] [DEBUG] [LOCAL ] SMR: Primary data saved (54577 records). [2025-09-28T02:29:16.411300] [INFO ] [MAIN ] SMR: Full history saved. [2025-09-28T02:29:16.411442] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SMR took 28.1s. Estimated remaining: 5m 37s. Rate: 73.2 symbols/min [2025-09-28T02:29:16.993387] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:17.082197] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:17.082271] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-28T02:29:17.182854] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:17.187321] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-28T02:29:17.209584] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:17.210767] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-28T02:29:17.211031] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-28T02:29:17.211887] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-28T02:29:17.212015] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-28T02:29:17.316361] [DEBUG] [LOCAL ] SOJE: Loaded 9408 existing records from primary storage. [2025-09-28T02:29:17.324709] [DEBUG] [LOCAL ] SOJC: Loaded 5120 existing records from primary storage. [2025-09-28T02:29:17.355542] [DEBUG] [LOCAL ] SOJD: Loaded 13180 existing records from primary storage. [2025-09-28T02:29:17.356207] [INFO ] [MAIN ] SOJC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:17.355863] [INFO ] [MAIN ] SOJE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:17.356714] [INFO ] [MAIN ] SOJD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:17.362305] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJC took 0.9s. Estimated remaining: 5m 36s. Rate: 73.2 symbols/min [2025-09-28T02:29:17.383296] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOJE took 1.0s. Estimated remaining: 5m 35s. Rate: 73.3 symbols/min [2025-09-28T02:29:17.468684] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJD took 1.0s. Estimated remaining: 5m 34s. Rate: 73.3 symbols/min [2025-09-28T02:29:17.957089] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:18.080998] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:29:18.127956] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-28T02:29:18.236937] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:18.237921] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:18.245561] [DEBUG] [LOCAL ] SOL: Loaded 13694 existing records from primary storage. [2025-09-28T02:29:18.245925] [INFO ] [MAIN ] SOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:18.246174] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOL took 0.9s. Estimated remaining: 5m 33s. Rate: 73.3 symbols/min [2025-09-28T02:29:18.479456] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:29:18.469021] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:18.480548] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-28T02:29:18.480767] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:29:18.480841] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-09-28T02:29:18.481911] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:29:18.482080] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-28T02:29:18.482304] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-28T02:29:18.482402] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-28T02:29:18.498197] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-28T02:29:18.498495] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOJF took 2.1s. Estimated remaining: 5m 32s. Rate: 73.3 symbols/min [2025-09-28T02:29:18.517795] [DEBUG] [LOCAL ] SOLV: Loaded 44791 existing records from primary storage. [2025-09-28T02:29:18.546774] [INFO ] [MAIN ] SOLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:18.552344] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SOLV took 1.1s. Estimated remaining: 5m 31s. Rate: 73.3 symbols/min [2025-09-28T02:29:18.598118] [DEBUG] [LOCAL ] SON: Loaded 43596 existing records from primary storage. [2025-09-28T02:29:18.683589] [INFO ] [MAIN ] SON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:18.738337] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SON took 1.1s. Estimated remaining: 5m 30s. Rate: 73.4 symbols/min [2025-09-28T02:29:18.871129] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:19.056568] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:19.060321] [DEBUG] [LOCAL ] SOR: Loaded 2947 existing records from primary storage. [2025-09-28T02:29:19.092814] [DEBUG] [LOCAL ] SONY: Loaded 54136 existing records from primary storage. [2025-09-28T02:29:19.110133] [INFO ] [MAIN ] SOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:19.131095] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SOR took 0.6s. Estimated remaining: 5m 29s. Rate: 73.4 symbols/min [2025-09-28T02:29:19.156942] [INFO ] [MAIN ] SONY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:19.221859] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:19.264455] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SONY took 1.0s. Estimated remaining: 5m 28s. Rate: 73.4 symbols/min [2025-09-28T02:29:19.281866] [DEBUG] [LOCAL ] SOS: Loaded 8266 existing records from primary storage. [2025-09-28T02:29:19.398137] [INFO ] [MAIN ] SOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:19.418308] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SOS took 0.8s. Estimated remaining: 5m 28s. Rate: 73.5 symbols/min [2025-09-28T02:29:19.709202] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:19.810155] [DEBUG] [LOCAL ] SPB: Loaded 34677 existing records from primary storage. [2025-09-28T02:29:19.845404] [INFO ] [MAIN ] SPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:19.855065] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:19.918913] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPB took 1.1s. Estimated remaining: 5m 27s. Rate: 73.5 symbols/min [2025-09-28T02:29:19.937701] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:20.039332] [DEBUG] [LOCAL ] SPE: Loaded 6441 existing records from primary storage. [2025-09-28T02:29:20.063209] [INFO ] [MAIN ] SPE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:20.106915] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPE took 0.8s. Estimated remaining: 5m 26s. Rate: 73.5 symbols/min [2025-09-28T02:29:20.172466] [DEBUG] [LOCAL ] SPCE: Loaded 50615 existing records from primary storage. [2025-09-28T02:29:20.178196] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:20.216068] [INFO ] [MAIN ] SPCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:20.265368] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPCE took 1.1s. Estimated remaining: 5m 25s. Rate: 73.5 symbols/min [2025-09-28T02:29:20.471913] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:20.552032] [DEBUG] [LOCAL ] SPG: Loaded 51134 existing records from primary storage. [2025-09-28T02:29:20.601528] [INFO ] [MAIN ] SPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:20.627187] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPG took 1.2s. Estimated remaining: 5m 24s. Rate: 73.6 symbols/min [2025-09-28T02:29:20.626332] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:20.709076] [DEBUG] [LOCAL ] SPGI: Loaded 46562 existing records from primary storage. [2025-09-28T02:29:20.692877] [DEBUG] [LOCAL ] SPH: Loaded 18213 existing records from primary storage. [2025-09-28T02:29:20.731725] [INFO ] [MAIN ] SPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:20.726432] [INFO ] [MAIN ] SPGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:20.737312] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPH took 0.6s. Estimated remaining: 5m 23s. Rate: 73.6 symbols/min [2025-09-28T02:29:20.771209] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPGI took 0.8s. Estimated remaining: 5m 22s. Rate: 73.6 symbols/min [2025-09-28T02:29:21.090581] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:21.178338] [DEBUG] [LOCAL ] SPHR: Loaded 40745 existing records from primary storage. [2025-09-28T02:29:21.248121] [INFO ] [MAIN ] SPHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:21.281122] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:21.300539] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPHR took 1.0s. Estimated remaining: 5m 21s. Rate: 73.6 symbols/min [2025-09-28T02:29:21.320972] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:21.333917] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-28T02:29:21.345126] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-28T02:29:21.391688] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-28T02:29:21.471837] [DEBUG] [LOCAL ] SPMC: Loaded 5613 existing records from primary storage. [2025-09-28T02:29:21.461071] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-28T02:29:21.489786] [INFO ] [MAIN ] SPMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:21.491427] [DEBUG] [LOCAL ] SPIR: Loaded 37871 existing records from primary storage. [2025-09-28T02:29:21.512563] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-28T02:29:21.524800] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-28T02:29:21.531725] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPMC took 0.8s. Estimated remaining: 5m 20s. Rate: 73.7 symbols/min [2025-09-28T02:29:21.535821] [INFO ] [MAIN ] SPIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:21.598756] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:21.656039] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPIR took 1.0s. Estimated remaining: 5m 19s. Rate: 73.7 symbols/min [2025-09-28T02:29:22.186812] [DEBUG] [LOCAL ] SPNT: Loaded 35342 existing records from primary storage. [2025-09-28T02:29:22.231068] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:22.226286] [INFO ] [MAIN ] SPNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:22.242360] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPNT took 0.9s. Estimated remaining: 5m 18s. Rate: 73.7 symbols/min [2025-09-28T02:29:22.386490] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:22.478756] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:29:22.496046] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-28T02:29:22.629733] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:22.662523] [DEBUG] [LOCAL ] SPOT: Loaded 51481 existing records from primary storage. [2025-09-28T02:29:22.663788] [INFO ] [MAIN ] SPOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:22.685599] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPOT took 1.1s. Estimated remaining: 5m 17s. Rate: 73.7 symbols/min [2025-09-28T02:29:22.685897] [DEBUG] [LOCAL ] SPRU: Loaded 8714 existing records from primary storage. [2025-09-28T02:29:22.687153] [DEBUG] [LOCAL ] SPR: Loaded 41867 existing records from primary storage. [2025-09-28T02:29:22.740786] [INFO ] [MAIN ] SPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:22.763397] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPR took 1.0s. Estimated remaining: 5m 16s. Rate: 73.8 symbols/min [2025-09-28T02:29:22.699851] [INFO ] [MAIN ] SPRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:22.797376] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:29:22.802736] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPRU took 0.5s. Estimated remaining: 5m 15s. Rate: 73.8 symbols/min [2025-09-28T02:29:22.858504] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-28T02:29:22.957211] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:29:23.084770] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:23.094526] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-09-28T02:29:23.145562] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:29:23.146057] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-28T02:29:23.198078] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:23.208762] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-28T02:29:23.225665] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-28T02:29:23.280181] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:23.280502] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-28T02:29:23.280749] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPME took 2.5s. Estimated remaining: 5m 15s. Rate: 73.8 symbols/min [2025-09-28T02:29:23.404235] [DEBUG] [LOCAL ] SPXX: Loaded 9166 existing records from primary storage. [2025-09-28T02:29:23.415242] [DEBUG] [LOCAL ] SPXC: Loaded 23666 existing records from primary storage. [2025-09-28T02:29:23.415719] [INFO ] [MAIN ] SPXX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:23.431683] [INFO ] [MAIN ] SPXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:23.432026] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXX took 0.6s. Estimated remaining: 5m 14s. Rate: 73.8 symbols/min [2025-09-28T02:29:23.432604] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SPXC took 0.7s. Estimated remaining: 5m 13s. Rate: 73.9 symbols/min [2025-09-28T02:29:23.713784] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:23.831810] [DEBUG] [LOCAL ] SQM: Loaded 49278 existing records from primary storage. [2025-09-28T02:29:23.920300] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:23.920476] [INFO ] [MAIN ] SQM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:23.961750] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQM took 1.1s. Estimated remaining: 5m 12s. Rate: 73.9 symbols/min [2025-09-28T02:29:23.961601] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:24.074096] [DEBUG] [LOCAL ] SQNS: Loaded 26307 existing records from primary storage. [2025-09-28T02:29:24.096249] [INFO ] [MAIN ] SQNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:24.141925] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SQNS took 0.9s. Estimated remaining: 5m 11s. Rate: 73.9 symbols/min [2025-09-28T02:29:24.178472] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:24.356197] [DEBUG] [LOCAL ] SR: Loaded 33411 existing records from primary storage. [2025-09-28T02:29:24.364170] [DEBUG] [LOCAL ] SRE: Loaded 54202 existing records from primary storage. [2025-09-28T02:29:24.379411] [INFO ] [MAIN ] SRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:24.379772] [DEBUG] [LOCAL ] SREA: Loaded 10561 existing records from primary storage. [2025-09-28T02:29:24.356856] [INFO ] [MAIN ] SR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:24.390513] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SR took 1.0s. Estimated remaining: 5m 10s. Rate: 73.9 symbols/min [2025-09-28T02:29:24.385283] [INFO ] [MAIN ] SREA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:24.415576] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SRE took 1.0s. Estimated remaining: 5m 9s. Rate: 74.0 symbols/min [2025-09-28T02:29:24.478848] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:24.490553] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SREA took 0.4s. Estimated remaining: 5m 8s. Rate: 74.0 symbols/min [2025-09-28T02:29:25.047947] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:24.972516] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:25.048367] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-28T02:29:25.018298] [DEBUG] [LOCAL ] SRFM: Loaded 36431 existing records from primary storage. [2025-09-28T02:29:25.049705] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-28T02:29:25.067763] [INFO ] [MAIN ] SRFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:25.068224] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRFM took 0.9s. Estimated remaining: 5m 7s. Rate: 74.0 symbols/min [2025-09-28T02:29:25.067915] [DEBUG] [LOCAL ] SRG: No existing data file found in primary storage. [2025-09-28T02:29:25.069403] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:25.068402] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-28T02:29:25.069911] [WARN ] [MAIN ] SRG: No existing data found, performing full refresh instead. [2025-09-28T02:29:25.075397] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-28T02:29:25.107476] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-28T02:29:25.102184] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-28T02:29:25.113755] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-28T02:29:25.119584] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-28T02:29:25.178428] [DEBUG] [LOCAL ] SRG: No primary data file found to delete. [2025-09-28T02:29:25.227221] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-28T02:29:25.463828] [DEBUG] [LOCAL ] SRI: Loaded 27810 existing records from primary storage. [2025-09-28T02:29:25.514184] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:25.546807] [INFO ] [MAIN ] SRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:25.564193] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRI took 1.1s. Estimated remaining: 5m 6s. Rate: 74.0 symbols/min [2025-09-28T02:29:25.916178] [DEBUG] [LOCAL ] SRV: Loaded 7631 existing records from primary storage. [2025-09-28T02:29:26.000096] [INFO ] [MAIN ] SRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:26.197624] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:26.078307] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRV took 1.0s. Estimated remaining: 5m 5s. Rate: 74.0 symbols/min [2025-09-28T02:29:26.179176] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:29:26.270812] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-28T02:29:26.359241] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:29:26.394695] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-28T02:29:26.477411] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:26.507059] [DEBUG] [LOCAL ] SSB: Loaded 43377 existing records from primary storage. [2025-09-28T02:29:26.507571] [INFO ] [MAIN ] SSB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:26.512206] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SSB took 0.9s. Estimated remaining: 5m 5s. Rate: 74.1 symbols/min [2025-09-28T02:29:26.640902] [DEBUG] [LOCAL ] SSD: Loaded 22631 existing records from primary storage. [2025-09-28T02:29:26.661825] [INFO ] [MAIN ] SSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:26.685745] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SSD took 0.5s. Estimated remaining: 5m 4s. Rate: 74.1 symbols/min [2025-09-28T02:29:26.755145] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:26.919930] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:26.945429] [DEBUG] [LOCAL ] SST: Loaded 12166 existing records from primary storage. [2025-09-28T02:29:26.945871] [INFO ] [MAIN ] SST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:26.945994] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SST took 0.2s. Estimated remaining: 5m 3s. Rate: 74.1 symbols/min [2025-09-28T02:29:26.966121] [DEBUG] [LOCAL ] SSL: Loaded 41830 existing records from primary storage. [2025-09-28T02:29:26.965186] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-28T02:29:26.967991] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-28T02:29:26.969039] [INFO ] [MAIN ] SSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:26.969786] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSL took 0.5s. Estimated remaining: 5m 2s. Rate: 74.2 symbols/min [2025-09-28T02:29:27.454881] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-28T02:29:27.456146] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-28T02:29:27.662177] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-28T02:29:27.668664] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-28T02:29:27.828067] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-28T02:29:27.829290] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-28T02:29:28.190093] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-28T02:29:28.191178] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-28T02:29:28.582740] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-28T02:29:28.584003] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-28T02:29:28.670930] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-28T02:29:28.677524] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-28T02:29:29.049248] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-28T02:29:29.050495] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-28T02:29:29.411306] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-28T02:29:29.412436] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-28T02:29:29.710059] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-28T02:29:29.714315] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-28T02:29:29.765459] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-28T02:29:29.766733] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-28T02:29:30.151922] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-28T02:29:30.153007] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-28T02:29:30.567291] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-28T02:29:30.572212] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-28T02:29:30.633310] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-28T02:29:30.634260] [INFO ] [REMOTE ] SRL: Full fetch complete (1966 records). [2025-09-28T02:29:30.634362] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-28T02:29:30.830418] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-28T02:29:30.830663] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:29:30.830734] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:29:30.830807] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-28T02:29:30.830909] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-28T02:29:30.830983] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-28T02:29:30.831086] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-28T02:29:30.831189] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SRL took 6.3s. Estimated remaining: 5m 2s. Rate: 74.0 symbols/min [2025-09-28T02:29:31.671700] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-28T02:29:31.677994] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-28T02:29:32.849361] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-28T02:29:32.853700] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-28T02:29:33.645498] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-28T02:29:33.648849] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-28T02:29:34.469571] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-28T02:29:34.473689] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-28T02:29:35.501218] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-28T02:29:35.505836] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-28T02:29:36.453825] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-28T02:29:36.457549] [INFO ] [REMOTE ] SRG: Full fetch complete (25100 records). [2025-09-28T02:29:36.457813] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-28T02:29:36.862624] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-28T02:29:36.862819] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-28T02:29:36.863368] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-28T02:29:36.863464] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-28T02:29:36.864617] [DEBUG] [LOCAL ] SRG: Trimmed 25100 records to 15859 (keeping 200 days of data) [2025-09-28T02:29:36.953752] [DEBUG] [LOCAL ] SRG: Primary data saved (15859 records). [2025-09-28T02:29:36.953987] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-28T02:29:36.954117] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SRG took 12.5s. Estimated remaining: 5m 2s. Rate: 73.8 symbols/min [2025-09-28T02:29:37.682638] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:37.662712] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:37.695276] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:37.759350] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:37.790778] [DEBUG] [LOCAL ] SSTK: Loaded 26762 existing records from primary storage. [2025-09-28T02:29:37.791222] [INFO ] [MAIN ] SSTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:37.791369] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. SSTK took 0.8s. Estimated remaining: 5m 1s. Rate: 73.8 symbols/min [2025-09-28T02:29:37.878291] [DEBUG] [LOCAL ] STC: Loaded 17878 existing records from primary storage. [2025-09-28T02:29:37.920877] [INFO ] [MAIN ] STC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:37.934389] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. STC took 1.0s. Estimated remaining: 4m 60s. Rate: 73.8 symbols/min [2025-09-28T02:29:38.098853] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:38.147909] [DEBUG] [LOCAL ] ST: Loaded 50505 existing records from primary storage. [2025-09-28T02:29:38.175939] [INFO ] [MAIN ] ST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:38.177906] [DEBUG] [LOCAL ] STAG: Loaded 50799 existing records from primary storage. [2025-09-28T02:29:38.176350] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. ST took 1.2s. Estimated remaining: 4m 59s. Rate: 73.8 symbols/min [2025-09-28T02:29:38.194217] [INFO ] [MAIN ] STAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:38.239909] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. STAG took 1.3s. Estimated remaining: 4m 58s. Rate: 73.9 symbols/min [2025-09-28T02:29:38.371408] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:38.661864] [DEBUG] [LOCAL ] STE: Loaded 35822 existing records from primary storage. [2025-09-28T02:29:38.672968] [INFO ] [MAIN ] STE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:38.635266] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:38.693136] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:38.702255] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STE took 0.9s. Estimated remaining: 4m 57s. Rate: 73.9 symbols/min [2025-09-28T02:29:38.716788] [DEBUG] [LOCAL ] STEL: Loaded 23823 existing records from primary storage. [2025-09-28T02:29:38.755246] [INFO ] [MAIN ] STEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:38.772606] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEL took 0.8s. Estimated remaining: 4m 56s. Rate: 73.9 symbols/min [2025-09-28T02:29:38.928439] [DEBUG] [LOCAL ] STEW: Loaded 16354 existing records from primary storage. [2025-09-28T02:29:38.961328] [INFO ] [MAIN ] STEW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:39.001624] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STEW took 0.7s. Estimated remaining: 4m 55s. Rate: 73.9 symbols/min [2025-09-28T02:29:39.061695] [DEBUG] [LOCAL ] STEM: Loaded 40374 existing records from primary storage. [2025-09-28T02:29:39.100207] [INFO ] [MAIN ] STEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:39.055232] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:39.132817] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-28T02:29:39.122304] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STEM took 0.9s. Estimated remaining: 4m 54s. Rate: 74.0 symbols/min [2025-09-28T02:29:39.219754] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-28T02:29:39.272801] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-28T02:29:39.350231] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:39.350375] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-28T02:29:39.397935] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-28T02:29:39.429927] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-28T02:29:39.563200] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:39.580304] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:39.593637] [DEBUG] [LOCAL ] STK: Loaded 9550 existing records from primary storage. [2025-09-28T02:29:39.615930] [INFO ] [MAIN ] STK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:39.646282] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STK took 0.8s. Estimated remaining: 4m 54s. Rate: 74.0 symbols/min [2025-09-28T02:29:40.131929] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:40.239452] [DEBUG] [LOCAL ] STLA: Loaded 54322 existing records from primary storage. [2025-09-28T02:29:40.201081] [DEBUG] [LOCAL ] STM: Loaded 54362 existing records from primary storage. [2025-09-28T02:29:40.248779] [INFO ] [MAIN ] STLA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:40.272805] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:29:40.273883] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STLA took 1.2s. Estimated remaining: 4m 53s. Rate: 74.0 symbols/min [2025-09-28T02:29:40.274872] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-28T02:29:40.274128] [INFO ] [MAIN ] STM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:40.276983] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STM took 1.1s. Estimated remaining: 4m 52s. Rate: 74.0 symbols/min [2025-09-28T02:29:40.457285] [DEBUG] [LOCAL ] STN: Loaded 23436 existing records from primary storage. [2025-09-28T02:29:40.529199] [INFO ] [MAIN ] STN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:40.561138] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STN took 0.9s. Estimated remaining: 4m 51s. Rate: 74.1 symbols/min [2025-09-28T02:29:40.691708] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:40.745148] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:40.779897] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-28T02:29:40.792951] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-28T02:29:40.897523] [DEBUG] [LOCAL ] STRV: Loaded 11754 existing records from primary storage. [2025-09-28T02:29:40.896620] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:40.898131] [INFO ] [MAIN ] STRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:40.898635] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STRV took 0.6s. Estimated remaining: 4m 50s. Rate: 74.1 symbols/min [2025-09-28T02:29:41.122432] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:41.122835] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-28T02:29:41.122962] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-28T02:29:41.123266] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-28T02:29:41.123435] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-28T02:29:41.123673] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-28T02:29:41.123935] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-28T02:29:41.137577] [DEBUG] [LOCAL ] STNG: Loaded 44620 existing records from primary storage. [2025-09-28T02:29:41.223761] [INFO ] [MAIN ] STNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:41.229201] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STNG took 1.0s. Estimated remaining: 4m 49s. Rate: 74.1 symbols/min [2025-09-28T02:29:41.282847] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-28T02:29:41.331332] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-28T02:29:41.338998] [DEBUG] [LOCAL ] STT: Loaded 51793 existing records from primary storage. [2025-09-28T02:29:41.400596] [INFO ] [MAIN ] STT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:41.411507] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STT took 0.8s. Estimated remaining: 4m 48s. Rate: 74.1 symbols/min [2025-09-28T02:29:41.740054] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:41.868794] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-28T02:29:41.933965] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:29:41.969880] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-28T02:29:41.970222] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-28T02:29:41.968663] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:41.993418] [DEBUG] [LOCAL ] STVN: Loaded 26677 existing records from primary storage. [2025-09-28T02:29:41.993883] [INFO ] [MAIN ] STVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:41.994059] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STVN took 0.7s. Estimated remaining: 4m 47s. Rate: 74.1 symbols/min [2025-09-28T02:29:42.200297] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:42.203527] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:29:42.206319] [DEBUG] [LOCAL ] STXD: Loaded 1341 existing records from primary storage. [2025-09-28T02:29:42.208169] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-28T02:29:42.208626] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:29:42.209024] [INFO ] [MAIN ] STXD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:42.208753] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-09-28T02:29:42.209392] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STXD took 0.2s. Estimated remaining: 4m 46s. Rate: 74.2 symbols/min [2025-09-28T02:29:42.230235] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:29:42.230463] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-28T02:29:42.266843] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-28T02:29:42.275399] [DEBUG] [LOCAL ] STWD: Loaded 52643 existing records from primary storage. [2025-09-28T02:29:42.311011] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-28T02:29:42.316373] [INFO ] [MAIN ] STWD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:42.340521] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-28T02:29:42.340930] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STWD took 0.8s. Estimated remaining: 4m 45s. Rate: 74.2 symbols/min [2025-09-28T02:29:42.347202] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STUB took 1.4s. Estimated remaining: 4m 45s. Rate: 74.2 symbols/min [2025-09-28T02:29:42.424205] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-28T02:29:42.456907] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-28T02:29:42.582916] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:42.759837] [DEBUG] [LOCAL ] STXE: Loaded 2234 existing records from primary storage. [2025-09-28T02:29:42.761475] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:42.781428] [INFO ] [MAIN ] STXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:42.829795] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STXE took 0.6s. Estimated remaining: 4m 44s. Rate: 74.2 symbols/min [2025-09-28T02:29:42.830772] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:42.874671] [DEBUG] [LOCAL ] STXG: Loaded 2612 existing records from primary storage. [2025-09-28T02:29:42.888073] [INFO ] [MAIN ] STXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:42.896772] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STXG took 0.5s. Estimated remaining: 4m 43s. Rate: 74.3 symbols/min [2025-09-28T02:29:42.969776] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-28T02:29:43.050154] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-28T02:29:43.048924] [DEBUG] [LOCAL ] STXK: Loaded 1535 existing records from primary storage. [2025-09-28T02:29:43.083791] [INFO ] [MAIN ] STXK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:43.104772] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXK took 0.7s. Estimated remaining: 4m 42s. Rate: 74.3 symbols/min [2025-09-28T02:29:43.257356] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:43.265852] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-28T02:29:43.291611] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-28T02:29:43.342365] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-28T02:29:43.368837] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-28T02:29:43.370956] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-28T02:29:43.423711] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-28T02:29:43.429031] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:43.510345] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:43.602113] [DEBUG] [LOCAL ] STXT: Loaded 2592 existing records from primary storage. [2025-09-28T02:29:43.609502] [INFO ] [MAIN ] STXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:43.609976] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXT took 0.7s. Estimated remaining: 4m 41s. Rate: 74.3 symbols/min [2025-09-28T02:29:43.609811] [DEBUG] [LOCAL ] STXV: Loaded 1648 existing records from primary storage. [2025-09-28T02:29:43.637365] [INFO ] [MAIN ] STXV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:43.668432] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-28T02:29:43.697869] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-28T02:29:43.726607] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXV took 0.6s. Estimated remaining: 4m 40s. Rate: 74.3 symbols/min [2025-09-28T02:29:44.161204] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:44.281951] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:44.316874] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:29:44.320137] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-28T02:29:44.321923] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-28T02:29:44.320417] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-28T02:29:44.407096] [DEBUG] [LOCAL ] STZ: Loaded 53035 existing records from primary storage. [2025-09-28T02:29:44.407896] [DEBUG] [LOCAL ] SU: Loaded 54234 existing records from primary storage. [2025-09-28T02:29:44.408378] [INFO ] [MAIN ] STZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:44.408477] [INFO ] [MAIN ] SU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:44.408592] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STZ took 0.8s. Estimated remaining: 4m 39s. Rate: 74.4 symbols/min [2025-09-28T02:29:44.442781] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. SU took 0.6s. Estimated remaining: 4m 38s. Rate: 74.4 symbols/min [2025-09-28T02:29:44.753694] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:44.787067] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-28T02:29:44.796861] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-28T02:29:44.820845] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:44.821251] [DEBUG] [LOCAL ] SUN: No existing data file found in primary storage. [2025-09-28T02:29:44.821370] [WARN ] [MAIN ] SUN: No existing data found, performing full refresh instead. [2025-09-28T02:29:44.822812] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-28T02:29:44.822911] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-28T02:29:44.823054] [DEBUG] [LOCAL ] SUN: No primary data file found to delete. [2025-09-28T02:29:44.823145] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-28T02:29:45.181067] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-28T02:29:45.169081] [DEBUG] [LOCAL ] SUI: Loaded 42505 existing records from primary storage. [2025-09-28T02:29:45.207322] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-28T02:29:45.207568] [INFO ] [MAIN ] SUI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:45.265626] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-28T02:29:45.302880] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:29:45.303301] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. SUI took 0.9s. Estimated remaining: 4m 37s. Rate: 74.4 symbols/min [2025-09-28T02:29:45.305103] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-28T02:29:45.310849] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-28T02:29:45.498399] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:45.546820] [DEBUG] [LOCAL ] SUPV: Loaded 47961 existing records from primary storage. [2025-09-28T02:29:45.547237] [INFO ] [MAIN ] SUPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:45.547756] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. SUPV took 0.2s. Estimated remaining: 4m 37s. Rate: 74.4 symbols/min [2025-09-28T02:29:45.732939] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:45.749480] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-28T02:29:45.751480] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-28T02:29:45.787560] [DEBUG] [LOCAL ] SUZ: Loaded 46428 existing records from primary storage. [2025-09-28T02:29:45.788018] [INFO ] [MAIN ] SUZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:45.788128] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUZ took 0.2s. Estimated remaining: 4m 36s. Rate: 74.4 symbols/min [2025-09-28T02:29:45.880872] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-28T02:29:45.908458] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-28T02:29:45.990898] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:46.032704] [DEBUG] [LOCAL ] SVV: Loaded 40221 existing records from primary storage. [2025-09-28T02:29:46.033110] [INFO ] [MAIN ] SVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:46.033804] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SVV took 0.2s. Estimated remaining: 4m 35s. Rate: 74.5 symbols/min [2025-09-28T02:29:46.219176] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:46.223629] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-28T02:29:46.224794] [INFO ] [REMOTE ] STG: Full fetch complete (2496 records). [2025-09-28T02:29:46.224910] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-28T02:29:46.342345] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-28T02:29:46.349293] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-28T02:29:46.456393] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-28T02:29:46.456737] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:29:46.456812] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:29:46.456890] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-28T02:29:46.456992] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-28T02:29:46.457069] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-28T02:29:46.457233] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-28T02:29:46.457339] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. STG took 7.8s. Estimated remaining: 4m 34s. Rate: 74.5 symbols/min [2025-09-28T02:29:46.615196] [DEBUG] [LOCAL ] SW: Loaded 53939 existing records from primary storage. [2025-09-28T02:29:46.683288] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:46.683423] [INFO ] [MAIN ] SW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:46.684676] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SW took 0.7s. Estimated remaining: 4m 33s. Rate: 74.5 symbols/min [2025-09-28T02:29:46.813335] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-28T02:29:46.825573] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-28T02:29:46.890411] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:46.930112] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-28T02:29:46.938950] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-28T02:29:46.958889] [DEBUG] [LOCAL ] SWK: Loaded 53178 existing records from primary storage. [2025-09-28T02:29:46.959471] [INFO ] [MAIN ] SWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:46.959617] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SWK took 0.5s. Estimated remaining: 4m 32s. Rate: 74.5 symbols/min [2025-09-28T02:29:47.098935] [DEBUG] [LOCAL ] SWX: Loaded 31735 existing records from primary storage. [2025-09-28T02:29:47.111083] [INFO ] [MAIN ] SWX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:47.126737] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SWX took 0.4s. Estimated remaining: 4m 31s. Rate: 74.6 symbols/min [2025-09-28T02:29:47.177702] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:47.287048] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-28T02:29:47.293112] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-28T02:29:47.373599] [DEBUG] [LOCAL ] SWZ: Loaded 6074 existing records from primary storage. [2025-09-28T02:29:47.377636] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:47.378427] [INFO ] [MAIN ] SWZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:47.378596] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SWZ took 0.4s. Estimated remaining: 4m 30s. Rate: 74.6 symbols/min [2025-09-28T02:29:47.569180] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:47.589748] [DEBUG] [LOCAL ] SXC: Loaded 42142 existing records from primary storage. [2025-09-28T02:29:47.590240] [INFO ] [MAIN ] SXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:47.590481] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SXC took 0.4s. Estimated remaining: 4m 29s. Rate: 74.6 symbols/min [2025-09-28T02:29:47.643185] [DEBUG] [LOCAL ] SXI: Loaded 11685 existing records from primary storage. [2025-09-28T02:29:47.672579] [INFO ] [MAIN ] SXI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:47.679352] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SXI took 0.3s. Estimated remaining: 4m 28s. Rate: 74.6 symbols/min [2025-09-28T02:29:47.709981] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-28T02:29:47.711318] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-28T02:29:47.786409] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:29:47.826675] [DEBUG] [LOCAL ] SXT: Loaded 29557 existing records from primary storage. [2025-09-28T02:29:47.827475] [INFO ] [MAIN ] SXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:29:47.828442] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXT took 0.2s. Estimated remaining: 4m 28s. Rate: 74.7 symbols/min [2025-09-28T02:29:48.093315] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-28T02:29:48.094725] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-28T02:29:48.451343] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-28T02:29:48.452460] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-28T02:29:48.584144] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-28T02:29:48.594624] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-28T02:29:48.792666] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-28T02:29:48.793490] [INFO ] [REMOTE ] STXM: Full fetch complete (1431 records). [2025-09-28T02:29:48.793603] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-28T02:29:48.987583] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:29:48.987927] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:29:48.988094] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:29:48.988206] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-28T02:29:48.988343] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-28T02:29:48.988426] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-28T02:29:48.988531] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-28T02:29:48.988667] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. STXM took 6.2s. Estimated remaining: 4m 27s. Rate: 74.7 symbols/min [2025-09-28T02:29:50.079752] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-28T02:29:50.087990] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-28T02:29:51.559222] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-28T02:29:51.566738] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-28T02:29:53.026045] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-28T02:29:53.034002] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-28T02:29:54.562697] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-28T02:29:54.571597] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-28T02:29:56.012828] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-28T02:29:56.021300] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-28T02:29:57.549411] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-28T02:29:57.558465] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-28T02:29:59.215399] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-28T02:29:59.225229] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-28T02:30:00.690540] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-28T02:30:00.701976] [INFO ] [REMOTE ] SUN: Full fetch complete (54582 records). [2025-09-28T02:30:00.702230] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-28T02:30:01.128634] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-28T02:30:01.128818] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-28T02:30:01.129491] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-28T02:30:01.129578] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-28T02:30:01.130987] [DEBUG] [LOCAL ] SUN: Trimmed 54582 records to 37928 (keeping 200 days of data) [2025-09-28T02:30:01.373714] [DEBUG] [LOCAL ] SUN: Primary data saved (37928 records). [2025-09-28T02:30:01.373907] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-28T02:30:01.374029] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. SUN took 16.9s. Estimated remaining: 4m 28s. Rate: 74.1 symbols/min [2025-09-28T02:30:02.134717] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:02.035339] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:02.207062] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:02.231937] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:02.360335] [DEBUG] [LOCAL ] SYF: Loaded 54222 existing records from primary storage. [2025-09-28T02:30:02.358827] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-09-28T02:30:02.361910] [INFO ] [MAIN ] T: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:02.362077] [INFO ] [MAIN ] SYF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:02.379096] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. T took 1.0s. Estimated remaining: 4m 27s. Rate: 74.1 symbols/min [2025-09-28T02:30:02.380237] [DEBUG] [LOCAL ] SYY: Loaded 54009 existing records from primary storage. [2025-09-28T02:30:02.400309] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYF took 1.0s. Estimated remaining: 4m 26s. Rate: 74.2 symbols/min [2025-09-28T02:30:02.400561] [INFO ] [MAIN ] SYY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:02.420973] [DEBUG] [LOCAL ] SYK: Loaded 47699 existing records from primary storage. [2025-09-28T02:30:02.428875] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. SYY took 1.0s. Estimated remaining: 4m 25s. Rate: 74.2 symbols/min [2025-09-28T02:30:02.429189] [INFO ] [MAIN ] SYK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:02.464523] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. SYK took 1.1s. Estimated remaining: 4m 24s. Rate: 74.2 symbols/min [2025-09-28T02:30:02.988845] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:03.159433] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:03.216736] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:03.218531] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:03.297064] [DEBUG] [LOCAL ] TAC: Loaded 43441 existing records from primary storage. [2025-09-28T02:30:03.297794] [INFO ] [MAIN ] TAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:03.297927] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAC took 0.9s. Estimated remaining: 4m 24s. Rate: 74.2 symbols/min [2025-09-28T02:30:03.426800] [DEBUG] [LOCAL ] TAL: Loaded 52783 existing records from primary storage. [2025-09-28T02:30:03.463699] [DEBUG] [LOCAL ] TAK: Loaded 50538 existing records from primary storage. [2025-09-28T02:30:03.508732] [INFO ] [MAIN ] TAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:03.503268] [INFO ] [MAIN ] TAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:03.515264] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TAK took 1.1s. Estimated remaining: 4m 23s. Rate: 74.3 symbols/min [2025-09-28T02:30:03.517146] [DEBUG] [LOCAL ] TALO: Loaded 51575 existing records from primary storage. [2025-09-28T02:30:03.529734] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TAL took 1.1s. Estimated remaining: 4m 22s. Rate: 74.3 symbols/min [2025-09-28T02:30:03.570098] [INFO ] [MAIN ] TALO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:03.609392] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TALO took 1.0s. Estimated remaining: 4m 21s. Rate: 74.3 symbols/min [2025-09-28T02:30:03.697677] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:04.032880] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:04.115146] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:04.176094] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:04.208859] [DEBUG] [LOCAL ] TBB: Loaded 11828 existing records from primary storage. [2025-09-28T02:30:04.215405] [INFO ] [MAIN ] TBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:04.215754] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TBB took 0.7s. Estimated remaining: 4m 20s. Rate: 74.3 symbols/min [2025-09-28T02:30:04.358108] [DEBUG] [LOCAL ] TAP: Loaded 53648 existing records from primary storage. [2025-09-28T02:30:04.350800] [DEBUG] [LOCAL ] TBI: Loaded 22937 existing records from primary storage. [2025-09-28T02:30:04.390490] [INFO ] [MAIN ] TAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:04.390632] [INFO ] [MAIN ] TBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:04.438226] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TAP took 1.1s. Estimated remaining: 4m 19s. Rate: 74.4 symbols/min [2025-09-28T02:30:04.428446] [DEBUG] [LOCAL ] TBBB: Loaded 36262 existing records from primary storage. [2025-09-28T02:30:04.467320] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:04.473746] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBI took 0.8s. Estimated remaining: 4m 18s. Rate: 74.4 symbols/min [2025-09-28T02:30:04.482612] [INFO ] [MAIN ] TBBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:04.482326] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-28T02:30:04.493585] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TBBB took 0.9s. Estimated remaining: 4m 17s. Rate: 74.4 symbols/min [2025-09-28T02:30:04.583475] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-28T02:30:04.631212] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-28T02:30:04.699599] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-28T02:30:04.765316] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-28T02:30:04.819510] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-28T02:30:04.995707] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:05.075880] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:05.108270] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-28T02:30:05.153922] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-28T02:30:05.266904] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:05.187045] [DEBUG] [LOCAL ] TBN: Loaded 3044 existing records from primary storage. [2025-09-28T02:30:05.277460] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-28T02:30:05.293754] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-28T02:30:05.294269] [INFO ] [MAIN ] TBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:05.327300] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-28T02:30:05.328507] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TBN took 0.9s. Estimated remaining: 4m 16s. Rate: 74.4 symbols/min [2025-09-28T02:30:05.345269] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-28T02:30:06.055211] [DEBUG] [LOCAL ] TD: Loaded 53036 existing records from primary storage. [2025-09-28T02:30:06.140697] [INFO ] [MAIN ] TD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:06.245960] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TD took 1.6s. Estimated remaining: 4m 16s. Rate: 74.4 symbols/min [2025-09-28T02:30:06.309496] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:06.333699] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:30:06.400716] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-28T02:30:06.722840] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:30:06.778327] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-28T02:30:06.777230] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:06.795444] [DEBUG] [LOCAL ] TDC: Loaded 47501 existing records from primary storage. [2025-09-28T02:30:06.796318] [INFO ] [MAIN ] TDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:06.797462] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TDC took 1.4s. Estimated remaining: 4m 15s. Rate: 74.4 symbols/min [2025-09-28T02:30:06.881850] [DEBUG] [LOCAL ] TDF: Loaded 6595 existing records from primary storage. [2025-09-28T02:30:06.900560] [INFO ] [MAIN ] TDF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:06.922446] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TDF took 0.6s. Estimated remaining: 4m 14s. Rate: 74.5 symbols/min [2025-09-28T02:30:06.933943] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-28T02:30:07.022374] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-28T02:30:07.049508] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:30:07.085493] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:07.102988] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-28T02:30:07.119311] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:30:07.119439] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-09-28T02:30:07.130746] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:30:07.146101] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-28T02:30:07.146313] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-28T02:30:07.152116] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-28T02:30:07.162719] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-28T02:30:07.162836] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TCAI took 2.7s. Estimated remaining: 4m 13s. Rate: 74.5 symbols/min [2025-09-28T02:30:07.277197] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:07.384955] [DEBUG] [LOCAL ] TDG: Loaded 22314 existing records from primary storage. [2025-09-28T02:30:07.401577] [INFO ] [MAIN ] TDG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:07.428032] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDG took 0.6s. Estimated remaining: 4m 12s. Rate: 74.5 symbols/min [2025-09-28T02:30:07.468348] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:07.683288] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:07.703574] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-28T02:30:07.705663] [DEBUG] [LOCAL ] TDOC: Loaded 54125 existing records from primary storage. [2025-09-28T02:30:07.707604] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-28T02:30:07.709141] [INFO ] [MAIN ] TDOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:07.720229] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDOC took 0.8s. Estimated remaining: 4m 11s. Rate: 74.5 symbols/min [2025-09-28T02:30:07.852947] [DEBUG] [LOCAL ] TDS: Loaded 43435 existing records from primary storage. [2025-09-28T02:30:07.906426] [INFO ] [MAIN ] TDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:07.947007] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:07.947246] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDS took 0.8s. Estimated remaining: 4m 10s. Rate: 74.6 symbols/min [2025-09-28T02:30:08.078984] [DEBUG] [LOCAL ] TDW: Loaded 46091 existing records from primary storage. [2025-09-28T02:30:08.102074] [INFO ] [MAIN ] TDW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:08.110696] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-28T02:30:08.134273] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-28T02:30:08.135318] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TDW took 0.7s. Estimated remaining: 4m 9s. Rate: 74.6 symbols/min [2025-09-28T02:30:08.237470] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:08.260608] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-28T02:30:08.227228] [DEBUG] [LOCAL ] TDY: Loaded 22979 existing records from primary storage. [2025-09-28T02:30:08.274571] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-28T02:30:08.283484] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-28T02:30:08.293832] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-28T02:30:08.299194] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-28T02:30:08.307364] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-28T02:30:08.283741] [INFO ] [MAIN ] TDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:08.336606] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDY took 0.6s. Estimated remaining: 4m 8s. Rate: 74.6 symbols/min [2025-09-28T02:30:08.699833] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:08.786602] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-28T02:30:08.824823] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-28T02:30:08.845518] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:08.883165] [DEBUG] [LOCAL ] TEAF: Loaded 7529 existing records from primary storage. [2025-09-28T02:30:08.899788] [INFO ] [MAIN ] TEAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:08.925034] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TEAF took 0.7s. Estimated remaining: 4m 8s. Rate: 74.6 symbols/min [2025-09-28T02:30:09.259061] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:30:09.294452] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-28T02:30:09.287971] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-28T02:30:09.312798] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-28T02:30:09.326969] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:09.346629] [DEBUG] [LOCAL ] TECK: Loaded 54216 existing records from primary storage. [2025-09-28T02:30:09.347276] [INFO ] [MAIN ] TECK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:09.347504] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TECK took 1.0s. Estimated remaining: 4m 7s. Rate: 74.6 symbols/min [2025-09-28T02:30:09.563373] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:09.566214] [DEBUG] [LOCAL ] TEF: Loaded 37944 existing records from primary storage. [2025-09-28T02:30:09.566791] [INFO ] [MAIN ] TEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:09.566917] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEF took 0.6s. Estimated remaining: 4m 6s. Rate: 74.7 symbols/min [2025-09-28T02:30:09.590328] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:30:09.631300] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-28T02:30:09.660807] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:30:09.691611] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-09-28T02:30:09.692482] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:30:09.743535] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-28T02:30:09.752248] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-28T02:30:09.801866] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-28T02:30:09.752515] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-28T02:30:09.826713] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:09.827815] [DEBUG] [LOCAL ] TEI: Loaded 20910 existing records from primary storage. [2025-09-28T02:30:09.828117] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-28T02:30:09.829028] [INFO ] [MAIN ] TEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:09.829298] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-28T02:30:09.829436] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TEI took 0.5s. Estimated remaining: 4m 5s. Rate: 74.7 symbols/min [2025-09-28T02:30:09.829909] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TE took 1.9s. Estimated remaining: 4m 4s. Rate: 74.7 symbols/min [2025-09-28T02:30:10.295723] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:10.297031] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:10.300777] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-28T02:30:10.302504] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-28T02:30:10.327007] [DEBUG] [LOCAL ] TEL: Loaded 51898 existing records from primary storage. [2025-09-28T02:30:10.327792] [INFO ] [MAIN ] TEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:10.328160] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TEL took 0.8s. Estimated remaining: 4m 3s. Rate: 74.7 symbols/min [2025-09-28T02:30:10.487951] [DEBUG] [LOCAL ] TEN: Loaded 31383 existing records from primary storage. [2025-09-28T02:30:10.486904] [DEBUG] [LOCAL ] TEO: Loaded 22345 existing records from primary storage. [2025-09-28T02:30:10.499560] [INFO ] [MAIN ] TEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:10.499720] [INFO ] [MAIN ] TEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:10.570950] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:10.566393] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEO took 0.7s. Estimated remaining: 4m 2s. Rate: 74.8 symbols/min [2025-09-28T02:30:10.577060] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEN took 0.7s. Estimated remaining: 4m 1s. Rate: 74.8 symbols/min [2025-09-28T02:30:10.707677] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-28T02:30:10.779713] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-28T02:30:10.912964] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:11.007802] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:11.032611] [DEBUG] [LOCAL ] TEVA: Loaded 54413 existing records from primary storage. [2025-09-28T02:30:11.035269] [INFO ] [MAIN ] TEVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:11.035933] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEVA took 0.7s. Estimated remaining: 4m 1s. Rate: 74.8 symbols/min [2025-09-28T02:30:11.182697] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-28T02:30:11.185384] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-28T02:30:11.250982] [DEBUG] [LOCAL ] TEX: Loaded 45170 existing records from primary storage. [2025-09-28T02:30:11.308110] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:11.308744] [INFO ] [MAIN ] TEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:11.311135] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEX took 0.7s. Estimated remaining: 3m 60s. Rate: 74.8 symbols/min [2025-09-28T02:30:11.309720] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-09-28T02:30:11.336115] [INFO ] [MAIN ] TFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:11.368686] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TFC took 0.8s. Estimated remaining: 3m 59s. Rate: 74.9 symbols/min [2025-09-28T02:30:11.633864] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-28T02:30:11.669732] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:11.671118] [INFO ] [REMOTE ] TBLU: Full fetch complete (1172 records). [2025-09-28T02:30:11.672213] [DEBUG] [LOCAL ] TFII: Loaded 34733 existing records from primary storage. [2025-09-28T02:30:11.678885] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-28T02:30:11.679073] [INFO ] [MAIN ] TFII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:11.679691] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFII took 0.6s. Estimated remaining: 3m 58s. Rate: 74.9 symbols/min [2025-09-28T02:30:12.004867] [DEBUG] [LOCAL ] TFIN: Loaded 23896 existing records from primary storage. [2025-09-28T02:30:11.964931] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:12.010426] [INFO ] [MAIN ] TFIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:12.016549] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFIN took 0.7s. Estimated remaining: 3m 57s. Rate: 74.9 symbols/min [2025-09-28T02:30:12.207551] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:12.199358] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:30:12.234705] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:30:12.246124] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:30:12.252239] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-28T02:30:12.304705] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-28T02:30:12.321605] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-28T02:30:12.321906] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-28T02:30:12.360145] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TBLU took 8.1s. Estimated remaining: 3m 56s. Rate: 74.9 symbols/min [2025-09-28T02:30:12.443558] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:12.461811] [DEBUG] [LOCAL ] TFPM: Loaded 37997 existing records from primary storage. [2025-09-28T02:30:12.502694] [INFO ] [MAIN ] TFPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:12.515272] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TFPM took 1.1s. Estimated remaining: 3m 55s. Rate: 75.0 symbols/min [2025-09-28T02:30:12.621429] [DEBUG] [LOCAL ] TG: Loaded 10581 existing records from primary storage. [2025-09-28T02:30:12.652005] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:12.655289] [DEBUG] [LOCAL ] TFX: Loaded 37936 existing records from primary storage. [2025-09-28T02:30:12.656217] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-28T02:30:12.657065] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-28T02:30:12.657508] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-28T02:30:12.656971] [INFO ] [MAIN ] TFX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:12.655851] [INFO ] [MAIN ] TG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:12.658129] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-28T02:30:12.657759] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TFX took 1.0s. Estimated remaining: 3m 54s. Rate: 75.0 symbols/min [2025-09-28T02:30:12.658319] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-28T02:30:12.658527] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TG took 0.6s. Estimated remaining: 3m 53s. Rate: 75.0 symbols/min [2025-09-28T02:30:12.658700] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-28T02:30:13.035191] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:30:13.035751] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-28T02:30:13.253673] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:30:13.254071] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-28T02:30:13.254182] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:30:13.254276] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-09-28T02:30:13.254364] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:30:13.254451] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-28T02:30:13.254556] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-28T02:30:13.254637] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-28T02:30:13.254811] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-28T02:30:13.254919] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TGE took 0.9s. Estimated remaining: 3m 53s. Rate: 75.0 symbols/min [2025-09-28T02:30:13.889070] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:13.993189] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:14.030257] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:14.031543] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:14.074184] [DEBUG] [LOCAL ] TGLS: Loaded 28709 existing records from primary storage. [2025-09-28T02:30:14.074834] [INFO ] [MAIN ] TGLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:14.075035] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGLS took 0.8s. Estimated remaining: 3m 52s. Rate: 75.0 symbols/min [2025-09-28T02:30:14.171180] [DEBUG] [LOCAL ] TGS: Loaded 33072 existing records from primary storage. [2025-09-28T02:30:14.228376] [INFO ] [MAIN ] TGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:14.228935] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGS took 1.0s. Estimated remaining: 3m 51s. Rate: 75.1 symbols/min [2025-09-28T02:30:14.343359] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-09-28T02:30:14.349327] [INFO ] [MAIN ] TGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:14.440399] [DEBUG] [LOCAL ] TGNA: Loaded 49444 existing records from primary storage. [2025-09-28T02:30:14.431920] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGT took 1.2s. Estimated remaining: 3m 50s. Rate: 75.1 symbols/min [2025-09-28T02:30:14.456136] [INFO ] [MAIN ] TGNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:14.460902] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:14.505400] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGNA took 1.2s. Estimated remaining: 3m 49s. Rate: 75.1 symbols/min [2025-09-28T02:30:14.657474] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:14.921301] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:14.980853] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:14.999904] [DEBUG] [LOCAL ] THLV: Loaded 1614 existing records from primary storage. [2025-09-28T02:30:15.009600] [INFO ] [MAIN ] THLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:15.011325] [DEBUG] [LOCAL ] THC: Loaded 48617 existing records from primary storage. [2025-09-28T02:30:15.011767] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THLV took 0.5s. Estimated remaining: 3m 48s. Rate: 75.2 symbols/min [2025-09-28T02:30:15.012932] [INFO ] [MAIN ] THC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:15.012373] [DEBUG] [LOCAL ] THG: Loaded 22081 existing records from primary storage. [2025-09-28T02:30:15.019041] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THC took 0.9s. Estimated remaining: 3m 47s. Rate: 75.2 symbols/min [2025-09-28T02:30:15.037354] [INFO ] [MAIN ] THG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:15.092534] [DEBUG] [LOCAL ] THIR: Loaded 2238 existing records from primary storage. [2025-09-28T02:30:15.090104] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THG took 0.9s. Estimated remaining: 3m 47s. Rate: 75.2 symbols/min [2025-09-28T02:30:15.121840] [INFO ] [MAIN ] THIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:15.160451] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THIR took 0.7s. Estimated remaining: 3m 46s. Rate: 75.3 symbols/min [2025-09-28T02:30:15.496713] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:15.649422] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:15.845795] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:15.849955] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:15.890090] [DEBUG] [LOCAL ] THO: Loaded 42957 existing records from primary storage. [2025-09-28T02:30:15.899007] [INFO ] [MAIN ] THO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:15.899428] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THO took 0.9s. Estimated remaining: 3m 45s. Rate: 75.3 symbols/min [2025-09-28T02:30:15.900999] [DEBUG] [LOCAL ] THQ: Loaded 24879 existing records from primary storage. [2025-09-28T02:30:15.918799] [INFO ] [MAIN ] THQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:15.970285] [DEBUG] [LOCAL ] THR: Loaded 20218 existing records from primary storage. [2025-09-28T02:30:15.970410] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THQ took 0.9s. Estimated remaining: 3m 44s. Rate: 75.3 symbols/min [2025-09-28T02:30:15.995313] [INFO ] [MAIN ] THR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:16.049329] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. THR took 0.9s. Estimated remaining: 3m 43s. Rate: 75.3 symbols/min [2025-09-28T02:30:16.216824] [DEBUG] [LOCAL ] THS: Loaded 38565 existing records from primary storage. [2025-09-28T02:30:16.247307] [INFO ] [MAIN ] THS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:16.422275] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. THS took 1.2s. Estimated remaining: 3m 42s. Rate: 75.3 symbols/min [2025-09-28T02:30:16.458568] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:16.518747] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:16.605486] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:16.580776] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-28T02:30:16.658847] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-28T02:30:16.678244] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-28T02:30:16.678432] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-28T02:30:16.737930] [DEBUG] [LOCAL ] THW: Loaded 19392 existing records from primary storage. [2025-09-28T02:30:16.738067] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-28T02:30:16.767526] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:16.767777] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-28T02:30:16.768329] [INFO ] [MAIN ] THW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:16.773869] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THW took 0.9s. Estimated remaining: 3m 41s. Rate: 75.4 symbols/min [2025-09-28T02:30:16.923634] [DEBUG] [LOCAL ] TISI: Loaded 3805 existing records from primary storage. [2025-09-28T02:30:16.954537] [INFO ] [MAIN ] TISI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:16.984553] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. TISI took 0.5s. Estimated remaining: 3m 40s. Rate: 75.4 symbols/min [2025-09-28T02:30:17.123078] [DEBUG] [LOCAL ] TIMB: Loaded 36983 existing records from primary storage. [2025-09-28T02:30:17.185675] [INFO ] [MAIN ] TIMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:17.443162] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:17.393957] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TIMB took 1.3s. Estimated remaining: 3m 40s. Rate: 75.4 symbols/min [2025-09-28T02:30:17.580483] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:17.765842] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:30:17.772276] [DEBUG] [LOCAL ] TIXT: Loaded 31824 existing records from primary storage. [2025-09-28T02:30:17.773615] [INFO ] [MAIN ] TIXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:17.773158] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-28T02:30:17.780568] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TIXT took 1.0s. Estimated remaining: 3m 39s. Rate: 75.4 symbols/min [2025-09-28T02:30:17.955284] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:18.084105] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:18.103822] [DEBUG] [LOCAL ] TJX: Loaded 54449 existing records from primary storage. [2025-09-28T02:30:18.104376] [INFO ] [MAIN ] TJX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:18.104612] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TJX took 1.1s. Estimated remaining: 3m 38s. Rate: 75.4 symbols/min [2025-09-28T02:30:18.138470] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:30:18.172399] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-28T02:30:18.240444] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:30:18.247275] [DEBUG] [LOCAL ] TK: Loaded 40151 existing records from primary storage. [2025-09-28T02:30:18.267244] [INFO ] [MAIN ] TK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:18.267425] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TK took 0.8s. Estimated remaining: 3m 37s. Rate: 75.5 symbols/min [2025-09-28T02:30:18.266730] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-09-28T02:30:18.327821] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:30:18.427819] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:18.423370] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-28T02:30:18.462725] [DEBUG] [LOCAL ] TKC: Loaded 39062 existing records from primary storage. [2025-09-28T02:30:18.474702] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-28T02:30:18.479750] [INFO ] [MAIN ] TKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:18.481008] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-28T02:30:18.482319] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TKC took 0.7s. Estimated remaining: 3m 36s. Rate: 75.5 symbols/min [2025-09-28T02:30:18.487763] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-28T02:30:18.488140] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TIC took 2.5s. Estimated remaining: 3m 35s. Rate: 75.5 symbols/min [2025-09-28T02:30:18.635375] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:18.953586] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:18.949592] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:18.968595] [DEBUG] [LOCAL ] TKO: Loaded 44814 existing records from primary storage. [2025-09-28T02:30:18.967666] [DEBUG] [LOCAL ] TLK: No existing data file found in primary storage. [2025-09-28T02:30:18.977699] [INFO ] [MAIN ] TKO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:18.977393] [WARN ] [MAIN ] TLK: No existing data found, performing full refresh instead. [2025-09-28T02:30:18.977996] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKO took 0.9s. Estimated remaining: 3m 34s. Rate: 75.5 symbols/min [2025-09-28T02:30:18.978120] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-28T02:30:18.989837] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-28T02:30:19.011036] [DEBUG] [LOCAL ] TLK: No primary data file found to delete. [2025-09-28T02:30:19.054253] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-28T02:30:19.104515] [DEBUG] [LOCAL ] TKR: Loaded 40832 existing records from primary storage. [2025-09-28T02:30:19.155929] [DEBUG] [LOCAL ] TLYS: Loaded 17064 existing records from primary storage. [2025-09-28T02:30:19.187685] [INFO ] [MAIN ] TKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:19.259332] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKR took 1.0s. Estimated remaining: 3m 34s. Rate: 75.6 symbols/min [2025-09-28T02:30:19.267184] [INFO ] [MAIN ] TLYS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:19.365777] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLYS took 0.9s. Estimated remaining: 3m 33s. Rate: 75.6 symbols/min [2025-09-28T02:30:19.367097] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:19.934808] [DEBUG] [LOCAL ] TM: Loaded 36992 existing records from primary storage. [2025-09-28T02:30:19.938706] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:19.999185] [INFO ] [MAIN ] TM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:20.018277] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:20.039976] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TM took 1.1s. Estimated remaining: 3m 32s. Rate: 75.6 symbols/min [2025-09-28T02:30:20.098597] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:30:20.116863] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-28T02:30:20.315521] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:20.349843] [DEBUG] [LOCAL ] TMHC: Loaded 46274 existing records from primary storage. [2025-09-28T02:30:20.350696] [INFO ] [MAIN ] TMHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:20.350860] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TMHC took 1.0s. Estimated remaining: 3m 31s. Rate: 75.6 symbols/min [2025-09-28T02:30:20.484169] [DEBUG] [LOCAL ] TME: Loaded 53979 existing records from primary storage. [2025-09-28T02:30:20.511936] [INFO ] [MAIN ] TME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:20.542890] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TME took 1.3s. Estimated remaining: 3m 30s. Rate: 75.7 symbols/min [2025-09-28T02:30:20.567426] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:20.806689] [DEBUG] [LOCAL ] TMO: Loaded 53089 existing records from primary storage. [2025-09-28T02:30:20.826108] [DEBUG] [LOCAL ] TNC: Loaded 15334 existing records from primary storage. [2025-09-28T02:30:20.829914] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:20.830818] [INFO ] [MAIN ] TMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:20.831058] [INFO ] [MAIN ] TNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:20.832031] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TNC took 0.5s. Estimated remaining: 3m 29s. Rate: 75.7 symbols/min [2025-09-28T02:30:20.832772] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TMO took 0.8s. Estimated remaining: 3m 28s. Rate: 75.7 symbols/min [2025-09-28T02:30:21.263022] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:21.267803] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:21.268332] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-28T02:30:21.269397] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-28T02:30:21.269884] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-28T02:30:21.270067] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-28T02:30:21.270326] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-28T02:30:21.278371] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-28T02:30:21.315343] [DEBUG] [LOCAL ] TNET: Loaded 29247 existing records from primary storage. [2025-09-28T02:30:21.354924] [INFO ] [MAIN ] TNET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:21.397572] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TNET took 0.8s. Estimated remaining: 3m 28s. Rate: 75.7 symbols/min [2025-09-28T02:30:21.683845] [DEBUG] [LOCAL ] TNK: Loaded 35701 existing records from primary storage. [2025-09-28T02:30:21.793098] [INFO ] [MAIN ] TNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:21.845330] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:21.851155] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNK took 1.0s. Estimated remaining: 3m 27s. Rate: 75.7 symbols/min [2025-09-28T02:30:22.030980] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:30:22.047903] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-28T02:30:22.154440] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-28T02:30:22.194217] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:22.203294] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-28T02:30:22.220429] [DEBUG] [LOCAL ] TNL: Loaded 42474 existing records from primary storage. [2025-09-28T02:30:22.220929] [INFO ] [MAIN ] TNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:22.221036] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNL took 0.8s. Estimated remaining: 3m 26s. Rate: 75.8 symbols/min [2025-09-28T02:30:22.373027] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:30:22.420841] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-28T02:30:22.420500] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:22.421052] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:30:22.421708] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-09-28T02:30:22.436520] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:30:22.436739] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-28T02:30:22.436843] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-28T02:30:22.436921] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-28T02:30:22.437013] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-28T02:30:22.437199] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNGY took 1.6s. Estimated remaining: 3m 25s. Rate: 75.8 symbols/min [2025-09-28T02:30:22.573560] [DEBUG] [LOCAL ] TOL: Loaded 51738 existing records from primary storage. [2025-09-28T02:30:22.596088] [INFO ] [MAIN ] TOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:22.632484] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TOL took 0.8s. Estimated remaining: 3m 24s. Rate: 75.8 symbols/min [2025-09-28T02:30:22.655431] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:22.872868] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-09-28T02:30:22.895791] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:22.896471] [INFO ] [MAIN ] TOST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:22.897355] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TOST took 0.7s. Estimated remaining: 3m 23s. Rate: 75.8 symbols/min [2025-09-28T02:30:22.956417] [DEBUG] [LOCAL ] TPB: Loaded 25409 existing records from primary storage. [2025-09-28T02:30:23.007149] [INFO ] [MAIN ] TPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:23.038856] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TPB took 0.6s. Estimated remaining: 3m 22s. Rate: 75.9 symbols/min [2025-09-28T02:30:23.119411] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:23.227770] [DEBUG] [LOCAL ] TPC: Loaded 39311 existing records from primary storage. [2025-09-28T02:30:23.255125] [INFO ] [MAIN ] TPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:23.276734] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TPC took 0.6s. Estimated remaining: 3m 22s. Rate: 75.9 symbols/min [2025-09-28T02:30:23.378262] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:23.555501] [DEBUG] [LOCAL ] TPH: Loaded 45821 existing records from primary storage. [2025-09-28T02:30:23.584441] [INFO ] [MAIN ] TPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:23.615501] [DEBUG] [LOCAL ] TPL: Loaded 12533 existing records from primary storage. [2025-09-28T02:30:23.650992] [INFO ] [MAIN ] TPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:23.616432] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPH took 0.7s. Estimated remaining: 3m 21s. Rate: 75.9 symbols/min [2025-09-28T02:30:23.656030] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:23.657561] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPL took 0.6s. Estimated remaining: 3m 20s. Rate: 75.9 symbols/min [2025-09-28T02:30:23.741375] [DEBUG] [LOCAL ] TPR: Loaded 54252 existing records from primary storage. [2025-09-28T02:30:23.742428] [INFO ] [MAIN ] TPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:23.742748] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPR took 0.4s. Estimated remaining: 3m 19s. Rate: 76.0 symbols/min [2025-09-28T02:30:23.782774] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-28T02:30:23.794149] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-28T02:30:25.328505] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-28T02:30:25.337075] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-28T02:30:27.030504] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-28T02:30:27.041087] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-28T02:30:28.785613] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-28T02:30:28.794415] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-28T02:30:30.313195] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-28T02:30:30.322811] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-28T02:30:31.712438] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-28T02:30:31.721548] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-28T02:30:32.977327] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-28T02:30:32.986333] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-28T02:30:34.481938] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-28T02:30:34.492758] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-28T02:30:35.960045] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-28T02:30:35.969704] [INFO ] [REMOTE ] TLK: Full fetch complete (57258 records). [2025-09-28T02:30:35.969989] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-28T02:30:36.507723] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-28T02:30:36.507858] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-28T02:30:36.508757] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-28T02:30:36.508848] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-28T02:30:36.511504] [DEBUG] [LOCAL ] TLK: Trimmed 57258 records to 39925 (keeping 200 days of data) [2025-09-28T02:30:36.773874] [DEBUG] [LOCAL ] TLK: Primary data saved (39925 records). [2025-09-28T02:30:36.774065] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-28T02:30:36.774183] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TLK took 18.3s. Estimated remaining: 3m 20s. Rate: 75.4 symbols/min [2025-09-28T02:30:37.401419] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:37.562912] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:37.597452] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:37.602208] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:37.611311] [DEBUG] [LOCAL ] TPZ: Loaded 5095 existing records from primary storage. [2025-09-28T02:30:37.615848] [INFO ] [MAIN ] TPZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:37.615962] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPZ took 0.8s. Estimated remaining: 3m 19s. Rate: 75.4 symbols/min [2025-09-28T02:30:37.712555] [DEBUG] [LOCAL ] TPYP: Loaded 8039 existing records from primary storage. [2025-09-28T02:30:37.767810] [DEBUG] [LOCAL ] TR: Loaded 18494 existing records from primary storage. [2025-09-28T02:30:37.767276] [INFO ] [MAIN ] TPYP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:37.790452] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TPYP took 1.0s. Estimated remaining: 3m 18s. Rate: 75.5 symbols/min [2025-09-28T02:30:37.785115] [INFO ] [MAIN ] TR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:37.861434] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:37.869496] [DEBUG] [LOCAL ] TPVG: Loaded 27400 existing records from primary storage. [2025-09-28T02:30:37.868520] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TR took 1.0s. Estimated remaining: 3m 17s. Rate: 75.5 symbols/min [2025-09-28T02:30:37.894503] [INFO ] [MAIN ] TPVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:37.952196] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TPVG took 1.2s. Estimated remaining: 3m 16s. Rate: 75.5 symbols/min [2025-09-28T02:30:38.087018] [DEBUG] [LOCAL ] TRAK: Loaded 9383 existing records from primary storage. [2025-09-28T02:30:38.152942] [INFO ] [MAIN ] TRAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:38.247793] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRAK took 0.6s. Estimated remaining: 3m 15s. Rate: 75.5 symbols/min [2025-09-28T02:30:38.296900] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:38.452343] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:38.629676] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:38.696160] [DEBUG] [LOCAL ] TRC: Loaded 16189 existing records from primary storage. [2025-09-28T02:30:38.733607] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:38.733884] [INFO ] [MAIN ] TRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:38.735000] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRC took 0.9s. Estimated remaining: 3m 15s. Rate: 75.6 symbols/min [2025-09-28T02:30:38.946249] [DEBUG] [LOCAL ] TREX: Loaded 50733 existing records from primary storage. [2025-09-28T02:30:39.009308] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:39.019347] [INFO ] [MAIN ] TREX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:39.020546] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TREX took 1.1s. Estimated remaining: 3m 14s. Rate: 75.6 symbols/min [2025-09-28T02:30:39.021729] [DEBUG] [LOCAL ] TRGP: Loaded 51504 existing records from primary storage. [2025-09-28T02:30:39.028141] [INFO ] [MAIN ] TRGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:39.042570] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRGP took 1.0s. Estimated remaining: 3m 13s. Rate: 75.6 symbols/min [2025-09-28T02:30:39.165472] [DEBUG] [LOCAL ] TRN: Loaded 37786 existing records from primary storage. [2025-09-28T02:30:39.252355] [INFO ] [MAIN ] TRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:39.317957] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRN took 1.0s. Estimated remaining: 3m 12s. Rate: 75.6 symbols/min [2025-09-28T02:30:39.354134] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:39.511600] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:39.588354] [DEBUG] [LOCAL ] TRNO: Loaded 44598 existing records from primary storage. [2025-09-28T02:30:39.616930] [INFO ] [MAIN ] TRNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:39.640211] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRNO took 0.9s. Estimated remaining: 3m 11s. Rate: 75.7 symbols/min [2025-09-28T02:30:39.670261] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:39.924776] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:39.962425] [DEBUG] [LOCAL ] TROX: Loaded 52550 existing records from primary storage. [2025-09-28T02:30:39.965953] [DEBUG] [LOCAL ] TRTX: Loaded 38058 existing records from primary storage. [2025-09-28T02:30:39.967063] [INFO ] [MAIN ] TRTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:39.966705] [INFO ] [MAIN ] TROX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:39.982257] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TROX took 1.0s. Estimated remaining: 3m 10s. Rate: 75.7 symbols/min [2025-09-28T02:30:39.996211] [DEBUG] [LOCAL ] TRP: Loaded 52891 existing records from primary storage. [2025-09-28T02:30:39.989075] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TRTX took 0.6s. Estimated remaining: 3m 9s. Rate: 75.7 symbols/min [2025-09-28T02:30:40.062579] [INFO ] [MAIN ] TRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:40.078986] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRP took 1.0s. Estimated remaining: 3m 9s. Rate: 75.7 symbols/min [2025-09-28T02:30:40.482706] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:40.519138] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:40.514186] [DEBUG] [LOCAL ] TRU: Loaded 51965 existing records from primary storage. [2025-09-28T02:30:40.529694] [DEBUG] [LOCAL ] TRV: No existing data file found in primary storage. [2025-09-28T02:30:40.545507] [INFO ] [MAIN ] TRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:40.563026] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 0.9s. Estimated remaining: 3m 8s. Rate: 75.8 symbols/min [2025-09-28T02:30:40.601477] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:40.570392] [WARN ] [MAIN ] TRV: No existing data found, performing full refresh instead. [2025-09-28T02:30:40.602143] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-28T02:30:40.602241] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-28T02:30:40.624004] [DEBUG] [LOCAL ] TRV: No primary data file found to delete. [2025-09-28T02:30:40.644423] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-28T02:30:41.000500] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:41.055706] [DEBUG] [LOCAL ] TSE: Loaded 29074 existing records from primary storage. [2025-09-28T02:30:41.100146] [INFO ] [MAIN ] TSE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:41.111892] [DEBUG] [LOCAL ] TS: Loaded 52425 existing records from primary storage. [2025-09-28T02:30:41.112266] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TSE took 0.9s. Estimated remaining: 3m 7s. Rate: 75.8 symbols/min [2025-09-28T02:30:41.144995] [INFO ] [MAIN ] TS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:41.172677] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TS took 1.1s. Estimated remaining: 3m 6s. Rate: 75.8 symbols/min [2025-09-28T02:30:41.145316] [DEBUG] [LOCAL ] TSI: Loaded 8090 existing records from primary storage. [2025-09-28T02:30:41.217329] [INFO ] [MAIN ] TSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:41.283893] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TSI took 0.7s. Estimated remaining: 3m 5s. Rate: 75.8 symbols/min [2025-09-28T02:30:41.734138] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:30:41.755440] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-28T02:30:41.754739] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:41.817894] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:41.882019] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:41.953051] [DEBUG] [LOCAL ] TSLX: Loaded 35752 existing records from primary storage. [2025-09-28T02:30:41.953758] [INFO ] [MAIN ] TSLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:41.953945] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TSLX took 0.8s. Estimated remaining: 3m 4s. Rate: 75.8 symbols/min [2025-09-28T02:30:42.093349] [DEBUG] [LOCAL ] TSN: Loaded 53638 existing records from primary storage. [2025-09-28T02:30:42.097863] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-09-28T02:30:42.109760] [INFO ] [MAIN ] TSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:42.104533] [INFO ] [MAIN ] TSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:42.125743] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSM took 1.0s. Estimated remaining: 3m 3s. Rate: 75.9 symbols/min [2025-09-28T02:30:42.188566] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:42.184952] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSN took 0.8s. Estimated remaining: 3m 3s. Rate: 75.9 symbols/min [2025-09-28T02:30:42.551582] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:42.561002] [DEBUG] [LOCAL ] TSQ: Loaded 12195 existing records from primary storage. [2025-09-28T02:30:42.584671] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:42.585714] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-28T02:30:42.585921] [INFO ] [MAIN ] TSQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:42.586312] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TSQ took 0.6s. Estimated remaining: 3m 2s. Rate: 75.9 symbols/min [2025-09-28T02:30:42.585997] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-28T02:30:42.592287] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-28T02:30:42.605194] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-28T02:30:42.649564] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-28T02:30:42.691102] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-28T02:30:42.913262] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:42.955346] [DEBUG] [LOCAL ] TT: Loaded 48538 existing records from primary storage. [2025-09-28T02:30:42.996396] [INFO ] [MAIN ] TT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:43.033752] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TT took 0.9s. Estimated remaining: 3m 1s. Rate: 75.9 symbols/min [2025-09-28T02:30:43.426732] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:43.457914] [DEBUG] [LOCAL ] TTC: Loaded 43005 existing records from primary storage. [2025-09-28T02:30:43.459191] [INFO ] [MAIN ] TTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:43.476149] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:30:43.476526] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TTC took 0.9s. Estimated remaining: 3m 0s. Rate: 75.9 symbols/min [2025-09-28T02:30:43.476947] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-28T02:30:43.683341] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:43.721408] [DEBUG] [LOCAL ] TTE: Loaded 52395 existing records from primary storage. [2025-09-28T02:30:43.721943] [INFO ] [MAIN ] TTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:43.722051] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TTE took 0.7s. Estimated remaining: 2m 59s. Rate: 76.0 symbols/min [2025-09-28T02:30:43.762337] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:30:43.825222] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-28T02:30:43.849663] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:30:43.855688] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-09-28T02:30:43.866267] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:30:43.876768] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-28T02:30:43.876984] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-28T02:30:43.907386] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-28T02:30:43.945406] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:43.956300] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-28T02:30:43.970689] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTAM took 1.7s. Estimated remaining: 2m 58s. Rate: 76.0 symbols/min [2025-09-28T02:30:43.972900] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-28T02:30:43.983581] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-28T02:30:44.008546] [DEBUG] [LOCAL ] TTI: Loaded 46112 existing records from primary storage. [2025-09-28T02:30:44.009113] [INFO ] [MAIN ] TTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:44.009677] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTI took 0.5s. Estimated remaining: 2m 58s. Rate: 76.0 symbols/min [2025-09-28T02:30:44.346177] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:44.398496] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:44.426402] [DEBUG] [LOCAL ] TU: Loaded 50606 existing records from primary storage. [2025-09-28T02:30:44.427207] [INFO ] [MAIN ] TU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:44.428224] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TU took 0.7s. Estimated remaining: 2m 57s. Rate: 76.0 symbols/min [2025-09-28T02:30:44.595614] [DEBUG] [LOCAL ] TV: Loaded 43514 existing records from primary storage. [2025-09-28T02:30:44.606491] [INFO ] [MAIN ] TV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:44.648250] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TV took 0.6s. Estimated remaining: 2m 56s. Rate: 76.1 symbols/min [2025-09-28T02:30:44.689036] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:44.700415] [DEBUG] [LOCAL ] TUYA: Loaded 47185 existing records from primary storage. [2025-09-28T02:30:44.740550] [INFO ] [MAIN ] TUYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:44.790475] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TUYA took 0.8s. Estimated remaining: 2m 55s. Rate: 76.1 symbols/min [2025-09-28T02:30:44.792823] [DEBUG] [LOCAL ] TVC: Loaded 3466 existing records from primary storage. [2025-09-28T02:30:44.819319] [INFO ] [MAIN ] TVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:44.875622] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TVC took 0.4s. Estimated remaining: 2m 54s. Rate: 76.1 symbols/min [2025-09-28T02:30:44.962092] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:45.203049] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:45.203360] [DEBUG] [LOCAL ] TVE: Loaded 2795 existing records from primary storage. [2025-09-28T02:30:45.225349] [INFO ] [MAIN ] TVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:45.225554] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TVE took 0.6s. Estimated remaining: 2m 53s. Rate: 76.1 symbols/min [2025-09-28T02:30:45.340995] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:45.512257] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:45.525911] [DEBUG] [LOCAL ] TWI: Loaded 34981 existing records from primary storage. [2025-09-28T02:30:45.526449] [INFO ] [MAIN ] TWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:45.526720] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TWI took 0.7s. Estimated remaining: 2m 53s. Rate: 76.2 symbols/min [2025-09-28T02:30:45.604011] [DEBUG] [LOCAL ] TWN: Loaded 3250 existing records from primary storage. [2025-09-28T02:30:45.630668] [INFO ] [MAIN ] TWN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:45.650165] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWN took 0.4s. Estimated remaining: 2m 52s. Rate: 76.2 symbols/min [2025-09-28T02:30:45.807731] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:45.879543] [DEBUG] [LOCAL ] TWLO: Loaded 53501 existing records from primary storage. [2025-09-28T02:30:45.890057] [INFO ] [MAIN ] TWLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:45.900694] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWLO took 1.0s. Estimated remaining: 2m 51s. Rate: 76.2 symbols/min [2025-09-28T02:30:46.012304] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:46.038707] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-28T02:30:46.055010] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-28T02:30:46.090474] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-28T02:30:46.142167] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-28T02:30:46.145108] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-28T02:30:46.165232] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:46.165819] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-28T02:30:46.332292] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-28T02:30:46.432909] [DEBUG] [LOCAL ] TX: Loaded 23932 existing records from primary storage. [2025-09-28T02:30:46.414881] [DEBUG] [LOCAL ] TWO: Loaded 49002 existing records from primary storage. [2025-09-28T02:30:46.437564] [INFO ] [MAIN ] TWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:46.433410] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-28T02:30:46.440766] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWO took 0.9s. Estimated remaining: 2m 50s. Rate: 76.2 symbols/min [2025-09-28T02:30:46.440524] [INFO ] [MAIN ] TX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:46.463800] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TX took 0.5s. Estimated remaining: 2m 49s. Rate: 76.3 symbols/min [2025-09-28T02:30:47.041031] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:30:47.034573] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:47.042622] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:30:47.043586] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-28T02:30:47.066405] [DEBUG] [LOCAL ] TXO: Loaded 19060 existing records from primary storage. [2025-09-28T02:30:47.066901] [INFO ] [MAIN ] TXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:47.067021] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TXO took 0.5s. Estimated remaining: 2m 48s. Rate: 76.3 symbols/min [2025-09-28T02:30:47.101839] [DEBUG] [LOCAL ] TXNM: Loaded 44463 existing records from primary storage. [2025-09-28T02:30:47.102282] [INFO ] [MAIN ] TXNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:30:47.102387] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TXNM took 0.6s. Estimated remaining: 2m 47s. Rate: 76.3 symbols/min [2025-09-28T02:30:47.252201] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:30:47.252564] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-28T02:30:47.252683] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:30:47.252761] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-09-28T02:30:47.252830] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:30:47.252908] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-28T02:30:47.253004] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-28T02:30:47.253075] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-28T02:30:47.253177] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-28T02:30:47.253270] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TWOD took 1.6s. Estimated remaining: 2m 47s. Rate: 76.3 symbols/min [2025-09-28T02:30:48.268739] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-28T02:30:48.278619] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-28T02:30:50.299635] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-28T02:30:50.311509] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-28T02:30:52.365391] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-28T02:30:52.376947] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-28T02:30:54.172911] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-28T02:30:54.184247] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-28T02:30:55.804073] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-28T02:30:55.814489] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-28T02:30:57.657935] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-28T02:30:57.671062] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-28T02:30:59.359446] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-28T02:30:59.370370] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-28T02:31:01.292302] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-28T02:31:01.302423] [INFO ] [REMOTE ] TRV: Full fetch complete (69971 records). [2025-09-28T02:31:01.302678] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-28T02:31:01.741150] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-28T02:31:01.741283] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-28T02:31:01.742090] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-28T02:31:01.742211] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-28T02:31:01.743786] [DEBUG] [LOCAL ] TRV: Trimmed 69971 records to 48744 (keeping 200 days of data) [2025-09-28T02:31:02.072361] [DEBUG] [LOCAL ] TRV: Primary data saved (48744 records). [2025-09-28T02:31:02.072624] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-28T02:31:02.072801] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TRV took 22.1s. Estimated remaining: 2m 47s. Rate: 75.7 symbols/min [2025-09-28T02:31:02.763767] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:02.764758] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:02.861399] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:02.883759] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:02.894121] [DEBUG] [LOCAL ] TY: Loaded 7756 existing records from primary storage. [2025-09-28T02:31:02.894601] [INFO ] [MAIN ] TY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:02.894722] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TY took 0.8s. Estimated remaining: 2m 46s. Rate: 75.7 symbols/min [2025-09-28T02:31:03.031500] [DEBUG] [LOCAL ] TYG: Loaded 14410 existing records from primary storage. [2025-09-28T02:31:03.015369] [DEBUG] [LOCAL ] TYL: Loaded 22582 existing records from primary storage. [2025-09-28T02:31:03.051358] [INFO ] [MAIN ] TYL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:03.051614] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYL took 1.0s. Estimated remaining: 2m 46s. Rate: 75.7 symbols/min [2025-09-28T02:31:03.052273] [INFO ] [MAIN ] TYG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:03.178608] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:03.192617] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TYG took 1.1s. Estimated remaining: 2m 45s. Rate: 75.8 symbols/min [2025-09-28T02:31:03.490524] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:03.508964] [DEBUG] [LOCAL ] TXT: Loaded 50470 existing records from primary storage. [2025-09-28T02:31:03.541233] [INFO ] [MAIN ] TXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:03.565811] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TXT took 1.5s. Estimated remaining: 2m 44s. Rate: 75.8 symbols/min [2025-09-28T02:31:03.588178] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:03.694327] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-09-28T02:31:03.744968] [INFO ] [MAIN ] U: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:03.793564] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. U took 0.9s. Estimated remaining: 2m 43s. Rate: 75.8 symbols/min [2025-09-28T02:31:03.824310] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:03.881160] [DEBUG] [LOCAL ] UA: Loaded 51189 existing records from primary storage. [2025-09-28T02:31:03.942579] [INFO ] [MAIN ] UA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:03.966893] [DEBUG] [LOCAL ] UAN: Loaded 5507 existing records from primary storage. [2025-09-28T02:31:03.972618] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. UA took 0.9s. Estimated remaining: 2m 42s. Rate: 75.8 symbols/min [2025-09-28T02:31:03.998605] [INFO ] [MAIN ] UAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:04.031633] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-09-28T02:31:04.063841] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. UAN took 0.5s. Estimated remaining: 2m 41s. Rate: 75.9 symbols/min [2025-09-28T02:31:04.094050] [INFO ] [MAIN ] UAA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:04.184329] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UAA took 1.0s. Estimated remaining: 2m 40s. Rate: 75.9 symbols/min [2025-09-28T02:31:04.158278] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:04.515022] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:04.704523] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:04.708132] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:04.729124] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-09-28T02:31:04.745037] [INFO ] [MAIN ] UBER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:04.745484] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UBER took 0.9s. Estimated remaining: 2m 40s. Rate: 75.9 symbols/min [2025-09-28T02:31:04.956366] [DEBUG] [LOCAL ] UBS: Loaded 53187 existing records from primary storage. [2025-09-28T02:31:04.996438] [INFO ] [MAIN ] UBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:05.049177] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:05.050194] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UBS took 1.0s. Estimated remaining: 2m 39s. Rate: 75.9 symbols/min [2025-09-28T02:31:05.073975] [DEBUG] [LOCAL ] UDR: Loaded 52555 existing records from primary storage. [2025-09-28T02:31:05.085529] [DEBUG] [LOCAL ] UCB: Loaded 38555 existing records from primary storage. [2025-09-28T02:31:05.101257] [INFO ] [MAIN ] UDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:05.135099] [INFO ] [MAIN ] UCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:05.135941] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UDR took 0.9s. Estimated remaining: 2m 38s. Rate: 76.0 symbols/min [2025-09-28T02:31:05.168344] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UCB took 1.0s. Estimated remaining: 2m 37s. Rate: 76.0 symbols/min [2025-09-28T02:31:05.521057] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:05.633593] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:05.708236] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:05.710764] [DEBUG] [LOCAL ] UE: Loaded 43513 existing records from primary storage. [2025-09-28T02:31:05.711330] [INFO ] [MAIN ] UE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:05.715758] [DEBUG] [LOCAL ] UFI: Loaded 8229 existing records from primary storage. [2025-09-28T02:31:05.716051] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UE took 1.0s. Estimated remaining: 2m 36s. Rate: 76.0 symbols/min [2025-09-28T02:31:05.716273] [INFO ] [MAIN ] UFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:05.721828] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UFI took 0.7s. Estimated remaining: 2m 35s. Rate: 76.0 symbols/min [2025-09-28T02:31:06.107430] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:06.148473] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:06.181044] [DEBUG] [LOCAL ] UGP: Loaded 43319 existing records from primary storage. [2025-09-28T02:31:06.182808] [INFO ] [MAIN ] UGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:06.182914] [DEBUG] [LOCAL ] UGI: Loaded 51290 existing records from primary storage. [2025-09-28T02:31:06.183213] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UGP took 1.0s. Estimated remaining: 2m 35s. Rate: 76.1 symbols/min [2025-09-28T02:31:06.184611] [INFO ] [MAIN ] UGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:06.203285] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UGI took 1.0s. Estimated remaining: 2m 34s. Rate: 76.1 symbols/min [2025-09-28T02:31:06.366838] [DEBUG] [LOCAL ] UHAL: Loaded 16817 existing records from primary storage. [2025-09-28T02:31:06.400011] [INFO ] [MAIN ] UHAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:06.469457] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UHAL took 0.8s. Estimated remaining: 2m 33s. Rate: 76.1 symbols/min [2025-09-28T02:31:06.521135] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:06.710000] [DEBUG] [LOCAL ] UHS: Loaded 41674 existing records from primary storage. [2025-09-28T02:31:06.725239] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:06.744172] [INFO ] [MAIN ] UHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:06.769141] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHS took 1.0s. Estimated remaining: 2m 32s. Rate: 76.1 symbols/min [2025-09-28T02:31:06.855241] [DEBUG] [LOCAL ] UHT: Loaded 10131 existing records from primary storage. [2025-09-28T02:31:06.944045] [INFO ] [MAIN ] UHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:06.971472] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHT took 0.8s. Estimated remaining: 2m 31s. Rate: 76.2 symbols/min [2025-09-28T02:31:06.953414] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:07.006342] [DEBUG] [LOCAL ] UI: Loaded 13008 existing records from primary storage. [2025-09-28T02:31:07.035954] [INFO ] [MAIN ] UI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:07.063716] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UI took 0.8s. Estimated remaining: 2m 30s. Rate: 76.2 symbols/min [2025-09-28T02:31:07.310554] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:07.456939] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:07.534917] [DEBUG] [LOCAL ] UIS: Loaded 37552 existing records from primary storage. [2025-09-28T02:31:07.541571] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:07.542526] [INFO ] [MAIN ] UIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:07.542753] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 1.0s. Estimated remaining: 2m 30s. Rate: 76.2 symbols/min [2025-09-28T02:31:07.796981] [DEBUG] [LOCAL ] UL: Loaded 53843 existing records from primary storage. [2025-09-28T02:31:07.832462] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:07.844716] [INFO ] [MAIN ] UL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:07.845354] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. UL took 1.1s. Estimated remaining: 2m 29s. Rate: 76.2 symbols/min [2025-09-28T02:31:07.846228] [DEBUG] [LOCAL ] ULS: Loaded 39769 existing records from primary storage. [2025-09-28T02:31:07.869433] [INFO ] [MAIN ] ULS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:07.901277] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. ULS took 0.9s. Estimated remaining: 2m 28s. Rate: 76.3 symbols/min [2025-09-28T02:31:08.032588] [DEBUG] [LOCAL ] UMC: Loaded 53490 existing records from primary storage. [2025-09-28T02:31:08.100987] [INFO ] [MAIN ] UMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:08.147553] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMC took 1.1s. Estimated remaining: 2m 27s. Rate: 76.3 symbols/min [2025-09-28T02:31:08.147126] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:08.272758] [DEBUG] [LOCAL ] UMH: Loaded 34078 existing records from primary storage. [2025-09-28T02:31:08.307268] [INFO ] [MAIN ] UMH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:08.426551] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:08.396028] [DEBUG] [LOCAL ] UNF: Loaded 12048 existing records from primary storage. [2025-09-28T02:31:08.426731] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UMH took 0.9s. Estimated remaining: 2m 26s. Rate: 76.3 symbols/min [2025-09-28T02:31:08.443241] [INFO ] [MAIN ] UNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:08.473179] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UNF took 0.6s. Estimated remaining: 2m 25s. Rate: 76.3 symbols/min [2025-09-28T02:31:08.591394] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:08.885583] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:08.931702] [DEBUG] [LOCAL ] UNFI: Loaded 42528 existing records from primary storage. [2025-09-28T02:31:08.953809] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:08.969260] [INFO ] [MAIN ] UNFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:08.970091] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNFI took 1.0s. Estimated remaining: 2m 25s. Rate: 76.4 symbols/min [2025-09-28T02:31:09.089032] [DEBUG] [LOCAL ] UNMA: Loaded 3627 existing records from primary storage. [2025-09-28T02:31:09.110903] [INFO ] [MAIN ] UNMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:09.112313] [DEBUG] [LOCAL ] UNH: Loaded 54574 existing records from primary storage. [2025-09-28T02:31:09.118708] [INFO ] [MAIN ] UNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:09.134525] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNH took 1.0s. Estimated remaining: 2m 24s. Rate: 76.4 symbols/min [2025-09-28T02:31:09.151286] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNMA took 0.6s. Estimated remaining: 2m 23s. Rate: 76.4 symbols/min [2025-09-28T02:31:09.234043] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:09.397518] [DEBUG] [LOCAL ] UNM: Loaded 49368 existing records from primary storage. [2025-09-28T02:31:09.473233] [INFO ] [MAIN ] UNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:09.506116] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNM took 1.1s. Estimated remaining: 2m 22s. Rate: 76.4 symbols/min [2025-09-28T02:31:09.610554] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:09.639911] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:09.868026] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:09.887745] [DEBUG] [LOCAL ] UNP: Loaded 54030 existing records from primary storage. [2025-09-28T02:31:09.888520] [INFO ] [MAIN ] UNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:09.888681] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UNP took 0.9s. Estimated remaining: 2m 21s. Rate: 76.5 symbols/min [2025-09-28T02:31:10.003092] [DEBUG] [LOCAL ] UP: Loaded 43857 existing records from primary storage. [2025-09-28T02:31:10.025608] [INFO ] [MAIN ] UP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:10.036791] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. UP took 0.9s. Estimated remaining: 2m 20s. Rate: 76.5 symbols/min [2025-09-28T02:31:10.252058] [DEBUG] [LOCAL ] UPS: Loaded 54490 existing records from primary storage. [2025-09-28T02:31:10.214515] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:10.269536] [INFO ] [MAIN ] UPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:10.275579] [DEBUG] [LOCAL ] URI: Loaded 36669 existing records from primary storage. [2025-09-28T02:31:10.318861] [INFO ] [MAIN ] URI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:10.318577] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. UPS took 1.1s. Estimated remaining: 2m 20s. Rate: 76.5 symbols/min [2025-09-28T02:31:10.345875] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. URI took 0.7s. Estimated remaining: 2m 19s. Rate: 76.5 symbols/min [2025-09-28T02:31:10.367066] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:10.736147] [DEBUG] [LOCAL ] USAC: Loaded 23060 existing records from primary storage. [2025-09-28T02:31:10.734127] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:10.735584] [DEBUG] [LOCAL ] USA: Loaded 36524 existing records from primary storage. [2025-09-28T02:31:10.747438] [INFO ] [MAIN ] USA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:10.741825] [INFO ] [MAIN ] USAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:10.753060] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. USAC took 0.7s. Estimated remaining: 2m 18s. Rate: 76.6 symbols/min [2025-09-28T02:31:10.753933] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USA took 0.9s. Estimated remaining: 2m 17s. Rate: 76.6 symbols/min [2025-09-28T02:31:10.889266] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:11.135889] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:11.206977] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:11.230818] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-09-28T02:31:11.246603] [INFO ] [MAIN ] USB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:11.246991] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USB took 0.9s. Estimated remaining: 2m 16s. Rate: 76.6 symbols/min [2025-09-28T02:31:11.271089] [DEBUG] [LOCAL ] USNA: Loaded 18368 existing records from primary storage. [2025-09-28T02:31:11.271469] [DEBUG] [LOCAL ] USPH: Loaded 16827 existing records from primary storage. [2025-09-28T02:31:11.272069] [INFO ] [MAIN ] USPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:11.272211] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USPH took 0.5s. Estimated remaining: 2m 15s. Rate: 76.6 symbols/min [2025-09-28T02:31:11.286029] [INFO ] [MAIN ] USNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:11.287541] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USNA took 0.5s. Estimated remaining: 2m 15s. Rate: 76.7 symbols/min [2025-09-28T02:31:11.288788] [DEBUG] [LOCAL ] USFD: Loaded 51959 existing records from primary storage. [2025-09-28T02:31:11.289138] [INFO ] [MAIN ] USFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:11.289251] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USFD took 0.9s. Estimated remaining: 2m 14s. Rate: 76.7 symbols/min [2025-09-28T02:31:11.997401] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:12.061384] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:12.070601] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:12.128855] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:12.143696] [DEBUG] [LOCAL ] UTL: Loaded 11273 existing records from primary storage. [2025-09-28T02:31:12.144389] [INFO ] [MAIN ] UTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:12.144489] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 0.8s. Estimated remaining: 2m 13s. Rate: 76.7 symbols/min [2025-09-28T02:31:12.336887] [DEBUG] [LOCAL ] UTF: Loaded 29200 existing records from primary storage. [2025-09-28T02:31:12.375838] [INFO ] [MAIN ] UTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:12.414389] [DEBUG] [LOCAL ] UTI: Loaded 41146 existing records from primary storage. [2025-09-28T02:31:12.415576] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:12.415822] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTF took 1.1s. Estimated remaining: 2m 12s. Rate: 76.7 symbols/min [2025-09-28T02:31:12.429375] [INFO ] [MAIN ] UTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:12.435036] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTI took 1.1s. Estimated remaining: 2m 11s. Rate: 76.8 symbols/min [2025-09-28T02:31:12.485840] [DEBUG] [LOCAL ] UTZ: Loaded 45341 existing records from primary storage. [2025-09-28T02:31:12.590510] [INFO ] [MAIN ] UTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:12.653731] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTZ took 1.4s. Estimated remaining: 2m 11s. Rate: 76.8 symbols/min [2025-09-28T02:31:12.806071] [DEBUG] [LOCAL ] UVE: Loaded 22124 existing records from primary storage. [2025-09-28T02:31:12.888035] [INFO ] [MAIN ] UVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:12.874341] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:12.913682] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 0.8s. Estimated remaining: 2m 10s. Rate: 76.8 symbols/min [2025-09-28T02:31:12.939902] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:13.193481] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:13.257354] [DEBUG] [LOCAL ] UVV: Loaded 22660 existing records from primary storage. [2025-09-28T02:31:13.272822] [INFO ] [MAIN ] UVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:13.296299] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:13.295231] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UVV took 0.9s. Estimated remaining: 2m 9s. Rate: 76.8 symbols/min [2025-09-28T02:31:13.328443] [DEBUG] [LOCAL ] UZD: Loaded 6455 existing records from primary storage. [2025-09-28T02:31:13.357506] [INFO ] [MAIN ] UZD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:13.371848] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UZD took 0.7s. Estimated remaining: 2m 8s. Rate: 76.9 symbols/min [2025-09-28T02:31:13.430088] [DEBUG] [LOCAL ] UZE: Loaded 7528 existing records from primary storage. [2025-09-28T02:31:13.458521] [INFO ] [MAIN ] UZE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:13.464538] [DEBUG] [LOCAL ] UWMC: Loaded 53516 existing records from primary storage. [2025-09-28T02:31:13.476091] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZE took 0.5s. Estimated remaining: 2m 7s. Rate: 76.9 symbols/min [2025-09-28T02:31:13.593033] [INFO ] [MAIN ] UWMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:13.685839] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UWMC took 1.2s. Estimated remaining: 2m 6s. Rate: 76.9 symbols/min [2025-09-28T02:31:13.719937] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:14.023391] [DEBUG] [LOCAL ] UZF: Loaded 6574 existing records from primary storage. [2025-09-28T02:31:14.097048] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:14.099098] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:14.089541] [INFO ] [MAIN ] UZF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:14.126552] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZF took 0.8s. Estimated remaining: 2m 6s. Rate: 76.9 symbols/min [2025-09-28T02:31:14.181068] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:14.421388] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:14.437029] [DEBUG] [LOCAL ] VAC: Loaded 35026 existing records from primary storage. [2025-09-28T02:31:14.438231] [INFO ] [MAIN ] VAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:14.438393] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. VAC took 0.9s. Estimated remaining: 2m 5s. Rate: 76.9 symbols/min [2025-09-28T02:31:14.597299] [DEBUG] [LOCAL ] V: Loaded 54535 existing records from primary storage. [2025-09-28T02:31:14.598450] [DEBUG] [LOCAL ] VAL: Loaded 51142 existing records from primary storage. [2025-09-28T02:31:14.604858] [INFO ] [MAIN ] V: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:14.604674] [INFO ] [MAIN ] VAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:14.605816] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. V took 1.1s. Estimated remaining: 2m 4s. Rate: 77.0 symbols/min [2025-09-28T02:31:14.612541] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VAL took 0.9s. Estimated remaining: 2m 3s. Rate: 77.0 symbols/min [2025-09-28T02:31:14.795821] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:15.049243] [DEBUG] [LOCAL ] VALE: Loaded 54474 existing records from primary storage. [2025-09-28T02:31:15.124482] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:15.129265] [DEBUG] [LOCAL ] VATE: Loaded 5658 existing records from primary storage. [2025-09-28T02:31:15.153044] [INFO ] [MAIN ] VATE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:15.158367] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:15.158901] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VATE took 0.7s. Estimated remaining: 2m 2s. Rate: 77.0 symbols/min [2025-09-28T02:31:15.153176] [INFO ] [MAIN ] VALE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:15.171191] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VALE took 1.0s. Estimated remaining: 2m 1s. Rate: 77.1 symbols/min [2025-09-28T02:31:15.275454] [DEBUG] [LOCAL ] VBF: Loaded 7206 existing records from primary storage. [2025-09-28T02:31:15.315842] [DEBUG] [LOCAL ] VCV: Loaded 13766 existing records from primary storage. [2025-09-28T02:31:15.332702] [INFO ] [MAIN ] VBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:15.364840] [INFO ] [MAIN ] VCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:15.365017] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VBF took 0.8s. Estimated remaining: 2m 1s. Rate: 77.1 symbols/min [2025-09-28T02:31:15.429316] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VCV took 0.7s. Estimated remaining: 1m 60s. Rate: 77.1 symbols/min [2025-09-28T02:31:15.641454] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:15.709868] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:15.935243] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:15.947096] [DEBUG] [LOCAL ] VEL: Loaded 13299 existing records from primary storage. [2025-09-28T02:31:15.975018] [INFO ] [MAIN ] VEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:16.006975] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEL took 0.8s. Estimated remaining: 1m 59s. Rate: 77.1 symbols/min [2025-09-28T02:31:16.039144] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:16.190307] [DEBUG] [LOCAL ] VEEV: Loaded 47821 existing records from primary storage. [2025-09-28T02:31:16.206772] [INFO ] [MAIN ] VEEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:16.228573] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VEEV took 1.1s. Estimated remaining: 1m 58s. Rate: 77.1 symbols/min [2025-09-28T02:31:16.310089] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:16.386985] [DEBUG] [LOCAL ] VET: Loaded 44749 existing records from primary storage. [2025-09-28T02:31:16.369624] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-28T02:31:16.410506] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-28T02:31:16.415896] [INFO ] [MAIN ] VET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:16.421604] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-28T02:31:16.432682] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VET took 1.0s. Estimated remaining: 1m 57s. Rate: 77.2 symbols/min [2025-09-28T02:31:16.443234] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-28T02:31:16.491488] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-28T02:31:16.528714] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-28T02:31:16.523405] [DEBUG] [LOCAL ] VFC: Loaded 54390 existing records from primary storage. [2025-09-28T02:31:16.611992] [INFO ] [MAIN ] VFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:16.696724] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VFC took 1.1s. Estimated remaining: 1m 57s. Rate: 77.2 symbols/min [2025-09-28T02:31:16.743226] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:17.021568] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:17.066274] [DEBUG] [LOCAL ] VGI: Loaded 5237 existing records from primary storage. [2025-09-28T02:31:17.109824] [INFO ] [MAIN ] VGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:17.138222] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VGI took 0.9s. Estimated remaining: 1m 56s. Rate: 77.2 symbols/min [2025-09-28T02:31:17.351052] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:17.411560] [DEBUG] [LOCAL ] VGM: Loaded 18384 existing records from primary storage. [2025-09-28T02:31:17.441164] [INFO ] [MAIN ] VGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:17.477474] [DEBUG] [LOCAL ] VHI: Loaded 2905 existing records from primary storage. [2025-09-28T02:31:17.477568] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VGM took 1.0s. Estimated remaining: 1m 55s. Rate: 77.2 symbols/min [2025-09-28T02:31:17.567108] [INFO ] [MAIN ] VHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:17.667309] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:17.700317] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:17.742189] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-28T02:31:17.716482] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-28T02:31:17.700440] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VHI took 0.9s. Estimated remaining: 1m 54s. Rate: 77.3 symbols/min [2025-09-28T02:31:17.770512] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-28T02:31:17.809503] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-28T02:31:17.864980] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-28T02:31:17.913151] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:17.922553] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-28T02:31:17.975580] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-28T02:31:18.153397] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:18.083284] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:31:18.171250] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-28T02:31:18.189904] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:31:18.205845] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-09-28T02:31:18.232106] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:31:18.278402] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-28T02:31:18.324365] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-28T02:31:18.336871] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-28T02:31:18.376041] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-28T02:31:18.430527] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VG took 2.4s. Estimated remaining: 1m 53s. Rate: 77.3 symbols/min [2025-09-28T02:31:18.465274] [DEBUG] [LOCAL ] VICI: Loaded 54427 existing records from primary storage. [2025-09-28T02:31:18.506805] [INFO ] [MAIN ] VICI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:18.564809] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VICI took 1.0s. Estimated remaining: 1m 53s. Rate: 77.3 symbols/min [2025-09-28T02:31:18.651266] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:18.673004] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-28T02:31:18.722429] [DEBUG] [LOCAL ] VIK: Loaded 53250 existing records from primary storage. [2025-09-28T02:31:18.781978] [INFO ] [MAIN ] VIK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:18.863192] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VIK took 1.1s. Estimated remaining: 1m 52s. Rate: 77.3 symbols/min [2025-09-28T02:31:18.921536] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:19.013900] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:31:19.131004] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-28T02:31:19.119538] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:19.151264] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:31:19.151510] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-09-28T02:31:19.158086] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:31:19.174182] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-28T02:31:19.232461] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:19.228302] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-28T02:31:19.233060] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-28T02:31:19.233453] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-28T02:31:19.233557] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIA took 2.1s. Estimated remaining: 1m 51s. Rate: 77.3 symbols/min [2025-09-28T02:31:19.412870] [DEBUG] [LOCAL ] VIPS: Loaded 52093 existing records from primary storage. [2025-09-28T02:31:19.441810] [INFO ] [MAIN ] VIPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:19.509332] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIPS took 1.1s. Estimated remaining: 1m 50s. Rate: 77.3 symbols/min [2025-09-28T02:31:19.511347] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:19.525911] [DEBUG] [LOCAL ] VIRT: Loaded 47448 existing records from primary storage. [2025-09-28T02:31:19.572032] [DEBUG] [LOCAL ] VIST: Loaded 46722 existing records from primary storage. [2025-09-28T02:31:19.577482] [INFO ] [MAIN ] VIRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:19.597153] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIRT took 1.0s. Estimated remaining: 1m 49s. Rate: 77.4 symbols/min [2025-09-28T02:31:19.602616] [INFO ] [MAIN ] VIST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:19.631395] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VIST took 0.7s. Estimated remaining: 1m 49s. Rate: 77.4 symbols/min [2025-09-28T02:31:19.924825] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:20.060189] [DEBUG] [LOCAL ] VIV: Loaded 45667 existing records from primary storage. [2025-09-28T02:31:20.069963] [INFO ] [MAIN ] VIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:20.106154] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:20.172069] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:20.143204] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VIV took 0.9s. Estimated remaining: 1m 48s. Rate: 77.4 symbols/min [2025-09-28T02:31:20.205408] [DEBUG] [LOCAL ] VKQ: Loaded 17552 existing records from primary storage. [2025-09-28T02:31:20.243454] [INFO ] [MAIN ] VKQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:20.285500] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VKQ took 0.8s. Estimated remaining: 1m 47s. Rate: 77.4 symbols/min [2025-09-28T02:31:20.449271] [DEBUG] [LOCAL ] VLN: Loaded 29056 existing records from primary storage. [2025-09-28T02:31:20.532094] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:20.527792] [INFO ] [MAIN ] VLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:20.575006] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VLN took 0.9s. Estimated remaining: 1m 46s. Rate: 77.5 symbols/min [2025-09-28T02:31:20.757204] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:20.802481] [DEBUG] [LOCAL ] VLO: Loaded 53865 existing records from primary storage. [2025-09-28T02:31:20.862438] [INFO ] [MAIN ] VLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:20.895084] [DEBUG] [LOCAL ] VLT: Loaded 4615 existing records from primary storage. [2025-09-28T02:31:20.900098] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLO took 1.2s. Estimated remaining: 1m 45s. Rate: 77.5 symbols/min [2025-09-28T02:31:20.899377] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:20.913686] [INFO ] [MAIN ] VLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:20.921977] [DEBUG] [LOCAL ] VLRS: Loaded 41188 existing records from primary storage. [2025-09-28T02:31:20.934406] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLT took 0.6s. Estimated remaining: 1m 44s. Rate: 77.5 symbols/min [2025-09-28T02:31:20.957389] [INFO ] [MAIN ] VLRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:21.006625] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLRS took 0.8s. Estimated remaining: 1m 44s. Rate: 77.6 symbols/min [2025-09-28T02:31:21.339274] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:21.343281] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:21.360995] [DEBUG] [LOCAL ] VLTO: Loaded 46710 existing records from primary storage. [2025-09-28T02:31:21.361400] [INFO ] [MAIN ] VLTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:21.361560] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VLTO took 0.8s. Estimated remaining: 1m 43s. Rate: 77.6 symbols/min [2025-09-28T02:31:21.380104] [DEBUG] [LOCAL ] VMI: Loaded 15711 existing records from primary storage. [2025-09-28T02:31:21.380997] [INFO ] [MAIN ] VMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:21.381139] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VMI took 0.4s. Estimated remaining: 1m 42s. Rate: 77.6 symbols/min [2025-09-28T02:31:21.414463] [DEBUG] [LOCAL ] VMC: Loaded 44263 existing records from primary storage. [2025-09-28T02:31:21.414860] [INFO ] [MAIN ] VMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:21.414967] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMC took 0.5s. Estimated remaining: 1m 41s. Rate: 77.6 symbols/min [2025-09-28T02:31:22.163981] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:22.189133] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:22.233379] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:22.254580] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:22.270732] [DEBUG] [LOCAL ] VNCE: Loaded 7593 existing records from primary storage. [2025-09-28T02:31:22.271214] [INFO ] [MAIN ] VNCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:22.271553] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VNCE took 0.8s. Estimated remaining: 1m 40s. Rate: 77.6 symbols/min [2025-09-28T02:31:22.376473] [DEBUG] [LOCAL ] VMO: Loaded 21297 existing records from primary storage. [2025-09-28T02:31:22.430702] [INFO ] [MAIN ] VMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:22.431029] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VMO took 1.0s. Estimated remaining: 1m 40s. Rate: 77.7 symbols/min [2025-09-28T02:31:22.569328] [DEBUG] [LOCAL ] VNT: Loaded 44451 existing records from primary storage. [2025-09-28T02:31:22.604616] [DEBUG] [LOCAL ] VNO: Loaded 49668 existing records from primary storage. [2025-09-28T02:31:22.640919] [INFO ] [MAIN ] VNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:22.660467] [INFO ] [MAIN ] VNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:22.679756] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNO took 1.3s. Estimated remaining: 1m 39s. Rate: 77.7 symbols/min [2025-09-28T02:31:22.747394] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VNT took 1.3s. Estimated remaining: 1m 38s. Rate: 77.7 symbols/min [2025-09-28T02:31:22.749464] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:22.852011] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:23.001465] [DEBUG] [LOCAL ] VOC: Loaded 9021 existing records from primary storage. [2025-09-28T02:31:23.052000] [INFO ] [MAIN ] VOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:23.055988] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VOC took 0.8s. Estimated remaining: 1m 37s. Rate: 77.7 symbols/min [2025-09-28T02:31:23.088450] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:23.131685] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-28T02:31:23.185189] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-28T02:31:23.274274] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-28T02:31:23.353432] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-28T02:31:23.363037] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:23.402887] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-28T02:31:23.440152] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:23.440327] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-28T02:31:23.442229] [DEBUG] [LOCAL ] VOYA: Loaded 43377 existing records from primary storage. [2025-09-28T02:31:23.459629] [INFO ] [MAIN ] VOYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:23.488102] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VOYA took 1.1s. Estimated remaining: 1m 36s. Rate: 77.8 symbols/min [2025-09-28T02:31:23.671598] [DEBUG] [LOCAL ] VPV: Loaded 5429 existing records from primary storage. [2025-09-28T02:31:23.684331] [DEBUG] [LOCAL ] VPG: Loaded 17373 existing records from primary storage. [2025-09-28T02:31:23.739830] [INFO ] [MAIN ] VPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:23.734236] [INFO ] [MAIN ] VPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:23.740302] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VPG took 0.9s. Estimated remaining: 1m 36s. Rate: 77.8 symbols/min [2025-09-28T02:31:23.790743] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VPV took 0.7s. Estimated remaining: 1m 35s. Rate: 77.8 symbols/min [2025-09-28T02:31:23.999542] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:24.458475] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:24.505567] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:24.594783] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:24.597085] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-28T02:31:24.596522] [DEBUG] [LOCAL ] VRE: Loaded 35345 existing records from primary storage. [2025-09-28T02:31:24.601070] [INFO ] [MAIN ] VRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:24.601244] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VRE took 1.1s. Estimated remaining: 1m 34s. Rate: 77.8 symbols/min [2025-09-28T02:31:24.625070] [DEBUG] [LOCAL ] VRTS: Loaded 9287 existing records from primary storage. [2025-09-28T02:31:24.680049] [INFO ] [MAIN ] VRTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:24.710619] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRTS took 0.8s. Estimated remaining: 1m 33s. Rate: 77.8 symbols/min [2025-09-28T02:31:24.907233] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:24.882901] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:31:24.964154] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-28T02:31:24.974793] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:31:24.968966] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-09-28T02:31:24.981710] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-09-28T02:31:24.982250] [INFO ] [MAIN ] VRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:24.982420] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRT took 1.2s. Estimated remaining: 1m 32s. Rate: 77.9 symbols/min [2025-09-28T02:31:24.987934] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:31:25.063995] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-28T02:31:25.132807] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-28T02:31:25.151779] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-28T02:31:25.133778] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:25.157054] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-28T02:31:25.181704] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VOYG took 2.4s. Estimated remaining: 1m 32s. Rate: 77.9 symbols/min [2025-09-28T02:31:25.357966] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:25.448787] [DEBUG] [LOCAL ] VSCO: Loaded 53556 existing records from primary storage. [2025-09-28T02:31:25.504845] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:25.505704] [INFO ] [MAIN ] VSCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:25.505910] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSCO took 0.9s. Estimated remaining: 1m 31s. Rate: 77.9 symbols/min [2025-09-28T02:31:25.672290] [DEBUG] [LOCAL ] VSH: Loaded 49188 existing records from primary storage. [2025-09-28T02:31:25.672841] [INFO ] [MAIN ] VSH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:25.672946] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 0.9s. Estimated remaining: 1m 30s. Rate: 77.9 symbols/min [2025-09-28T02:31:25.841038] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:25.899114] [DEBUG] [LOCAL ] VST: Loaded 54498 existing records from primary storage. [2025-09-28T02:31:25.925159] [DEBUG] [LOCAL ] VSTS: Loaded 49773 existing records from primary storage. [2025-09-28T02:31:25.923739] [INFO ] [MAIN ] VST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:25.935934] [INFO ] [MAIN ] VSTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:25.937599] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VSTS took 0.8s. Estimated remaining: 1m 29s. Rate: 78.0 symbols/min [2025-09-28T02:31:25.943158] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VST took 1.0s. Estimated remaining: 1m 28s. Rate: 78.0 symbols/min [2025-09-28T02:31:26.054599] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:26.374396] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:26.444993] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:26.446551] [DEBUG] [LOCAL ] VTEX: Loaded 43948 existing records from primary storage. [2025-09-28T02:31:26.448584] [INFO ] [MAIN ] VTEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:26.448927] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTEX took 0.9s. Estimated remaining: 1m 28s. Rate: 78.0 symbols/min [2025-09-28T02:31:26.579580] [DEBUG] [LOCAL ] VTN: Loaded 7293 existing records from primary storage. [2025-09-28T02:31:26.594001] [INFO ] [MAIN ] VTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:26.563739] [DEBUG] [LOCAL ] VTLE: Loaded 49337 existing records from primary storage. [2025-09-28T02:31:26.600744] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTN took 0.6s. Estimated remaining: 1m 27s. Rate: 78.0 symbols/min [2025-09-28T02:31:26.607104] [INFO ] [MAIN ] VTLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:26.623159] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTLE took 1.0s. Estimated remaining: 1m 26s. Rate: 78.1 symbols/min [2025-09-28T02:31:26.646385] [DEBUG] [LOCAL ] VTMX: Loaded 17811 existing records from primary storage. [2025-09-28T02:31:26.774432] [INFO ] [MAIN ] VTMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:26.784832] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:26.883283] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTMX took 0.9s. Estimated remaining: 1m 25s. Rate: 78.1 symbols/min [2025-09-28T02:31:27.123192] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:27.211242] [DEBUG] [LOCAL ] VTOL: Loaded 19915 existing records from primary storage. [2025-09-28T02:31:27.231903] [INFO ] [MAIN ] VTOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:27.231446] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:27.242867] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTOL took 0.8s. Estimated remaining: 1m 25s. Rate: 78.1 symbols/min [2025-09-28T02:31:27.330072] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:27.564462] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:27.559747] [DEBUG] [LOCAL ] VTS: Loaded 30992 existing records from primary storage. [2025-09-28T02:31:27.565030] [INFO ] [MAIN ] VTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:27.588070] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTS took 0.9s. Estimated remaining: 1m 24s. Rate: 78.1 symbols/min [2025-09-28T02:31:27.659285] [DEBUG] [LOCAL ] VTR: Loaded 53620 existing records from primary storage. [2025-09-28T02:31:27.702887] [DEBUG] [LOCAL ] VVR: Loaded 31251 existing records from primary storage. [2025-09-28T02:31:27.724838] [INFO ] [MAIN ] VVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:27.708761] [INFO ] [MAIN ] VTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:27.740331] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VVR took 0.8s. Estimated remaining: 1m 23s. Rate: 78.2 symbols/min [2025-09-28T02:31:27.745058] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VTR took 1.1s. Estimated remaining: 1m 22s. Rate: 78.2 symbols/min [2025-09-28T02:31:27.952370] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:28.071086] [DEBUG] [LOCAL ] VVV: Loaded 50933 existing records from primary storage. [2025-09-28T02:31:28.091083] [INFO ] [MAIN ] VVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:28.102490] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVV took 0.8s. Estimated remaining: 1m 21s. Rate: 78.2 symbols/min [2025-09-28T02:31:28.374087] [DEBUG] [LOCAL ] VVX: Loaded 23664 existing records from primary storage. [2025-09-28T02:31:28.382603] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:28.417314] [INFO ] [MAIN ] VVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:28.435075] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVX took 0.8s. Estimated remaining: 1m 21s. Rate: 78.2 symbols/min [2025-09-28T02:31:28.424367] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:28.526753] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:28.716180] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:28.797156] [DEBUG] [LOCAL ] VYX: Loaded 49624 existing records from primary storage. [2025-09-28T02:31:28.799473] [INFO ] [MAIN ] VYX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:28.799909] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 1.1s. Estimated remaining: 1m 20s. Rate: 78.2 symbols/min [2025-09-28T02:31:28.798859] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-09-28T02:31:28.806024] [INFO ] [MAIN ] VZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:28.806531] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. VZ took 1.1s. Estimated remaining: 1m 19s. Rate: 78.3 symbols/min [2025-09-28T02:31:28.892981] [DEBUG] [LOCAL ] W: Loaded 54266 existing records from primary storage. [2025-09-28T02:31:29.008986] [INFO ] [MAIN ] W: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:29.022771] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. W took 0.9s. Estimated remaining: 1m 18s. Rate: 78.3 symbols/min [2025-09-28T02:31:29.205550] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:29.212505] [DEBUG] [LOCAL ] WAB: Loaded 44872 existing records from primary storage. [2025-09-28T02:31:29.280019] [INFO ] [MAIN ] WAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:29.319385] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WAB took 0.9s. Estimated remaining: 1m 17s. Rate: 78.3 symbols/min [2025-09-28T02:31:29.384584] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:29.573952] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:29.588548] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-28T02:31:29.623526] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-28T02:31:29.647152] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-28T02:31:29.647584] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-28T02:31:29.690213] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-28T02:31:29.694503] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:29.697069] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-28T02:31:29.764961] [DEBUG] [LOCAL ] WAL: Loaded 46040 existing records from primary storage. [2025-09-28T02:31:29.824250] [INFO ] [MAIN ] WAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:29.818901] [DEBUG] [LOCAL ] WAT: Loaded 35620 existing records from primary storage. [2025-09-28T02:31:29.830113] [INFO ] [MAIN ] WAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:29.830212] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WAL took 1.0s. Estimated remaining: 1m 17s. Rate: 78.3 symbols/min [2025-09-28T02:31:29.863094] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAT took 1.1s. Estimated remaining: 1m 16s. Rate: 78.4 symbols/min [2025-09-28T02:31:30.385143] [DEBUG] [LOCAL ] WBS: Loaded 49471 existing records from primary storage. [2025-09-28T02:31:30.393322] [INFO ] [MAIN ] WBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:30.421925] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:30.448407] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WBS took 1.1s. Estimated remaining: 1m 15s. Rate: 78.4 symbols/min [2025-09-28T02:31:30.532231] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:30.694278] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:30.706188] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-28T02:31:30.711337] [DEBUG] [LOCAL ] WBX: Loaded 12558 existing records from primary storage. [2025-09-28T02:31:30.724087] [INFO ] [MAIN ] WBX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:30.736142] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WBX took 0.9s. Estimated remaining: 1m 14s. Rate: 78.4 symbols/min [2025-09-28T02:31:30.847350] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:31.005224] [DEBUG] [LOCAL ] WCC: Loaded 40567 existing records from primary storage. [2025-09-28T02:31:31.030100] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:31.030433] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:31:31.031792] [INFO ] [MAIN ] WCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:31.032336] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-28T02:31:31.032239] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WCC took 1.2s. Estimated remaining: 1m 13s. Rate: 78.4 symbols/min [2025-09-28T02:31:31.045792] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:31:31.079279] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-09-28T02:31:31.117457] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:31:31.159671] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-28T02:31:31.236132] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-28T02:31:31.264771] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:31.265357] [DEBUG] [LOCAL ] WD: Loaded 23747 existing records from primary storage. [2025-09-28T02:31:31.265723] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-28T02:31:31.284039] [DEBUG] [LOCAL ] WCN: Loaded 48708 existing records from primary storage. [2025-09-28T02:31:31.282177] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-28T02:31:31.282338] [INFO ] [MAIN ] WD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:31.284900] [INFO ] [MAIN ] WCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:31.284673] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WBI took 2.2s. Estimated remaining: 1m 13s. Rate: 78.4 symbols/min [2025-09-28T02:31:31.286180] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WD took 0.5s. Estimated remaining: 1m 12s. Rate: 78.5 symbols/min [2025-09-28T02:31:31.309880] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WCN took 0.8s. Estimated remaining: 1m 11s. Rate: 78.5 symbols/min [2025-09-28T02:31:31.470152] [DEBUG] [LOCAL ] WDH: Loaded 17597 existing records from primary storage. [2025-09-28T02:31:31.492907] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:31.493586] [INFO ] [MAIN ] WDH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:31.493720] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WDH took 0.5s. Estimated remaining: 1m 10s. Rate: 78.5 symbols/min [2025-09-28T02:31:31.515808] [DEBUG] [LOCAL ] WDI: Loaded 21314 existing records from primary storage. [2025-09-28T02:31:31.516194] [INFO ] [MAIN ] WDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:31.516302] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 0.2s. Estimated remaining: 1m 9s. Rate: 78.6 symbols/min [2025-09-28T02:31:32.211464] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:32.274800] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:32.243094] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:32.298705] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:32.311726] [DEBUG] [LOCAL ] WEA: Loaded 7379 existing records from primary storage. [2025-09-28T02:31:32.312312] [INFO ] [MAIN ] WEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:32.312412] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 0.8s. Estimated remaining: 1m 9s. Rate: 78.6 symbols/min [2025-09-28T02:31:32.562265] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:32.564604] [DEBUG] [LOCAL ] WEAV: Loaded 42562 existing records from primary storage. [2025-09-28T02:31:32.576761] [INFO ] [MAIN ] WEAV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:32.579373] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 1.0s. Estimated remaining: 1m 8s. Rate: 78.6 symbols/min [2025-09-28T02:31:32.580555] [DEBUG] [LOCAL ] WDS: Loaded 44259 existing records from primary storage. [2025-09-28T02:31:32.593377] [INFO ] [MAIN ] WDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:32.619926] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WDS took 1.1s. Estimated remaining: 1m 7s. Rate: 78.6 symbols/min [2025-09-28T02:31:32.676095] [DEBUG] [LOCAL ] WEC: Loaded 52958 existing records from primary storage. [2025-09-28T02:31:32.726194] [INFO ] [MAIN ] WEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:32.785554] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WEC took 1.2s. Estimated remaining: 1m 6s. Rate: 78.6 symbols/min [2025-09-28T02:31:32.979708] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:33.104634] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:33.188482] [DEBUG] [LOCAL ] WELL: Loaded 53132 existing records from primary storage. [2025-09-28T02:31:33.200210] [INFO ] [MAIN ] WELL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:33.201973] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WELL took 0.9s. Estimated remaining: 1m 6s. Rate: 78.7 symbols/min [2025-09-28T02:31:33.222461] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:33.370548] [DEBUG] [LOCAL ] WF: Loaded 10903 existing records from primary storage. [2025-09-28T02:31:33.401709] [INFO ] [MAIN ] WF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:33.442473] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WF took 0.6s. Estimated remaining: 1m 5s. Rate: 78.7 symbols/min [2025-09-28T02:31:33.424148] [DEBUG] [LOCAL ] WEX: Loaded 35697 existing records from primary storage. [2025-09-28T02:31:33.502520] [INFO ] [MAIN ] WEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:33.546551] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:33.547411] [DEBUG] [LOCAL ] WES: Loaded 48689 existing records from primary storage. [2025-09-28T02:31:33.562409] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WEX took 0.9s. Estimated remaining: 1m 4s. Rate: 78.7 symbols/min [2025-09-28T02:31:33.625698] [INFO ] [MAIN ] WES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:33.663318] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WES took 1.1s. Estimated remaining: 1m 3s. Rate: 78.7 symbols/min [2025-09-28T02:31:33.940793] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:34.084008] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:34.168083] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:34.192187] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-09-28T02:31:34.193823] [INFO ] [MAIN ] WFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:34.194009] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFC took 1.0s. Estimated remaining: 1m 2s. Rate: 78.8 symbols/min [2025-09-28T02:31:34.285010] [DEBUG] [LOCAL ] WFG: Loaded 25211 existing records from primary storage. [2025-09-28T02:31:34.331321] [INFO ] [MAIN ] WFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:34.331861] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFG took 0.9s. Estimated remaining: 1m 2s. Rate: 78.8 symbols/min [2025-09-28T02:31:34.504734] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:34.557134] [DEBUG] [LOCAL ] WGO: Loaded 39823 existing records from primary storage. [2025-09-28T02:31:34.584199] [INFO ] [MAIN ] WGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:34.617764] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WGO took 1.0s. Estimated remaining: 1m 1s. Rate: 78.8 symbols/min [2025-09-28T02:31:34.618059] [DEBUG] [LOCAL ] WH: Loaded 46339 existing records from primary storage. [2025-09-28T02:31:34.665791] [INFO ] [MAIN ] WH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:34.713163] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WH took 1.0s. Estimated remaining: 1m 0s. Rate: 78.8 symbols/min [2025-09-28T02:31:34.707397] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:34.980932] [DEBUG] [LOCAL ] WHG: Loaded 3416 existing records from primary storage. [2025-09-28T02:31:35.038195] [DEBUG] [LOCAL ] WHD: Loaded 41130 existing records from primary storage. [2025-09-28T02:31:35.097195] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:35.071333] [INFO ] [MAIN ] WHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:35.107376] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WHG took 0.8s. Estimated remaining: 59.4s. Rate: 78.9 symbols/min [2025-09-28T02:31:35.107564] [INFO ] [MAIN ] WHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:35.138985] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WHD took 0.9s. Estimated remaining: 58.6s. Rate: 78.9 symbols/min [2025-09-28T02:31:35.133363] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:35.364770] [DEBUG] [LOCAL ] WIA: Loaded 4937 existing records from primary storage. [2025-09-28T02:31:35.386534] [INFO ] [MAIN ] WIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:35.458719] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WIA took 0.7s. Estimated remaining: 57.8s. Rate: 78.9 symbols/min [2025-09-28T02:31:35.606207] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:35.745324] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:35.774492] [DEBUG] [LOCAL ] WHR: Loaded 48846 existing records from primary storage. [2025-09-28T02:31:35.796321] [INFO ] [MAIN ] WHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:35.818850] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WHR took 1.2s. Estimated remaining: 57.0s. Rate: 78.9 symbols/min [2025-09-28T02:31:36.000117] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:35.971918] [DEBUG] [LOCAL ] WINN: Loaded 11944 existing records from primary storage. [2025-09-28T02:31:36.020175] [INFO ] [MAIN ] WINN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:36.020692] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WINN took 0.9s. Estimated remaining: 56.2s. Rate: 78.9 symbols/min [2025-09-28T02:31:36.308610] [DEBUG] [LOCAL ] WIW: Loaded 20756 existing records from primary storage. [2025-09-28T02:31:36.323189] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:36.316227] [DEBUG] [LOCAL ] WIT: Loaded 53070 existing records from primary storage. [2025-09-28T02:31:36.328765] [INFO ] [MAIN ] WIW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:36.363988] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIW took 0.8s. Estimated remaining: 55.5s. Rate: 79.0 symbols/min [2025-09-28T02:31:36.373010] [INFO ] [MAIN ] WIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:36.395907] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIT took 1.3s. Estimated remaining: 54.7s. Rate: 79.0 symbols/min [2025-09-28T02:31:36.444555] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:36.806598] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:36.847573] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:36.824919] [DEBUG] [LOCAL ] WK: Loaded 37342 existing records from primary storage. [2025-09-28T02:31:36.848437] [INFO ] [MAIN ] WK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:36.849401] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 1.0s. Estimated remaining: 53.9s. Rate: 79.0 symbols/min [2025-09-28T02:31:36.955077] [DEBUG] [LOCAL ] WLKP: Loaded 6800 existing records from primary storage. [2025-09-28T02:31:36.966520] [DEBUG] [LOCAL ] WKC: Loaded 35538 existing records from primary storage. [2025-09-28T02:31:36.983466] [INFO ] [MAIN ] WLKP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:37.003362] [INFO ] [MAIN ] WKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:37.003715] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 1.0s. Estimated remaining: 53.1s. Rate: 79.0 symbols/min [2025-09-28T02:31:37.026200] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLKP took 0.6s. Estimated remaining: 52.4s. Rate: 79.1 symbols/min [2025-09-28T02:31:37.225697] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:37.276863] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-28T02:31:37.314381] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-28T02:31:37.325206] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-28T02:31:37.379218] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-28T02:31:37.443673] [DEBUG] [LOCAL ] WLK: Loaded 46113 existing records from primary storage. [2025-09-28T02:31:37.443926] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-28T02:31:37.461810] [INFO ] [MAIN ] WLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:37.461954] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-28T02:31:37.476250] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLK took 1.1s. Estimated remaining: 51.6s. Rate: 79.1 symbols/min [2025-09-28T02:31:37.531159] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:37.577393] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:37.896527] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:38.097006] [DEBUG] [LOCAL ] WLY: Loaded 30414 existing records from primary storage. [2025-09-28T02:31:38.120236] [INFO ] [MAIN ] WLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:38.150098] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLY took 1.1s. Estimated remaining: 50.8s. Rate: 79.1 symbols/min [2025-09-28T02:31:38.204503] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:38.205916] [DEBUG] [LOCAL ] WM: Loaded 51697 existing records from primary storage. [2025-09-28T02:31:38.218278] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-28T02:31:38.271345] [INFO ] [MAIN ] WM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:38.319619] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WM took 1.3s. Estimated remaining: 50.1s. Rate: 79.1 symbols/min [2025-09-28T02:31:38.517598] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:38.547720] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-09-28T02:31:38.573922] [INFO ] [MAIN ] WMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:38.584451] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WMB took 1.1s. Estimated remaining: 49.3s. Rate: 79.1 symbols/min [2025-09-28T02:31:38.735696] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-28T02:31:38.775771] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:38.777933] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-28T02:31:38.776420] [DEBUG] [LOCAL ] WMK: Loaded 14753 existing records from primary storage. [2025-09-28T02:31:38.824899] [INFO ] [MAIN ] WMK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:38.826095] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WMK took 0.6s. Estimated remaining: 48.5s. Rate: 79.2 symbols/min [2025-09-28T02:31:39.018409] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:39.176417] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:39.193883] [DEBUG] [LOCAL ] WMS: Loaded 40249 existing records from primary storage. [2025-09-28T02:31:39.194534] [INFO ] [MAIN ] WMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:39.195164] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WMS took 0.9s. Estimated remaining: 47.7s. Rate: 79.2 symbols/min [2025-09-28T02:31:39.270491] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-28T02:31:39.304145] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-28T02:31:39.444221] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:39.447424] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-09-28T02:31:39.447926] [INFO ] [MAIN ] WMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:39.448037] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMT took 0.8s. Estimated remaining: 47.0s. Rate: 79.2 symbols/min [2025-09-28T02:31:39.567797] [DEBUG] [LOCAL ] WNC: Loaded 40452 existing records from primary storage. [2025-09-28T02:31:39.587231] [INFO ] [MAIN ] WNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:39.619051] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNC took 0.8s. Estimated remaining: 46.2s. Rate: 79.2 symbols/min [2025-09-28T02:31:39.671338] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:39.749327] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-28T02:31:39.766256] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-28T02:31:39.767605] [DEBUG] [LOCAL ] WNS: Loaded 40539 existing records from primary storage. [2025-09-28T02:31:39.810836] [INFO ] [MAIN ] WNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:39.833678] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNS took 0.6s. Estimated remaining: 45.4s. Rate: 79.3 symbols/min [2025-09-28T02:31:39.891472] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:40.115770] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:40.142354] [DEBUG] [LOCAL ] WOLF: Loaded 54312 existing records from primary storage. [2025-09-28T02:31:40.141014] [DEBUG] [LOCAL ] WOR: Loaded 25288 existing records from primary storage. [2025-09-28T02:31:40.142945] [INFO ] [MAIN ] WOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:40.143044] [INFO ] [MAIN ] WOLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:40.144108] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WOLF took 0.7s. Estimated remaining: 44.7s. Rate: 79.3 symbols/min [2025-09-28T02:31:40.144402] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOR took 0.5s. Estimated remaining: 43.9s. Rate: 79.3 symbols/min [2025-09-28T02:31:40.390976] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-28T02:31:40.535782] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:40.474698] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-28T02:31:40.574037] [DEBUG] [LOCAL ] WOW: Loaded 30769 existing records from primary storage. [2025-09-28T02:31:40.572453] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:40.575838] [INFO ] [MAIN ] WOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:40.576474] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOW took 0.7s. Estimated remaining: 43.1s. Rate: 79.3 symbols/min [2025-09-28T02:31:40.783718] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:40.846994] [DEBUG] [LOCAL ] WPM: Loaded 53504 existing records from primary storage. [2025-09-28T02:31:40.847743] [INFO ] [MAIN ] WPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:40.847908] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WPM took 0.7s. Estimated remaining: 42.3s. Rate: 79.3 symbols/min [2025-09-28T02:31:40.884442] [DEBUG] [LOCAL ] WPC: Loaded 49217 existing records from primary storage. [2025-09-28T02:31:40.945921] [INFO ] [MAIN ] WPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:40.979738] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPC took 0.8s. Estimated remaining: 41.6s. Rate: 79.4 symbols/min [2025-09-28T02:31:41.123053] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:41.141608] [DEBUG] [LOCAL ] WPP: Loaded 34282 existing records from primary storage. [2025-09-28T02:31:41.123276] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-28T02:31:41.174962] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-28T02:31:41.181179] [INFO ] [MAIN ] WPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:41.204145] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPP took 0.6s. Estimated remaining: 40.8s. Rate: 79.4 symbols/min [2025-09-28T02:31:41.286074] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:41.333830] [DEBUG] [LOCAL ] WRB: Loaded 51313 existing records from primary storage. [2025-09-28T02:31:41.334348] [INFO ] [MAIN ] WRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:41.334938] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WRB took 0.5s. Estimated remaining: 40.0s. Rate: 79.4 symbols/min [2025-09-28T02:31:41.375088] [DEBUG] [LOCAL ] WRBY: Loaded 51609 existing records from primary storage. [2025-09-28T02:31:41.375519] [INFO ] [MAIN ] WRBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:41.376360] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRBY took 0.4s. Estimated remaining: 39.3s. Rate: 79.5 symbols/min [2025-09-28T02:31:41.656765] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-28T02:31:41.657936] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-28T02:31:41.968573] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-28T02:31:41.969950] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-28T02:31:42.331423] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-28T02:31:42.332723] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-28T02:31:42.619110] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-28T02:31:42.620339] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-28T02:31:42.984749] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-28T02:31:42.986061] [INFO ] [REMOTE ] WLTG: Full fetch complete (1661 records). [2025-09-28T02:31:42.986177] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-28T02:31:43.226425] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:31:43.226700] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:31:43.226779] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:31:43.226872] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-28T02:31:43.227013] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-28T02:31:43.227120] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-28T02:31:43.227221] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-28T02:31:43.227349] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WLTG took 6.4s. Estimated remaining: 38.5s. Rate: 79.4 symbols/min [2025-09-28T02:31:43.878422] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:43.948681] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:44.050123] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:44.049116] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:44.092995] [DEBUG] [LOCAL ] WS: Loaded 24434 existing records from primary storage. [2025-09-28T02:31:44.102111] [DEBUG] [LOCAL ] WSR: Loaded 23550 existing records from primary storage. [2025-09-28T02:31:44.102795] [INFO ] [MAIN ] WSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:44.102914] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WSR took 0.8s. Estimated remaining: 37.8s. Rate: 79.4 symbols/min [2025-09-28T02:31:44.102393] [INFO ] [MAIN ] WS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:44.142927] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WS took 0.9s. Estimated remaining: 37.0s. Rate: 79.4 symbols/min [2025-09-28T02:31:44.210906] [DEBUG] [LOCAL ] WSO: Loaded 25059 existing records from primary storage. [2025-09-28T02:31:44.239787] [INFO ] [MAIN ] WSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:44.285471] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WSO took 1.1s. Estimated remaining: 36.2s. Rate: 79.5 symbols/min [2025-09-28T02:31:44.373009] [DEBUG] [LOCAL ] WSM: Loaded 50533 existing records from primary storage. [2025-09-28T02:31:44.541751] [INFO ] [MAIN ] WSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:44.564310] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSM took 1.3s. Estimated remaining: 35.5s. Rate: 79.5 symbols/min [2025-09-28T02:31:44.597721] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:44.793145] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:44.853227] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:44.966774] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:44.978520] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-28T02:31:44.978624] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-28T02:31:44.978841] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-28T02:31:44.978992] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-28T02:31:44.979820] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-28T02:31:44.980022] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-28T02:31:44.979574] [DEBUG] [LOCAL ] WST: Loaded 38092 existing records from primary storage. [2025-09-28T02:31:45.012811] [INFO ] [MAIN ] WST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:45.040750] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 0.9s. Estimated remaining: 34.7s. Rate: 79.5 symbols/min [2025-09-28T02:31:45.381923] [DEBUG] [LOCAL ] WT: Loaded 48354 existing records from primary storage. [2025-09-28T02:31:45.387941] [DEBUG] [LOCAL ] WTI: Loaded 44472 existing records from primary storage. [2025-09-28T02:31:45.399305] [INFO ] [MAIN ] WT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:45.488204] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WT took 1.3s. Estimated remaining: 34.0s. Rate: 79.5 symbols/min [2025-09-28T02:31:45.533939] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:45.488076] [INFO ] [MAIN ] WTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:45.583685] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WTI took 1.3s. Estimated remaining: 33.2s. Rate: 79.5 symbols/min [2025-09-28T02:31:45.728515] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:45.796358] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-28T02:31:45.973929] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:46.014800] [DEBUG] [LOCAL ] WTS: No existing data file found in primary storage. [2025-09-28T02:31:46.047148] [WARN ] [MAIN ] WTS: No existing data found, performing full refresh instead. [2025-09-28T02:31:46.067739] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-28T02:31:46.066510] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:46.068064] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-28T02:31:46.081251] [DEBUG] [LOCAL ] WTS: No primary data file found to delete. [2025-09-28T02:31:46.082608] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-28T02:31:46.083733] [DEBUG] [LOCAL ] WTRG: Loaded 51656 existing records from primary storage. [2025-09-28T02:31:46.126890] [INFO ] [MAIN ] WTRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:46.159962] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WTRG took 1.1s. Estimated remaining: 32.4s. Rate: 79.6 symbols/min [2025-09-28T02:31:46.395759] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-28T02:31:46.469889] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-28T02:31:46.611751] [DEBUG] [LOCAL ] WTTR: Loaded 45735 existing records from primary storage. [2025-09-28T02:31:46.600354] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:46.657816] [INFO ] [MAIN ] WTTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:46.699045] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTTR took 1.0s. Estimated remaining: 31.7s. Rate: 79.6 symbols/min [2025-09-28T02:31:46.746177] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:46.763546] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-28T02:31:47.070505] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:47.073061] [DEBUG] [LOCAL ] WU: Loaded 54232 existing records from primary storage. [2025-09-28T02:31:47.073886] [INFO ] [MAIN ] WU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:47.074023] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WU took 0.9s. Estimated remaining: 30.9s. Rate: 79.6 symbols/min [2025-09-28T02:31:47.146000] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-28T02:31:47.171514] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-28T02:31:47.294523] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:47.329060] [DEBUG] [LOCAL ] WWW: Loaded 49906 existing records from primary storage. [2025-09-28T02:31:47.329512] [INFO ] [MAIN ] WWW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:47.330211] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WWW took 0.6s. Estimated remaining: 30.1s. Rate: 79.6 symbols/min [2025-09-28T02:31:47.552574] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:47.555821] [DEBUG] [LOCAL ] WY: Loaded 53899 existing records from primary storage. [2025-09-28T02:31:47.556278] [INFO ] [MAIN ] WY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:47.557045] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WY took 0.5s. Estimated remaining: 29.4s. Rate: 79.6 symbols/min [2025-09-28T02:31:47.689155] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-28T02:31:47.707533] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-28T02:31:47.775595] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:47.788236] [DEBUG] [LOCAL ] XFLT: Loaded 30306 existing records from primary storage. [2025-09-28T02:31:47.788735] [INFO ] [MAIN ] XFLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:47.789251] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. XFLT took 0.5s. Estimated remaining: 28.6s. Rate: 79.7 symbols/min [2025-09-28T02:31:47.922107] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-28T02:31:47.958721] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-28T02:31:48.046360] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:48.048176] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-28T02:31:48.048017] [DEBUG] [LOCAL ] XHR: Loaded 44680 existing records from primary storage. [2025-09-28T02:31:48.048353] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-28T02:31:48.048813] [INFO ] [MAIN ] XHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:48.049131] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XHR took 0.5s. Estimated remaining: 27.9s. Rate: 79.7 symbols/min [2025-09-28T02:31:48.049009] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-28T02:31:48.049552] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-28T02:31:48.110594] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-28T02:31:48.134986] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-28T02:31:48.342480] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-28T02:31:48.366982] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:48.369857] [DEBUG] [LOCAL ] XOM: No existing data file found in primary storage. [2025-09-28T02:31:48.369243] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-28T02:31:48.392579] [WARN ] [MAIN ] XOM: No existing data found, performing full refresh instead. [2025-09-28T02:31:48.491685] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-28T02:31:48.531034] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-28T02:31:48.542465] [DEBUG] [LOCAL ] XOM: No primary data file found to delete. [2025-09-28T02:31:48.554185] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-28T02:31:48.857376] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:48.857982] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-28T02:31:49.057338] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-28T02:31:49.084984] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:49.088154] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-28T02:31:49.088829] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-28T02:31:49.087218] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-28T02:31:49.093013] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-28T02:31:49.141929] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:31:49.142325] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-28T02:31:49.142419] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:31:49.142495] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-09-28T02:31:49.142564] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:31:49.142697] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-28T02:31:49.142801] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-28T02:31:49.142877] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-28T02:31:49.143067] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-28T02:31:49.143161] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. XIFR took 1.4s. Estimated remaining: 27.1s. Rate: 79.7 symbols/min [2025-09-28T02:31:49.336861] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:49.371756] [DEBUG] [LOCAL ] XPER: Loaded 30181 existing records from primary storage. [2025-09-28T02:31:49.372131] [INFO ] [MAIN ] XPER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:49.372738] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. XPER took 0.2s. Estimated remaining: 26.4s. Rate: 79.7 symbols/min [2025-09-28T02:31:49.570604] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:49.617575] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-28T02:31:49.618865] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-28T02:31:49.642216] [DEBUG] [LOCAL ] XPEV: Loaded 54419 existing records from primary storage. [2025-09-28T02:31:49.642727] [INFO ] [MAIN ] XPEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:49.642874] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XPEV took 0.3s. Estimated remaining: 25.6s. Rate: 79.7 symbols/min [2025-09-28T02:31:49.832489] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:49.881773] [DEBUG] [LOCAL ] XPO: Loaded 48656 existing records from primary storage. [2025-09-28T02:31:49.882181] [INFO ] [MAIN ] XPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:49.882791] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XPO took 0.2s. Estimated remaining: 24.8s. Rate: 79.7 symbols/min [2025-09-28T02:31:50.072909] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:50.098996] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-28T02:31:50.104174] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-28T02:31:50.135824] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-28T02:31:50.136706] [DEBUG] [LOCAL ] XPOF: Loaded 39243 existing records from primary storage. [2025-09-28T02:31:50.138293] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-28T02:31:50.139446] [INFO ] [MAIN ] XPOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:50.140026] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XPOF took 0.3s. Estimated remaining: 24.1s. Rate: 79.7 symbols/min [2025-09-28T02:31:50.322997] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:50.370993] [DEBUG] [LOCAL ] XPRO: Loaded 46617 existing records from primary storage. [2025-09-28T02:31:50.371351] [INFO ] [MAIN ] XPRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:50.371909] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPRO took 0.2s. Estimated remaining: 23.3s. Rate: 79.8 symbols/min [2025-09-28T02:31:50.553745] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:50.586360] [DEBUG] [LOCAL ] XYF: Loaded 28464 existing records from primary storage. [2025-09-28T02:31:50.586746] [INFO ] [MAIN ] XYF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:50.587237] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XYF took 0.2s. Estimated remaining: 22.6s. Rate: 79.8 symbols/min [2025-09-28T02:31:50.699007] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-28T02:31:50.722132] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-28T02:31:50.776424] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:50.776684] [DEBUG] [LOCAL ] XYL: No existing data file found in primary storage. [2025-09-28T02:31:50.776762] [WARN ] [MAIN ] XYL: No existing data found, performing full refresh instead. [2025-09-28T02:31:50.776877] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-28T02:31:50.776959] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-28T02:31:50.777042] [DEBUG] [LOCAL ] XYL: No primary data file found to delete. [2025-09-28T02:31:50.777114] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-28T02:31:51.182531] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:51.183088] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-28T02:31:51.263113] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-28T02:31:51.265790] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-28T02:31:51.283056] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-28T02:31:51.290853] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-28T02:31:51.524725] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-28T02:31:51.536733] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-28T02:31:51.900233] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-28T02:31:51.901732] [INFO ] [REMOTE ] WTM: Full fetch complete (2277 records). [2025-09-28T02:31:51.901831] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-28T02:31:52.093222] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:31:52.093452] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:31:52.093527] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:31:52.093607] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-28T02:31:52.093728] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-28T02:31:52.093803] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-28T02:31:52.093925] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-28T02:31:52.094034] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. WTM took 7.5s. Estimated remaining: 21.8s. Rate: 79.8 symbols/min [2025-09-28T02:31:52.286965] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:52.287306] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-28T02:31:52.287385] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-28T02:31:52.287516] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-28T02:31:52.287592] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-28T02:31:52.287711] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-28T02:31:52.287784] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-28T02:31:52.653329] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-28T02:31:52.693417] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-28T02:31:52.740981] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:31:52.742073] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-28T02:31:52.898778] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-28T02:31:52.909202] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-28T02:31:52.991700] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:31:52.992058] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-28T02:31:52.992149] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:31:52.992229] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-09-28T02:31:52.992301] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:31:52.992379] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-28T02:31:52.992475] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-28T02:31:52.992545] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-28T02:31:52.992678] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-28T02:31:52.992766] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYZ took 0.9s. Estimated remaining: 21.1s. Rate: 79.8 symbols/min [2025-09-28T02:31:53.188512] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:53.224932] [DEBUG] [LOCAL ] YALA: Loaded 37892 existing records from primary storage. [2025-09-28T02:31:53.225295] [INFO ] [MAIN ] YALA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:53.225807] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. YALA took 0.2s. Estimated remaining: 20.3s. Rate: 79.8 symbols/min [2025-09-28T02:31:53.413787] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:53.461452] [DEBUG] [LOCAL ] YELP: Loaded 45909 existing records from primary storage. [2025-09-28T02:31:53.461966] [INFO ] [MAIN ] YELP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:53.462530] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. YELP took 0.2s. Estimated remaining: 19.5s. Rate: 79.8 symbols/min [2025-09-28T02:31:53.663660] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:53.724827] [DEBUG] [LOCAL ] YETI: Loaded 53216 existing records from primary storage. [2025-09-28T02:31:53.725265] [INFO ] [MAIN ] YETI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:53.725762] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. YETI took 0.3s. Estimated remaining: 18.8s. Rate: 79.8 symbols/min [2025-09-28T02:31:53.911608] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:53.927140] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-28T02:31:53.933154] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-28T02:31:53.975522] [DEBUG] [LOCAL ] YEXT: Loaded 43863 existing records from primary storage. [2025-09-28T02:31:53.975945] [INFO ] [MAIN ] YEXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:53.976439] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YEXT took 0.3s. Estimated remaining: 18.0s. Rate: 79.8 symbols/min [2025-09-28T02:31:54.166245] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:54.200730] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-09-28T02:31:54.212235] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-28T02:31:54.265381] [DEBUG] [LOCAL ] YMM: Loaded 53425 existing records from primary storage. [2025-09-28T02:31:54.265835] [INFO ] [MAIN ] YMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:54.266387] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. YMM took 0.3s. Estimated remaining: 17.3s. Rate: 79.9 symbols/min [2025-09-28T02:31:54.451740] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:54.505450] [DEBUG] [LOCAL ] YOU: Loaded 50504 existing records from primary storage. [2025-09-28T02:31:54.505884] [INFO ] [MAIN ] YOU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:54.506474] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YOU took 0.2s. Estimated remaining: 16.5s. Rate: 79.9 symbols/min [2025-09-28T02:31:54.695490] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:54.727154] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-28T02:31:54.737889] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-28T02:31:54.784834] [DEBUG] [LOCAL ] YPF: Loaded 51252 existing records from primary storage. [2025-09-28T02:31:54.785248] [INFO ] [MAIN ] YPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:54.785988] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YPF took 0.3s. Estimated remaining: 15.8s. Rate: 79.9 symbols/min [2025-09-28T02:31:54.973017] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:54.988767] [DEBUG] [LOCAL ] YRD: Loaded 12726 existing records from primary storage. [2025-09-28T02:31:54.989100] [INFO ] [MAIN ] YRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:54.989219] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YRD took 0.2s. Estimated remaining: 15.0s. Rate: 79.9 symbols/min [2025-09-28T02:31:55.123767] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-28T02:31:55.173192] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-28T02:31:55.202144] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:55.230250] [DEBUG] [LOCAL ] YSG: Loaded 25485 existing records from primary storage. [2025-09-28T02:31:55.230592] [INFO ] [MAIN ] YSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:55.230720] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YSG took 0.2s. Estimated remaining: 14.3s. Rate: 80.0 symbols/min [2025-09-28T02:31:55.413847] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:55.472064] [DEBUG] [LOCAL ] YUM: Loaded 51931 existing records from primary storage. [2025-09-28T02:31:55.472476] [INFO ] [MAIN ] YUM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:55.473064] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YUM took 0.2s. Estimated remaining: 13.5s. Rate: 80.0 symbols/min [2025-09-28T02:31:55.665888] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:55.722033] [DEBUG] [LOCAL ] YUMC: Loaded 53455 existing records from primary storage. [2025-09-28T02:31:55.722421] [INFO ] [MAIN ] YUMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:55.722983] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YUMC took 0.2s. Estimated remaining: 12.7s. Rate: 80.0 symbols/min [2025-09-28T02:31:55.903311] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:55.961090] [DEBUG] [LOCAL ] ZBH: Loaded 51948 existing records from primary storage. [2025-09-28T02:31:55.961542] [INFO ] [MAIN ] ZBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:55.962141] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. ZBH took 0.2s. Estimated remaining: 12.0s. Rate: 80.0 symbols/min [2025-09-28T02:31:56.156033] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:56.183899] [DEBUG] [LOCAL ] ZEPP: Loaded 17335 existing records from primary storage. [2025-09-28T02:31:56.184404] [INFO ] [MAIN ] ZEPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:56.184578] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. ZEPP took 0.2s. Estimated remaining: 11.2s. Rate: 80.1 symbols/min [2025-09-28T02:31:56.406904] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:31:56.409728] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-28T02:31:56.417576] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-28T02:31:56.453915] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-28T02:31:56.466436] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-28T02:31:56.498270] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-28T02:31:56.509310] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-28T02:31:56.555535] [DEBUG] [LOCAL ] ZETA: Loaded 54375 existing records from primary storage. [2025-09-28T02:31:56.556097] [INFO ] [MAIN ] ZETA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:31:56.556745] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. ZETA took 0.4s. Estimated remaining: 10.5s. Rate: 80.1 symbols/min [2025-09-28T02:31:57.580542] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-28T02:31:57.585609] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-28T02:31:58.469765] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-28T02:31:58.481995] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-28T02:31:58.492106] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-28T02:31:58.497209] [INFO ] [REMOTE ] WTS: Full fetch complete (26267 records). [2025-09-28T02:31:58.497436] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-28T02:31:58.949862] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-28T02:31:58.950125] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-28T02:31:58.950670] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-28T02:31:58.950768] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-28T02:31:58.952064] [DEBUG] [LOCAL ] WTS: Trimmed 26267 records to 18597 (keeping 200 days of data) [2025-09-28T02:31:59.071887] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-28T02:31:59.097982] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-28T02:31:59.121032] [DEBUG] [LOCAL ] WTS: Primary data saved (18597 records). [2025-09-28T02:31:59.121229] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-28T02:31:59.121362] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. WTS took 13.6s. Estimated remaining: 9.8s. Rate: 80.0 symbols/min [2025-09-28T02:32:00.411131] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-28T02:32:00.422846] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-28T02:32:01.956376] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-28T02:32:01.968586] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-28T02:32:02.413822] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-28T02:32:02.428049] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-28T02:32:04.266408] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-28T02:32:04.276946] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-28T02:32:04.373785] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-28T02:32:04.385945] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-28T02:32:05.964991] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-28T02:32:05.976225] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-28T02:32:06.362017] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-28T02:32:06.373611] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-28T02:32:07.744950] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-28T02:32:07.755315] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-28T02:32:08.967250] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-28T02:32:08.985789] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-28T02:32:09.457084] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-28T02:32:09.472280] [INFO ] [REMOTE ] XYL: Full fetch complete (69881 records). [2025-09-28T02:32:09.472543] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-28T02:32:09.992289] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-28T02:32:09.992593] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-28T02:32:09.993735] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-28T02:32:09.993840] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-28T02:32:09.998602] [DEBUG] [LOCAL ] XYL: Trimmed 69881 records to 48777 (keeping 200 days of data) [2025-09-28T02:32:10.320486] [DEBUG] [LOCAL ] XYL: Primary data saved (48777 records). [2025-09-28T02:32:10.320704] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-28T02:32:10.320954] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. XYL took 19.7s. Estimated remaining: 9.1s. Rate: 79.5 symbols/min [2025-09-28T02:32:11.523185] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-09-28T02:32:11.535023] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-28T02:32:13.847799] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-28T02:32:13.858769] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-09-28T02:32:13.859037] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-28T02:32:14.292826] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-28T02:32:14.292959] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-28T02:32:14.293881] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-28T02:32:14.294006] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-28T02:32:14.295761] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 54573 (keeping 200 days of data) [2025-09-28T02:32:14.688607] [DEBUG] [LOCAL ] XOM: Primary data saved (54573 records). [2025-09-28T02:32:14.689117] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-28T02:32:14.689429] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. XOM took 26.6s. Estimated remaining: 8.3s. Rate: 79.4 symbols/min [2025-09-28T02:32:15.384939] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:15.435051] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:15.443210] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:15.546570] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:15.602229] [DEBUG] [LOCAL ] ZH: Loaded 27298 existing records from primary storage. [2025-09-28T02:32:15.602603] [INFO ] [MAIN ] ZH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:15.602968] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 0.9s. Estimated remaining: 7.6s. Rate: 79.4 symbols/min [2025-09-28T02:32:15.812770] [DEBUG] [LOCAL ] ZGN: Loaded 41333 existing records from primary storage. [2025-09-28T02:32:15.849770] [INFO ] [MAIN ] ZGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:15.895083] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZGN took 1.2s. Estimated remaining: 6.8s. Rate: 79.4 symbols/min [2025-09-28T02:32:15.900009] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:15.925683] [DEBUG] [LOCAL ] ZIP: Loaded 44952 existing records from primary storage. [2025-09-28T02:32:15.932944] [DEBUG] [LOCAL ] ZIM: Loaded 54298 existing records from primary storage. [2025-09-28T02:32:15.966543] [INFO ] [MAIN ] ZIP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:15.979072] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZIP took 1.3s. Estimated remaining: 6.0s. Rate: 79.4 symbols/min [2025-09-28T02:32:15.978007] [INFO ] [MAIN ] ZIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:15.998081] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 1.3s. Estimated remaining: 5.3s. Rate: 79.4 symbols/min [2025-09-28T02:32:16.391181] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:16.486099] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:16.549713] [DEBUG] [LOCAL ] ZK: Loaded 40504 existing records from primary storage. [2025-09-28T02:32:16.554080] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:16.555013] [INFO ] [MAIN ] ZK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:16.555430] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZK took 1.0s. Estimated remaining: 4.5s. Rate: 79.4 symbols/min [2025-09-28T02:32:16.627412] [DEBUG] [LOCAL ] ZKH: Loaded 8119 existing records from primary storage. [2025-09-28T02:32:16.675074] [INFO ] [MAIN ] ZKH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:16.721407] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZKH took 0.8s. Estimated remaining: 3.8s. Rate: 79.5 symbols/min [2025-09-28T02:32:16.741805] [DEBUG] [LOCAL ] ZTR: Loaded 16911 existing records from primary storage. [2025-09-28T02:32:16.819673] [INFO ] [MAIN ] ZTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:16.894518] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTR took 0.9s. Estimated remaining: 3.0s. Rate: 79.5 symbols/min [2025-09-28T02:32:16.925825] [DEBUG] [LOCAL ] ZTO: Loaded 50751 existing records from primary storage. [2025-09-28T02:32:16.992381] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:17.002044] [INFO ] [MAIN ] ZTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:17.041484] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTO took 1.0s. Estimated remaining: 2.3s. Rate: 79.5 symbols/min [2025-09-28T02:32:17.174212] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:17.256903] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:32:17.316208] [DEBUG] [LOCAL ] ZTS: Loaded 53775 existing records from primary storage. [2025-09-28T02:32:17.316851] [INFO ] [MAIN ] ZTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:17.316972] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZTS took 0.8s. Estimated remaining: 1.5s. Rate: 79.5 symbols/min [2025-09-28T02:32:17.340804] [DEBUG] [LOCAL ] ZVIA: Loaded 35966 existing records from primary storage. [2025-09-28T02:32:17.341320] [INFO ] [MAIN ] ZVIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:17.341896] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZVIA took 0.6s. Estimated remaining: 0.8s. Rate: 79.6 symbols/min [2025-09-28T02:32:17.359182] [DEBUG] [LOCAL ] ZWS: Loaded 43134 existing records from primary storage. [2025-09-28T02:32:17.359556] [INFO ] [MAIN ] ZWS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:32:17.360254] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZWS took 0.4s. Estimated remaining: 0.0s. Rate: 79.6 symbols/min [2025-09-28T02:32:17.361800] [INFO ] [MAIN ] Parallel update completed in 29m 47s [2025-09-28T02:32:17.362077] [WARN ] [MAIN ] Failed symbols (160): AAMI, AAUC, AAM, AD, AEXA, AHL, AII, AKA, AMBQ, AMRZ... [2025-09-28T02:32:17.362163] [INFO ] [MAIN ] Update success rate: 93.3% (2211/2371 symbols) [2025-09-28T02:32:17.946738] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2211/2371 @ 93.25%)' [2025-09-28T02:32:17.947920] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-28T02:32:17.948319] [INFO ] [STATE ] Last completion updated: 2025-09-28T02:32:17.948003 [2025-09-28T02:32:17.948604] [WARN ] [STATE ] State set to: RUNNING [2025-09-28T02:32:17.948722] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-09-28T02:32:17.948804] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T02:32:17.948971] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T02:32:17.949043] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T02:32:19.681369] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T02:32:19.681557] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T02:32:19.681883] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T02:32:19.682563] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T02:32:19.682667] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T02:32:19.682762] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T02:32:19.682922] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-28T02:32:19.682998] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T02:32:19.683076] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T02:32:19.683513] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T02:32:19.683588] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T02:32:19.683838] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T02:32:19.683919] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T02:32:19.684001] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T02:32:19.684084] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T02:32:19.712728] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T02:32:19.713251] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T02:32:19.713329] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T02:32:19.713412] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T02:32:19.713491] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T02:32:19.713602] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-28T02:32:19.713720] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-28T02:32:19.713809] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-28T02:32:19.713928] [INFO ] [LOCAL ] Deleted 0 derivative data files. [2025-09-28T02:32:19.714764] [FATAL] [MAIN ] Exception during derivative generation: No module named 'BlacklistTracker' [2025-09-28T02:32:19.715070] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-09-28T02:32:19.715260] [INFO ] [STATE ] Last completion updated: 2025-09-28T02:32:19.715151 [2025-09-28T02:46:08.422610] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-28T02:46:08.422830] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T02:46:08.422948] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T02:46:08.423044] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T02:46:09.883893] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T02:46:09.884080] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T02:46:09.884321] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T02:46:09.884989] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T02:46:09.885070] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T02:46:09.885146] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T02:46:09.885253] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T02:46:09.885353] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T02:46:09.885787] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T02:46:09.885866] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T02:46:09.886071] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T02:46:09.886148] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T02:46:09.886226] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T02:46:09.886302] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T02:46:09.914107] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T02:46:09.914404] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T02:46:09.914484] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T02:46:09.914555] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T02:46:09.914624] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T02:46:09.914908] [WARN ] [STATE ] State set to: RUNNING [2025-09-28T02:46:09.914988] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-09-28T02:46:09.915059] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T02:46:09.915210] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T02:46:09.915285] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T02:46:11.411083] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T02:46:11.411287] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T02:46:11.411525] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T02:46:11.412097] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T02:46:11.412178] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T02:46:11.412249] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T02:46:11.412361] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-28T02:46:11.412465] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T02:46:11.412540] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T02:46:11.412990] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T02:46:11.413052] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T02:46:11.413246] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T02:46:11.413320] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T02:46:11.413392] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T02:46:11.413466] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T02:46:11.441883] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T02:46:11.442226] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T02:46:11.442308] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T02:46:11.442388] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T02:46:11.442462] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T02:46:11.442567] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T02:46:11.442999] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T02:46:11.443074] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T02:46:11.443150] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-28T02:46:11.443222] [INFO ] [MAIN ] Running in parallel mode [2025-09-28T02:46:11.443411] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-28T02:46:12.133030] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:12.112533] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:12.182801] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-28T02:46:12.239632] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:12.239727] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-28T02:46:12.240800] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:12.241397] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-28T02:46:12.242423] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-28T02:46:12.242133] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-28T02:46:12.242609] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-28T02:46:12.242739] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-28T02:46:12.242892] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-28T02:46:12.242946] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-28T02:46:12.248237] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-28T02:46:12.258949] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-28T02:46:12.279282] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-28T02:46:12.979565] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-28T02:46:12.996166] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-28T02:46:13.030448] [INFO ] [MAIN ] A: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:13.060349] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. A took 1.6s. Estimated remaining: 1h 3m 52s. Rate: 37.1 symbols/min [2025-09-28T02:46:13.054311] [INFO ] [MAIN ] AA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:13.091774] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AA took 1.6s. Estimated remaining: 32m 33s. Rate: 72.8 symbols/min [2025-09-28T02:46:13.101113] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:13.155739] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-28T02:46:13.397785] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:13.452840] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-28T02:46:13.511693] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:13.571296] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:13.637398] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-28T02:46:13.637939] [INFO ] [MAIN ] AAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:13.638736] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAP took 0.5s. Estimated remaining: 28m 53s. Rate: 82.0 symbols/min [2025-09-28T02:46:13.684534] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:13.751695] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-28T02:46:13.751360] [DEBUG] [LOCAL ] AAT: Loaded 31069 existing records from primary storage. [2025-09-28T02:46:13.766229] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-28T02:46:13.766441] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:13.786502] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-28T02:46:13.784861] [INFO ] [MAIN ] AAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:13.791444] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-09-28T02:46:13.792994] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAT took 0.6s. Estimated remaining: 23m 10s. Rate: 102.1 symbols/min [2025-09-28T02:46:13.798680] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:13.847436] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-28T02:46:13.920324] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:13.940409] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-28T02:46:13.910634] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-28T02:46:13.945846] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-28T02:46:13.952842] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-28T02:46:13.980566] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-28T02:46:13.981107] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-28T02:46:13.997231] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-28T02:46:13.981265] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-28T02:46:14.007730] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-28T02:46:14.027807] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAMI took 2.5s. Estimated remaining: 20m 23s. Rate: 116.1 symbols/min [2025-09-28T02:46:14.068692] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:14.144231] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-28T02:46:14.150545] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-28T02:46:14.552230] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:14.625723] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-28T02:46:14.626818] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-28T02:46:14.628601] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-28T02:46:14.645831] [INFO ] [MAIN ] AB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:14.677504] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AB took 0.9s. Estimated remaining: 21m 15s. Rate: 111.3 symbols/min [2025-09-28T02:46:14.725584] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:14.749725] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-28T02:46:14.934945] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:14.952679] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-28T02:46:14.953095] [INFO ] [MAIN ] ABBV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:14.953807] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. ABBV took 0.9s. Estimated remaining: 19m 46s. Rate: 119.6 symbols/min [2025-09-28T02:46:14.996455] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:15.036742] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-28T02:46:15.063549] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:15.088286] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-28T02:46:15.085163] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-09-28T02:46:15.110728] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:15.105331] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-28T02:46:15.139622] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-28T02:46:15.170476] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:15.170851] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-28T02:46:15.179864] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-28T02:46:15.181208] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-28T02:46:15.181366] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AAUC took 1.5s. Estimated remaining: 18m 24s. Rate: 128.4 symbols/min [2025-09-28T02:46:15.181927] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-28T02:46:15.206562] [INFO ] [MAIN ] ABCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:15.244195] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 0.5s. Estimated remaining: 16m 38s. Rate: 142.1 symbols/min [2025-09-28T02:46:15.504754] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:15.557764] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-28T02:46:15.588755] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:15.590250] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-28T02:46:15.609958] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-28T02:46:15.610476] [INFO ] [MAIN ] ABEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:15.617146] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABEV took 0.7s. Estimated remaining: 16m 25s. Rate: 143.8 symbols/min [2025-09-28T02:46:15.678548] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-28T02:46:15.706320] [INFO ] [MAIN ] ABG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:15.726382] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABG took 0.5s. Estimated remaining: 15m 19s. Rate: 154.1 symbols/min [2025-09-28T02:46:15.859178] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-28T02:46:15.814890] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-28T02:46:15.870727] [INFO ] [MAIN ] ABM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:15.872761] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-28T02:46:15.907261] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABM took 0.6s. Estimated remaining: 14m 38s. Rate: 161.3 symbols/min [2025-09-28T02:46:16.103412] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:16.175236] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-28T02:46:16.258623] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-28T02:46:16.309501] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:16.476038] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:16.513363] [DEBUG] [LOCAL ] ABR: Loaded 52817 existing records from primary storage. [2025-09-28T02:46:16.514355] [INFO ] [MAIN ] ABR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:16.514989] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABR took 0.9s. Estimated remaining: 15m 20s. Rate: 153.8 symbols/min [2025-09-28T02:46:16.581386] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-28T02:46:16.583812] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-28T02:46:16.700612] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-28T02:46:16.739192] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-28T02:46:16.749050] [INFO ] [MAIN ] ABT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:16.765865] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ABT took 1.0s. Estimated remaining: 14m 56s. Rate: 157.8 symbols/min [2025-09-28T02:46:16.772215] [INFO ] [MAIN ] ACA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:16.823001] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ACA took 0.8s. Estimated remaining: 14m 5s. Rate: 167.3 symbols/min [2025-09-28T02:46:16.910154] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:17.055471] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-28T02:46:17.131219] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-28T02:46:17.271559] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:17.308261] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:17.320992] [DEBUG] [LOCAL ] ACCO: Loaded 38214 existing records from primary storage. [2025-09-28T02:46:17.321323] [INFO ] [MAIN ] ACCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:17.321428] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ACCO took 0.8s. Estimated remaining: 14m 25s. Rate: 163.3 symbols/min [2025-09-28T02:46:17.458551] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-28T02:46:17.472132] [INFO ] [REMOTE ] AAM: Full fetch complete (966 records). [2025-09-28T02:46:17.570933] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:17.563809] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-28T02:46:17.573800] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:46:17.572471] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-28T02:46:17.574223] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:46:17.574531] [INFO ] [MAIN ] ACEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:17.574820] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACEL took 0.8s. Estimated remaining: 14m 9s. Rate: 166.4 symbols/min [2025-09-28T02:46:17.574901] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:46:17.594552] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-28T02:46:17.617000] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-28T02:46:17.638076] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-28T02:46:17.678637] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-28T02:46:17.697731] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. AAM took 6.2s. Estimated remaining: 13m 38s. Rate: 172.7 symbols/min [2025-09-28T02:46:17.724718] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-28T02:46:17.808389] [INFO ] [MAIN ] ACHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:17.846889] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACHR took 1.0s. Estimated remaining: 13m 13s. Rate: 178.0 symbols/min [2025-09-28T02:46:17.871681] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:18.108020] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-28T02:46:18.165719] [INFO ] [MAIN ] ACI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:18.167041] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 0.8s. Estimated remaining: 13m 10s. Rate: 178.5 symbols/min [2025-09-28T02:46:18.227920] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:18.323975] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:18.355200] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-28T02:46:18.389274] [INFO ] [MAIN ] ACM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:18.390328] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACM took 0.8s. Estimated remaining: 12m 57s. Rate: 181.4 symbols/min [2025-09-28T02:46:18.548333] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:18.661738] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-28T02:46:18.685840] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-28T02:46:18.768970] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:18.770353] [INFO ] [MAIN ] ACP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:18.769359] [INFO ] [MAIN ] ACR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:18.770586] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACR took 0.6s. Estimated remaining: 13m 2s. Rate: 180.1 symbols/min [2025-09-28T02:46:18.771270] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACP took 0.9s. Estimated remaining: 12m 28s. Rate: 188.3 symbols/min [2025-09-28T02:46:18.777691] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-28T02:46:18.827546] [INFO ] [MAIN ] ACN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:18.866723] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACN took 1.2s. Estimated remaining: 12m 6s. Rate: 194.0 symbols/min [2025-09-28T02:46:19.274896] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:19.318707] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-28T02:46:19.317599] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:19.330155] [INFO ] [MAIN ] ACRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:19.337017] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. ACRE took 0.9s. Estimated remaining: 12m 21s. Rate: 190.0 symbols/min [2025-09-28T02:46:19.491836] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:19.497963] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-28T02:46:19.498148] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-28T02:46:19.537267] [INFO ] [MAIN ] ACV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:19.531817] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-28T02:46:19.559386] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACV took 0.8s. Estimated remaining: 12m 12s. Rate: 192.2 symbols/min [2025-09-28T02:46:19.570041] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-28T02:46:19.616156] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-28T02:46:19.642420] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-28T02:46:19.658265] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-28T02:46:19.884253] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:19.934691] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-28T02:46:19.968502] [INFO ] [MAIN ] ACVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:20.000365] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACVA took 1.2s. Estimated remaining: 12m 23s. Rate: 189.3 symbols/min [2025-09-28T02:46:20.029260] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:20.472162] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-28T02:46:20.484793] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-28T02:46:20.485063] [INFO ] [MAIN ] ADC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:20.513835] [INFO ] [MAIN ] ADCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:20.515527] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:20.514365] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ADC took 1.2s. Estimated remaining: 12m 39s. Rate: 185.2 symbols/min [2025-09-28T02:46:20.580904] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADCT took 1.0s. Estimated remaining: 12m 18s. Rate: 190.4 symbols/min [2025-09-28T02:46:20.735878] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:20.796922] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-28T02:46:20.953525] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:21.033339] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:21.040143] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:21.055917] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-28T02:46:21.056462] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:21.056722] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-09-28T02:46:21.056793] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:21.056871] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-28T02:46:21.056983] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-28T02:46:21.057056] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-28T02:46:21.057151] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-28T02:46:21.058171] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-28T02:46:21.057240] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. AD took 2.1s. Estimated remaining: 12m 30s. Rate: 187.2 symbols/min [2025-09-28T02:46:21.072545] [INFO ] [MAIN ] ADM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:21.073159] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADM took 1.0s. Estimated remaining: 12m 7s. Rate: 193.1 symbols/min [2025-09-28T02:46:21.431028] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:21.491835] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-28T02:46:21.515757] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-28T02:46:21.514596] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:21.516987] [INFO ] [MAIN ] ADNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:21.517300] [INFO ] [MAIN ] ADT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:21.518506] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 1.0s. Estimated remaining: 12m 16s. Rate: 190.6 symbols/min [2025-09-28T02:46:21.526501] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADT took 0.9s. Estimated remaining: 11m 54s. Rate: 196.4 symbols/min [2025-09-28T02:46:21.906736] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-28T02:46:21.909390] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:21.965556] [INFO ] [MAIN ] ADX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:21.975770] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADX took 0.9s. Estimated remaining: 12m 4s. Rate: 193.7 symbols/min [2025-09-28T02:46:21.974989] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:22.072166] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-28T02:46:22.109998] [INFO ] [MAIN ] AEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:22.115492] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEE took 1.0s. Estimated remaining: 11m 52s. Rate: 196.8 symbols/min [2025-09-28T02:46:22.125881] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-28T02:46:22.143291] [INFO ] [MAIN ] AEFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:22.215844] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEFC took 0.7s. Estimated remaining: 11m 39s. Rate: 200.5 symbols/min [2025-09-28T02:46:22.280908] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:22.551338] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:22.597020] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-28T02:46:22.633690] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:22.647205] [INFO ] [MAIN ] AEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:22.648589] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 1.1s. Estimated remaining: 11m 47s. Rate: 198.1 symbols/min [2025-09-28T02:46:22.685868] [DEBUG] [LOCAL ] AEM: Loaded 54243 existing records from primary storage. [2025-09-28T02:46:22.686429] [INFO ] [MAIN ] AEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:22.687051] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 0.7s. Estimated remaining: 11m 30s. Rate: 202.8 symbols/min [2025-09-28T02:46:22.756103] [DEBUG] [LOCAL ] AER: Loaded 49271 existing records from primary storage. [2025-09-28T02:46:22.756544] [INFO ] [MAIN ] AER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:22.757962] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-28T02:46:22.758548] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AER took 0.5s. Estimated remaining: 11m 17s. Rate: 206.8 symbols/min [2025-09-28T02:46:22.759121] [INFO ] [MAIN ] AEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:22.759794] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEO took 0.6s. Estimated remaining: 10m 59s. Rate: 212.1 symbols/min [2025-09-28T02:46:23.318495] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:23.352471] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:23.501518] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:23.531976] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:23.533055] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-28T02:46:23.543883] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-28T02:46:23.542741] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-28T02:46:23.544476] [INFO ] [MAIN ] AFB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:23.544604] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-28T02:46:23.544754] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AFB took 0.8s. Estimated remaining: 11m 28s. Rate: 203.3 symbols/min [2025-09-28T02:46:23.544954] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-28T02:46:23.550551] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-28T02:46:23.568971] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-28T02:46:23.965514] [DEBUG] [LOCAL ] AESI: Loaded 50213 existing records from primary storage. [2025-09-28T02:46:24.023178] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:24.020821] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-28T02:46:24.054410] [INFO ] [MAIN ] AESI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:24.080182] [INFO ] [MAIN ] AES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:24.092786] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AESI took 1.3s. Estimated remaining: 11m 41s. Rate: 199.2 symbols/min [2025-09-28T02:46:24.104186] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AES took 1.3s. Estimated remaining: 11m 25s. Rate: 203.8 symbols/min [2025-09-28T02:46:24.407967] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:24.457902] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-28T02:46:24.514373] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-28T02:46:24.551443] [INFO ] [MAIN ] AFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:24.596143] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:24.611495] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFG took 1.1s. Estimated remaining: 11m 36s. Rate: 200.5 symbols/min [2025-09-28T02:46:24.636088] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:24.686637] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:24.721825] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-28T02:46:24.734216] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:24.753797] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-28T02:46:24.734590] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-28T02:46:24.745014] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-09-28T02:46:24.758556] [INFO ] [MAIN ] AFGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:24.758842] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AFGC took 0.6s. Estimated remaining: 11m 28s. Rate: 202.8 symbols/min [2025-09-28T02:46:24.759431] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:24.759283] [INFO ] [MAIN ] AFGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:24.822487] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGB took 0.7s. Estimated remaining: 11m 16s. Rate: 206.3 symbols/min [2025-09-28T02:46:24.792277] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-28T02:46:24.938247] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:24.948838] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-28T02:46:24.979486] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-28T02:46:25.042732] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-28T02:46:25.090296] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AEXA took 2.3s. Estimated remaining: 11m 15s. Rate: 206.6 symbols/min [2025-09-28T02:46:25.109619] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-28T02:46:25.179302] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:25.168761] [INFO ] [MAIN ] AFGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:25.242797] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGD took 0.6s. Estimated remaining: 11m 8s. Rate: 208.7 symbols/min [2025-09-28T02:46:25.319287] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:25.389691] [DEBUG] [LOCAL ] AFGE: Loaded 2512 existing records from primary storage. [2025-09-28T02:46:25.451737] [INFO ] [MAIN ] AFGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:25.481861] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 0.7s. Estimated remaining: 11m 5s. Rate: 209.4 symbols/min [2025-09-28T02:46:25.691114] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:25.722747] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:25.882964] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:25.901990] [DEBUG] [LOCAL ] AFL: Loaded 53915 existing records from primary storage. [2025-09-28T02:46:25.902848] [INFO ] [MAIN ] AFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:25.903164] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 1.0s. Estimated remaining: 11m 11s. Rate: 207.5 symbols/min [2025-09-28T02:46:26.054567] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-28T02:46:26.080771] [INFO ] [MAIN ] AGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:26.109741] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGD took 0.6s. Estimated remaining: 11m 7s. Rate: 208.6 symbols/min [2025-09-28T02:46:26.176060] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-28T02:46:26.174874] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-28T02:46:26.182911] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:26.188693] [INFO ] [MAIN ] AG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:26.210085] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AG took 1.1s. Estimated remaining: 10m 59s. Rate: 211.3 symbols/min [2025-09-28T02:46:26.209219] [INFO ] [MAIN ] AGCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:26.277414] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 1.0s. Estimated remaining: 10m 49s. Rate: 214.4 symbols/min [2025-09-28T02:46:26.596222] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:26.632680] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:26.776436] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:26.782044] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-28T02:46:26.782390] [INFO ] [MAIN ] AGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:26.783150] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGM took 0.6s. Estimated remaining: 10m 58s. Rate: 211.2 symbols/min [2025-09-28T02:46:26.814362] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-28T02:46:26.877742] [INFO ] [MAIN ] AGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:26.912278] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGI took 1.0s. Estimated remaining: 10m 51s. Rate: 213.3 symbols/min [2025-09-28T02:46:27.087077] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-28T02:46:27.159892] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-28T02:46:27.167792] [INFO ] [MAIN ] AGL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:27.169751] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:27.183238] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGL took 1.0s. Estimated remaining: 10m 51s. Rate: 213.5 symbols/min [2025-09-28T02:46:27.183635] [INFO ] [MAIN ] AGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:27.201333] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 0.9s. Estimated remaining: 10m 40s. Rate: 217.0 symbols/min [2025-09-28T02:46:27.495728] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:27.663691] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-28T02:46:27.680364] [INFO ] [MAIN ] AGRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:27.705086] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:27.705231] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AGRO took 0.9s. Estimated remaining: 10m 49s. Rate: 214.0 symbols/min [2025-09-28T02:46:27.702043] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:27.716194] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-28T02:46:27.739964] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-28T02:46:27.769084] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-28T02:46:27.793217] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-28T02:46:27.827976] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-28T02:46:27.828300] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-28T02:46:28.020144] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-28T02:46:28.058964] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:28.059224] [INFO ] [MAIN ] AGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:28.077857] [DEBUG] [LOCAL ] AHH: Loaded 41885 existing records from primary storage. [2025-09-28T02:46:28.076475] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGX took 1.1s. Estimated remaining: 10m 52s. Rate: 212.8 symbols/min [2025-09-28T02:46:28.099712] [INFO ] [MAIN ] AHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:28.151471] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AHH took 1.0s. Estimated remaining: 10m 44s. Rate: 215.5 symbols/min [2025-09-28T02:46:28.750362] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:28.734224] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:28.803775] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:28.805199] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-28T02:46:28.805903] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-28T02:46:28.807499] [INFO ] [MAIN ] AHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:28.808001] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHR took 1.1s. Estimated remaining: 10m 58s. Rate: 210.8 symbols/min [2025-09-28T02:46:28.886388] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-28T02:46:28.904854] [INFO ] [MAIN ] AHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:28.910518] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHT took 0.8s. Estimated remaining: 10m 51s. Rate: 213.0 symbols/min [2025-09-28T02:46:28.992146] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:29.086811] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-28T02:46:29.147042] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:29.132610] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:29.158253] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-09-28T02:46:29.211697] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:29.230480] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:29.230869] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-28T02:46:29.230986] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-28T02:46:29.232434] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-28T02:46:29.232355] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-28T02:46:29.232715] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-28T02:46:29.232996] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-28T02:46:29.232788] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-28T02:46:29.234117] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-28T02:46:29.234375] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-28T02:46:29.234570] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AHL took 2.0s. Estimated remaining: 10m 52s. Rate: 212.5 symbols/min [2025-09-28T02:46:29.240168] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-28T02:46:29.246737] [INFO ] [MAIN ] AI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:29.277564] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AI took 1.1s. Estimated remaining: 10m 43s. Rate: 215.3 symbols/min [2025-09-28T02:46:29.283037] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-28T02:46:29.682835] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:29.817587] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:29.894561] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-28T02:46:29.935358] [INFO ] [MAIN ] AIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:29.987368] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-28T02:46:29.982233] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIG took 1.2s. Estimated remaining: 10m 58s. Rate: 210.4 symbols/min [2025-09-28T02:46:30.035632] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-28T02:46:29.999560] [INFO ] [MAIN ] AIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:30.073173] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIN took 0.8s. Estimated remaining: 10m 51s. Rate: 212.6 symbols/min [2025-09-28T02:46:30.052371] [INFO ] [MAIN ] AIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:30.161632] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIO took 0.9s. Estimated remaining: 10m 44s. Rate: 214.8 symbols/min [2025-09-28T02:46:30.127174] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:30.291066] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-28T02:46:30.478156] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:30.577985] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:30.645820] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:30.650036] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:30.650639] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-28T02:46:30.650849] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:30.651266] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-09-28T02:46:30.651403] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:30.651537] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-28T02:46:30.651769] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-28T02:46:30.652602] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-28T02:46:30.652836] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-28T02:46:30.652926] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AII took 1.7s. Estimated remaining: 10m 51s. Rate: 212.4 symbols/min [2025-09-28T02:46:30.872798] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:30.882172] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-28T02:46:30.884202] [INFO ] [MAIN ] AIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:30.883435] [DEBUG] [LOCAL ] AIR: Loaded 28152 existing records from primary storage. [2025-09-28T02:46:30.884431] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIT took 0.8s. Estimated remaining: 10m 49s. Rate: 213.0 symbols/min [2025-09-28T02:46:30.886199] [INFO ] [MAIN ] AIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:30.929578] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIR took 0.9s. Estimated remaining: 10m 41s. Rate: 215.5 symbols/min [2025-09-28T02:46:30.992699] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-28T02:46:31.068804] [INFO ] [MAIN ] AIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:31.200476] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 1.0s. Estimated remaining: 10m 40s. Rate: 215.6 symbols/min [2025-09-28T02:46:31.204446] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:31.356272] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-28T02:46:31.362603] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:31.356017] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-28T02:46:31.384928] [INFO ] [MAIN ] AIZN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:31.385271] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZN took 0.5s. Estimated remaining: 10m 37s. Rate: 216.6 symbols/min [2025-09-28T02:46:31.385403] [INFO ] [MAIN ] AIZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:31.403608] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZ took 0.8s. Estimated remaining: 10m 28s. Rate: 219.4 symbols/min [2025-09-28T02:46:31.638233] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:31.675813] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-28T02:46:31.798762] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-28T02:46:31.824298] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:31.835587] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-28T02:46:31.854866] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-28T02:46:31.883815] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-28T02:46:31.894699] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-28T02:46:31.896178] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-28T02:46:31.912348] [INFO ] [MAIN ] AJG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:31.970143] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AJG took 1.0s. Estimated remaining: 10m 37s. Rate: 216.3 symbols/min [2025-09-28T02:46:32.060917] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:32.337829] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-28T02:46:32.439484] [INFO ] [MAIN ] AKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:32.474080] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:32.485027] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AKR took 1.1s. Estimated remaining: 10m 44s. Rate: 213.9 symbols/min [2025-09-28T02:46:32.546536] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-28T02:46:32.643722] [INFO ] [MAIN ] AL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:32.628151] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:32.654985] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 1.2s. Estimated remaining: 10m 41s. Rate: 215.0 symbols/min [2025-09-28T02:46:32.664891] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-28T02:46:32.935981] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:33.059881] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:33.062544] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-28T02:46:33.063408] [INFO ] [MAIN ] ALB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:33.064221] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. ALB took 1.0s. Estimated remaining: 10m 44s. Rate: 213.7 symbols/min [2025-09-28T02:46:33.074615] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-28T02:46:33.075953] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-28T02:46:33.114096] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-28T02:46:33.114633] [INFO ] [MAIN ] ALE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:33.114794] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALE took 0.4s. Estimated remaining: 10m 37s. Rate: 216.0 symbols/min [2025-09-28T02:46:33.132279] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-28T02:46:33.132729] [INFO ] [MAIN ] ALC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:33.133132] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALC took 0.6s. Estimated remaining: 10m 29s. Rate: 218.5 symbols/min [2025-09-28T02:46:33.398297] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-28T02:46:33.399906] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-28T02:46:33.555734] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.16 seconds). [2025-09-28T02:46:33.557186] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-28T02:46:33.871353] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-28T02:46:33.872696] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-28T02:46:34.175224] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-28T02:46:34.176717] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-28T02:46:34.711418] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-28T02:46:34.713083] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-28T02:46:35.008831] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-28T02:46:35.010115] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-28T02:46:35.153420] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.14 seconds). [2025-09-28T02:46:35.154452] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-28T02:46:35.374203] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-28T02:46:35.375329] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-28T02:46:35.589843] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-28T02:46:35.590767] [INFO ] [REMOTE ] AKA: Full fetch complete (2428 records). [2025-09-28T02:46:35.590874] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-28T02:46:35.777315] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:46:35.777542] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:46:35.777618] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:46:35.777762] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-28T02:46:35.777886] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-28T02:46:35.777964] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-28T02:46:35.778057] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-28T02:46:35.778177] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. AKA took 4.6s. Estimated remaining: 11m 37s. Rate: 197.2 symbols/min [2025-09-28T02:46:36.358366] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:36.415125] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:36.473094] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:36.532724] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:36.550836] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-28T02:46:36.551762] [INFO ] [MAIN ] ALG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:36.552039] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALG took 0.8s. Estimated remaining: 11m 50s. Rate: 193.6 symbols/min [2025-09-28T02:46:36.806149] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:36.825357] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-28T02:46:36.842045] [INFO ] [MAIN ] ALEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:36.841693] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-28T02:46:36.842946] [INFO ] [MAIN ] ALK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:36.842719] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 1.1s. Estimated remaining: 11m 49s. Rate: 193.7 symbols/min [2025-09-28T02:46:36.856163] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALK took 1.1s. Estimated remaining: 11m 41s. Rate: 196.0 symbols/min [2025-09-28T02:46:36.855715] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-28T02:46:36.940414] [INFO ] [MAIN ] ALIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:37.030248] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALIT took 1.2s. Estimated remaining: 11m 37s. Rate: 197.0 symbols/min [2025-09-28T02:46:37.363835] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-28T02:46:37.359721] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:37.396633] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:37.413884] [INFO ] [MAIN ] ALL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:37.447578] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALL took 0.9s. Estimated remaining: 11m 39s. Rate: 196.1 symbols/min [2025-09-28T02:46:37.470137] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:37.687021] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:37.715238] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-28T02:46:37.716960] [INFO ] [MAIN ] ALLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:37.731320] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALLE took 0.9s. Estimated remaining: 11m 38s. Rate: 196.3 symbols/min [2025-09-28T02:46:37.759833] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-28T02:46:37.801998] [INFO ] [MAIN ] ALSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:37.803001] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-28T02:46:37.840239] [INFO ] [MAIN ] ALLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:37.822779] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALSN took 0.7s. Estimated remaining: 11m 33s. Rate: 197.9 symbols/min [2025-09-28T02:46:37.874043] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALLY took 1.0s. Estimated remaining: 11m 26s. Rate: 199.8 symbols/min [2025-09-28T02:46:38.061721] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-28T02:46:38.063527] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:38.128517] [INFO ] [MAIN ] ALTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:38.144236] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 0.7s. Estimated remaining: 11m 25s. Rate: 200.0 symbols/min [2025-09-28T02:46:38.415260] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:38.455055] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:38.455461] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-28T02:46:38.460682] [INFO ] [MAIN ] ALUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:38.473972] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 0.7s. Estimated remaining: 11m 25s. Rate: 199.8 symbols/min [2025-09-28T02:46:38.564030] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:38.600199] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-28T02:46:38.609098] [INFO ] [MAIN ] ALX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:38.636787] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 0.7s. Estimated remaining: 11m 21s. Rate: 200.8 symbols/min [2025-09-28T02:46:38.856746] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:38.935604] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-28T02:46:38.971217] [INFO ] [MAIN ] ALV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:38.995688] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALV took 1.1s. Estimated remaining: 11m 23s. Rate: 200.3 symbols/min [2025-09-28T02:46:38.995069] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:39.068220] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-28T02:46:39.112685] [INFO ] [MAIN ] AM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:39.157113] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AM took 1.0s. Estimated remaining: 11m 19s. Rate: 201.3 symbols/min [2025-09-28T02:46:39.158402] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-28T02:46:39.170599] [INFO ] [MAIN ] AMBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:39.197968] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBC took 0.7s. Estimated remaining: 11m 12s. Rate: 203.2 symbols/min [2025-09-28T02:46:39.388240] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:39.425010] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-28T02:46:39.472277] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-28T02:46:39.507608] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-28T02:46:39.537775] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-28T02:46:39.557173] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-28T02:46:39.579967] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-28T02:46:39.585337] [INFO ] [MAIN ] AMBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:39.619592] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:39.615558] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBP took 1.0s. Estimated remaining: 11m 15s. Rate: 202.3 symbols/min [2025-09-28T02:46:39.632384] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-28T02:46:39.727481] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:40.108163] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:40.216173] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-28T02:46:40.264490] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-28T02:46:40.277454] [INFO ] [MAIN ] AMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:40.278440] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMC took 1.1s. Estimated remaining: 11m 23s. Rate: 199.8 symbols/min [2025-09-28T02:46:40.278873] [INFO ] [MAIN ] AMCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:40.324077] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMCR took 1.0s. Estimated remaining: 11m 17s. Rate: 201.5 symbols/min [2025-09-28T02:46:40.737172] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:40.768742] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:40.774534] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-28T02:46:40.830327] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-28T02:46:40.852210] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:40.853279] [INFO ] [MAIN ] AME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:40.854633] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AME took 1.2s. Estimated remaining: 11m 22s. Rate: 199.9 symbols/min [2025-09-28T02:46:40.985152] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-28T02:46:41.002007] [INFO ] [MAIN ] AMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:41.009043] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:41.020637] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AMG took 0.7s. Estimated remaining: 11m 19s. Rate: 200.8 symbols/min [2025-09-28T02:46:41.021282] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-28T02:46:41.021628] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:41.111830] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-09-28T02:46:41.133127] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:41.155148] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:41.216376] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-28T02:46:41.238081] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-28T02:46:41.238389] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-28T02:46:41.238490] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-28T02:46:41.238594] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMBQ took 2.2s. Estimated remaining: 11m 17s. Rate: 201.4 symbols/min [2025-09-28T02:46:41.267792] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-28T02:46:41.354357] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:41.354580] [INFO ] [MAIN ] AMH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:41.431702] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMH took 1.1s. Estimated remaining: 11m 14s. Rate: 202.1 symbols/min [2025-09-28T02:46:41.607132] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-28T02:46:41.651549] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:41.666270] [INFO ] [MAIN ] AMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:41.683107] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMN took 0.8s. Estimated remaining: 11m 13s. Rate: 202.4 symbols/min [2025-09-28T02:46:41.752429] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:41.845209] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-28T02:46:41.876872] [INFO ] [MAIN ] AMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:41.877116] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMP took 0.8s. Estimated remaining: 11m 10s. Rate: 203.1 symbols/min [2025-09-28T02:46:42.019968] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:42.170290] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-28T02:46:42.202775] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:42.203290] [INFO ] [MAIN ] AMPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:42.204102] [DEBUG] [LOCAL ] AMPY: Loaded 38164 existing records from primary storage. [2025-09-28T02:46:42.204734] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 1.0s. Estimated remaining: 11m 11s. Rate: 202.9 symbols/min [2025-09-28T02:46:42.226872] [INFO ] [MAIN ] AMPY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:42.243744] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPY took 0.8s. Estimated remaining: 11m 5s. Rate: 204.5 symbols/min [2025-09-28T02:46:42.403427] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-28T02:46:42.445911] [INFO ] [MAIN ] AMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:42.509638] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMR took 0.8s. Estimated remaining: 11m 4s. Rate: 204.7 symbols/min [2025-09-28T02:46:42.582787] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:42.637212] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-28T02:46:42.648052] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:42.661419] [INFO ] [MAIN ] AMRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:42.666859] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-28T02:46:42.686170] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMRC took 0.8s. Estimated remaining: 11m 1s. Rate: 205.5 symbols/min [2025-09-28T02:46:42.676761] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-28T02:46:42.724111] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-28T02:46:42.749401] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-28T02:46:42.789357] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-28T02:46:42.819530] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-28T02:46:42.900522] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:43.163771] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:43.253072] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-28T02:46:43.306281] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-28T02:46:43.296422] [INFO ] [MAIN ] AMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:43.318039] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMT took 1.0s. Estimated remaining: 11m 8s. Rate: 203.3 symbols/min [2025-09-28T02:46:43.328598] [INFO ] [MAIN ] AMTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:43.385540] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-28T02:46:43.363014] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTB took 0.8s. Estimated remaining: 11m 2s. Rate: 204.9 symbols/min [2025-09-28T02:46:43.407507] [INFO ] [MAIN ] AMTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:43.494486] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTD took 0.8s. Estimated remaining: 10m 59s. Rate: 205.9 symbols/min [2025-09-28T02:46:43.640119] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:43.728224] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-28T02:46:43.783236] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:43.926532] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:44.010192] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:44.016375] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-28T02:46:44.029915] [INFO ] [MAIN ] AMWL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:44.030083] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMWL took 0.6s. Estimated remaining: 11m 3s. Rate: 204.4 symbols/min [2025-09-28T02:46:44.126036] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:44.165619] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-28T02:46:44.177303] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-28T02:46:44.202729] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:44.240408] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:44.218920] [INFO ] [MAIN ] AMTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:44.238573] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-09-28T02:46:44.241036] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:44.241560] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMTM took 0.9s. Estimated remaining: 11m 2s. Rate: 204.9 symbols/min [2025-09-28T02:46:44.241742] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-28T02:46:44.248114] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-28T02:46:44.248373] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-28T02:46:44.265588] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-28T02:46:44.298366] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMRZ took 2.1s. Estimated remaining: 10m 57s. Rate: 206.4 symbols/min [2025-09-28T02:46:44.551967] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-28T02:46:44.600863] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:44.617257] [INFO ] [MAIN ] AMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:44.630453] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMX took 1.1s. Estimated remaining: 10m 57s. Rate: 206.1 symbols/min [2025-09-28T02:46:44.641994] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-28T02:46:44.754441] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:44.681929] [INFO ] [MAIN ] AN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:44.792446] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AN took 0.8s. Estimated remaining: 10m 54s. Rate: 206.9 symbols/min [2025-09-28T02:46:45.063979] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:45.117803] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:45.117898] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-28T02:46:45.118568] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-28T02:46:45.121007] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-28T02:46:45.136214] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-28T02:46:45.138195] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-28T02:46:45.138585] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-28T02:46:45.138687] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-28T02:46:45.145259] [INFO ] [MAIN ] ANET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:45.146105] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANET took 0.9s. Estimated remaining: 10m 55s. Rate: 206.5 symbols/min [2025-09-28T02:46:45.386983] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-28T02:46:45.451582] [INFO ] [MAIN ] ANF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:45.569330] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANF took 1.3s. Estimated remaining: 10m 57s. Rate: 205.7 symbols/min [2025-09-28T02:46:45.538795] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-28T02:46:45.608337] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:45.635957] [INFO ] [MAIN ] ANRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:45.655631] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 0.8s. Estimated remaining: 10m 53s. Rate: 206.9 symbols/min [2025-09-28T02:46:45.778635] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:45.779065] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-28T02:46:45.789177] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-28T02:46:45.789509] [INFO ] [MAIN ] ANVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:45.789631] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANVS took 0.6s. Estimated remaining: 10m 50s. Rate: 207.9 symbols/min [2025-09-28T02:46:45.927805] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:45.928143] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-28T02:46:45.928234] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:45.928313] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-09-28T02:46:45.928381] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:45.928456] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-28T02:46:45.928560] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-28T02:46:45.928634] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-28T02:46:45.928765] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-28T02:46:45.928857] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANGX took 1.3s. Estimated remaining: 10m 47s. Rate: 208.8 symbols/min [2025-09-28T02:46:46.526447] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:46.610520] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:46.689519] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:46.691118] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:46.693820] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-28T02:46:46.693928] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-28T02:46:46.694039] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-28T02:46:46.694091] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-28T02:46:46.694150] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-28T02:46:46.694197] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-28T02:46:46.839340] [DEBUG] [LOCAL ] AOMR: Loaded 16852 existing records from primary storage. [2025-09-28T02:46:46.927484] [INFO ] [MAIN ] AOMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:46.980123] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMR took 1.0s. Estimated remaining: 11m 1s. Rate: 204.3 symbols/min [2025-09-28T02:46:46.986344] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-28T02:46:47.018975] [INFO ] [MAIN ] AOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:47.036395] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOD took 1.1s. Estimated remaining: 10m 56s. Rate: 205.7 symbols/min [2025-09-28T02:46:47.231726] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-28T02:46:47.362738] [INFO ] [MAIN ] AON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:47.376908] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AON took 1.4s. Estimated remaining: 10m 57s. Rate: 205.4 symbols/min [2025-09-28T02:46:47.390765] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:47.479432] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-28T02:46:47.575371] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:47.654959] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:47.754437] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:47.754965] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-28T02:46:47.755062] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:47.755121] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-09-28T02:46:47.755162] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:47.755207] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-28T02:46:47.759889] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-28T02:46:47.759610] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:47.760163] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-28T02:46:47.760759] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-28T02:46:47.760875] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOMD took 1.8s. Estimated remaining: 10m 58s. Rate: 204.9 symbols/min [2025-09-28T02:46:47.869205] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-28T02:46:47.897464] [DEBUG] [LOCAL ] AP: Loaded 7236 existing records from primary storage. [2025-09-28T02:46:47.903530] [INFO ] [MAIN ] AORT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:47.931132] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AORT took 0.9s. Estimated remaining: 10m 56s. Rate: 205.5 symbols/min [2025-09-28T02:46:47.963704] [INFO ] [MAIN ] AP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:47.991603] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 0.6s. Estimated remaining: 10m 51s. Rate: 206.8 symbols/min [2025-09-28T02:46:48.040753] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:48.170754] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-28T02:46:48.247447] [INFO ] [MAIN ] AOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:48.293980] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AOS took 1.2s. Estimated remaining: 10m 51s. Rate: 206.8 symbols/min [2025-09-28T02:46:48.370733] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:48.500724] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-28T02:46:48.494207] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:48.512356] [INFO ] [MAIN ] APAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:48.524922] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 0.8s. Estimated remaining: 10m 50s. Rate: 207.1 symbols/min [2025-09-28T02:46:48.664270] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:48.835572] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:48.870349] [DEBUG] [LOCAL ] APG: Loaded 50931 existing records from primary storage. [2025-09-28T02:46:48.872255] [INFO ] [MAIN ] APG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:48.871465] [DEBUG] [LOCAL ] APD: Loaded 46087 existing records from primary storage. [2025-09-28T02:46:48.873137] [INFO ] [MAIN ] APD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:48.872683] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APG took 0.9s. Estimated remaining: 10m 51s. Rate: 206.8 symbols/min [2025-09-28T02:46:48.881510] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APD took 0.9s. Estimated remaining: 10m 45s. Rate: 208.3 symbols/min [2025-09-28T02:46:49.176565] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-28T02:46:49.193085] [INFO ] [MAIN ] APH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:49.193737] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 0.9s. Estimated remaining: 10m 46s. Rate: 208.2 symbols/min [2025-09-28T02:46:49.315225] [DEBUG] [LOCAL ] APLE: Loaded 52769 existing records from primary storage. [2025-09-28T02:46:49.394885] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:49.412068] [INFO ] [MAIN ] APLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:49.467888] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APLE took 0.9s. Estimated remaining: 10m 45s. Rate: 208.3 symbols/min [2025-09-28T02:46:49.483470] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:49.699240] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:49.742415] [DEBUG] [LOCAL ] APOS: Loaded 7568 existing records from primary storage. [2025-09-28T02:46:49.774401] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:49.775950] [INFO ] [MAIN ] APOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:49.793361] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APOS took 0.9s. Estimated remaining: 10m 45s. Rate: 208.1 symbols/min [2025-09-28T02:46:49.943614] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-28T02:46:49.967852] [INFO ] [MAIN ] APO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:49.991726] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APO took 1.1s. Estimated remaining: 10m 44s. Rate: 208.6 symbols/min [2025-09-28T02:46:50.021376] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:50.160447] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-28T02:46:50.208061] [INFO ] [MAIN ] AQNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:50.208576] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQNB took 0.4s. Estimated remaining: 10m 42s. Rate: 209.0 symbols/min [2025-09-28T02:46:50.209828] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-28T02:46:50.264470] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-28T02:46:50.242509] [INFO ] [MAIN ] APTV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:50.323397] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 1.1s. Estimated remaining: 10m 39s. Rate: 209.9 symbols/min [2025-09-28T02:46:50.343768] [INFO ] [MAIN ] AQN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:50.408028] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 0.9s. Estimated remaining: 10m 35s. Rate: 211.0 symbols/min [2025-09-28T02:46:50.382574] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:50.679008] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:50.929661] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:50.955409] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:51.013182] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-28T02:46:51.029361] [INFO ] [MAIN ] ARCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:51.029801] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. ARCO took 0.8s. Estimated remaining: 10m 41s. Rate: 209.2 symbols/min [2025-09-28T02:46:51.051953] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-28T02:46:51.089497] [INFO ] [MAIN ] AR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:51.105230] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-28T02:46:51.121175] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. AR took 1.1s. Estimated remaining: 10m 37s. Rate: 210.2 symbols/min [2025-09-28T02:46:51.166483] [INFO ] [MAIN ] ARDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:51.196787] [DEBUG] [LOCAL ] ARDT: Loaded 28513 existing records from primary storage. [2025-09-28T02:46:51.184049] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARDC took 0.9s. Estimated remaining: 10m 33s. Rate: 211.4 symbols/min [2025-09-28T02:46:51.228569] [INFO ] [MAIN ] ARDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:51.317134] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 0.9s. Estimated remaining: 10m 31s. Rate: 212.2 symbols/min [2025-09-28T02:46:51.448504] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:51.784448] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:51.780686] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:51.838252] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:51.898098] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-28T02:46:51.931331] [INFO ] [MAIN ] ARE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:51.932441] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARE took 0.9s. Estimated remaining: 10m 36s. Rate: 210.4 symbols/min [2025-09-28T02:46:52.094429] [DEBUG] [LOCAL ] ARIS: Loaded 42624 existing records from primary storage. [2025-09-28T02:46:52.132761] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-28T02:46:52.171336] [INFO ] [MAIN ] ARI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:52.171760] [INFO ] [MAIN ] ARIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:52.176809] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-28T02:46:52.177266] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARIS took 0.8s. Estimated remaining: 10m 35s. Rate: 210.6 symbols/min [2025-09-28T02:46:52.198315] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:52.199188] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARI took 0.9s. Estimated remaining: 10m 30s. Rate: 212.0 symbols/min [2025-09-28T02:46:52.224091] [INFO ] [MAIN ] ARES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:52.270986] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARES took 1.1s. Estimated remaining: 10m 27s. Rate: 213.1 symbols/min [2025-09-28T02:46:52.689686] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:52.751434] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:52.809350] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:52.813483] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-28T02:46:52.814788] [INFO ] [MAIN ] ARLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:52.815411] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 0.9s. Estimated remaining: 10m 30s. Rate: 211.7 symbols/min [2025-09-28T02:46:53.048909] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:53.051048] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-28T02:46:53.067490] [INFO ] [MAIN ] AROC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:53.080856] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. AROC took 0.9s. Estimated remaining: 10m 30s. Rate: 211.8 symbols/min [2025-09-28T02:46:53.141404] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-28T02:46:53.203973] [INFO ] [MAIN ] ARMK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:53.208224] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARMK took 1.0s. Estimated remaining: 10m 27s. Rate: 212.6 symbols/min [2025-09-28T02:46:53.210369] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-28T02:46:53.298223] [INFO ] [MAIN ] ARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:53.350323] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:53.360604] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-28T02:46:53.365967] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-28T02:46:53.360479] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARR took 1.0s. Estimated remaining: 10m 25s. Rate: 213.3 symbols/min [2025-09-28T02:46:53.372049] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-28T02:46:53.372162] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-28T02:46:53.445081] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-28T02:46:53.496070] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-28T02:46:53.616723] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-28T02:46:53.608439] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:53.647295] [INFO ] [MAIN ] ARW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:53.647502] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARW took 0.8s. Estimated remaining: 10m 25s. Rate: 213.2 symbols/min [2025-09-28T02:46:53.863087] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:54.209143] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-28T02:46:54.210930] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:54.270834] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-28T02:46:54.271096] [INFO ] [MAIN ] ASA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:54.325066] [INFO ] [MAIN ] AS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:54.335013] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:46:54.335731] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-28T02:46:54.335222] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ASA took 0.9s. Estimated remaining: 10m 31s. Rate: 211.2 symbols/min [2025-09-28T02:46:54.344161] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. AS took 1.1s. Estimated remaining: 10m 26s. Rate: 212.6 symbols/min [2025-09-28T02:46:54.499163] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:46:54.526879] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-28T02:46:54.532311] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:46:54.585529] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-09-28T02:46:54.624544] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:46:54.732791] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-28T02:46:54.725994] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-28T02:46:54.753132] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:54.729534] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:54.754348] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-28T02:46:54.754479] [INFO ] [MAIN ] ASAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:54.754796] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-28T02:46:54.755724] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ASAN took 1.1s. Estimated remaining: 10m 28s. Rate: 211.9 symbols/min [2025-09-28T02:46:54.755063] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-28T02:46:54.761787] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ARX took 1.7s. Estimated remaining: 10m 24s. Rate: 213.3 symbols/min [2025-09-28T02:46:54.856027] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-28T02:46:54.893669] [INFO ] [MAIN ] ASBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:54.940279] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASBA took 0.6s. Estimated remaining: 10m 22s. Rate: 213.8 symbols/min [2025-09-28T02:46:55.226719] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:55.328017] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:55.381042] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:55.383394] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-28T02:46:55.386025] [INFO ] [MAIN ] ASB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:55.386696] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASB took 1.0s. Estimated remaining: 10m 24s. Rate: 213.0 symbols/min [2025-09-28T02:46:55.536433] [DEBUG] [LOCAL ] ASG: Loaded 20695 existing records from primary storage. [2025-09-28T02:46:55.588517] [INFO ] [MAIN ] ASG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:55.616970] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-28T02:46:55.629721] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASG took 0.9s. Estimated remaining: 10m 23s. Rate: 213.2 symbols/min [2025-09-28T02:46:55.630859] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:55.631108] [INFO ] [MAIN ] ASGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:55.632354] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASGI took 0.6s. Estimated remaining: 10m 19s. Rate: 214.5 symbols/min [2025-09-28T02:46:55.633634] [DEBUG] [LOCAL ] ASC: Loaded 38153 existing records from primary storage. [2025-09-28T02:46:55.634397] [INFO ] [MAIN ] ASC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:55.634496] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASC took 0.9s. Estimated remaining: 10m 15s. Rate: 215.9 symbols/min [2025-09-28T02:46:55.683773] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-28T02:46:55.684161] [INFO ] [MAIN ] ASGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:55.684272] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 0.3s. Estimated remaining: 10m 11s. Rate: 217.0 symbols/min [2025-09-28T02:46:56.290791] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:56.419148] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:56.424098] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:56.464382] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:56.496294] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-28T02:46:56.503981] [INFO ] [MAIN ] ASR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:56.506003] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 0.8s. Estimated remaining: 10m 19s. Rate: 214.4 symbols/min [2025-09-28T02:46:56.551227] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-28T02:46:56.610436] [INFO ] [MAIN ] ASIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:56.647149] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-28T02:46:56.690046] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-28T02:46:56.712258] [INFO ] [MAIN ] ASH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:56.715347] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 1.0s. Estimated remaining: 10m 17s. Rate: 214.7 symbols/min [2025-09-28T02:46:56.742505] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:56.750347] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASH took 1.1s. Estimated remaining: 10m 14s. Rate: 215.9 symbols/min [2025-09-28T02:46:56.742774] [INFO ] [MAIN ] ASPN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:56.762269] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 1.1s. Estimated remaining: 10m 10s. Rate: 217.1 symbols/min [2025-09-28T02:46:57.327143] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:57.299012] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:57.347131] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:57.373532] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-28T02:46:57.374492] [INFO ] [MAIN ] ASX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:57.375030] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASX took 0.9s. Estimated remaining: 10m 14s. Rate: 215.5 symbols/min [2025-09-28T02:46:57.581083] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-28T02:46:57.619823] [INFO ] [MAIN ] ATHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:57.639602] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-28T02:46:57.642403] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-28T02:46:57.641486] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:57.642779] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATHM took 0.9s. Estimated remaining: 10m 14s. Rate: 215.6 symbols/min [2025-09-28T02:46:57.643585] [INFO ] [MAIN ] ATEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:57.657396] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATEN took 0.9s. Estimated remaining: 10m 10s. Rate: 216.8 symbols/min [2025-09-28T02:46:57.649097] [INFO ] [MAIN ] ATGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:57.678001] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATGE took 0.9s. Estimated remaining: 10m 6s. Rate: 218.0 symbols/min [2025-09-28T02:46:57.876188] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-28T02:46:57.996458] [INFO ] [MAIN ] ATHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:58.086308] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 0.7s. Estimated remaining: 10m 8s. Rate: 217.4 symbols/min [2025-09-28T02:46:58.126206] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:58.152800] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:58.312257] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:58.418862] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:58.495258] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-28T02:46:58.496574] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-28T02:46:58.497452] [INFO ] [MAIN ] ATI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:58.498287] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATI took 0.9s. Estimated remaining: 10m 9s. Rate: 216.8 symbols/min [2025-09-28T02:46:58.498431] [INFO ] [MAIN ] ATKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:58.522180] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 0.8s. Estimated remaining: 10m 6s. Rate: 217.9 symbols/min [2025-09-28T02:46:58.694278] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-28T02:46:58.726001] [INFO ] [MAIN ] ATMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:58.801509] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATMU took 1.1s. Estimated remaining: 10m 5s. Rate: 217.9 symbols/min [2025-09-28T02:46:58.803794] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-28T02:46:58.851811] [INFO ] [MAIN ] ATO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:58.854137] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:58.887967] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATO took 0.7s. Estimated remaining: 10m 3s. Rate: 218.8 symbols/min [2025-09-28T02:46:59.057278] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:59.311923] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-28T02:46:59.330810] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:59.336854] [INFO ] [MAIN ] ATR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:59.310512] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:59.337289] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATR took 0.8s. Estimated remaining: 10m 5s. Rate: 218.0 symbols/min [2025-09-28T02:46:59.439687] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-28T02:46:59.460515] [INFO ] [MAIN ] ATS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:59.460998] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 0.9s. Estimated remaining: 10m 3s. Rate: 218.7 symbols/min [2025-09-28T02:46:59.655383] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:59.736359] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-28T02:46:59.770202] [INFO ] [MAIN ] ATUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:59.802014] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 1.0s. Estimated remaining: 10m 3s. Rate: 218.4 symbols/min [2025-09-28T02:46:59.806955] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:46:59.852165] [DEBUG] [LOCAL ] AU: Loaded 53715 existing records from primary storage. [2025-09-28T02:46:59.886280] [INFO ] [MAIN ] AU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:46:59.910042] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AU took 1.0s. Estimated remaining: 10m 1s. Rate: 219.1 symbols/min [2025-09-28T02:46:59.966924] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-28T02:47:00.006412] [INFO ] [MAIN ] AUNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:00.056522] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AUNA took 0.6s. Estimated remaining: 9m 59s. Rate: 219.7 symbols/min [2025-09-28T02:47:00.180018] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:00.226087] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-28T02:47:00.304272] [INFO ] [MAIN ] AUB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:00.378518] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:00.376511] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AUB took 1.0s. Estimated remaining: 9m 59s. Rate: 219.5 symbols/min [2025-09-28T02:47:00.463253] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:00.611712] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-28T02:47:00.678446] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-28T02:47:00.664689] [INFO ] [MAIN ] AVAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:00.688462] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVAL took 0.8s. Estimated remaining: 9m 59s. Rate: 219.3 symbols/min [2025-09-28T02:47:00.704502] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:00.753303] [INFO ] [MAIN ] AVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:00.770064] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-28T02:47:00.764768] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 1.0s. Estimated remaining: 9m 57s. Rate: 220.2 symbols/min [2025-09-28T02:47:00.799796] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-28T02:47:00.829528] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-28T02:47:00.857414] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-28T02:47:00.878805] [INFO ] [MAIN ] AVB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:00.862852] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-28T02:47:00.906077] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVB took 0.8s. Estimated remaining: 9m 55s. Rate: 220.8 symbols/min [2025-09-28T02:47:00.953211] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-28T02:47:01.040755] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-28T02:47:01.188721] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:01.340814] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:01.460138] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:01.608157] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-28T02:47:01.649950] [INFO ] [MAIN ] AVD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:01.650280] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVD took 0.9s. Estimated remaining: 10m 0s. Rate: 218.7 symbols/min [2025-09-28T02:47:01.770502] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-28T02:47:01.894244] [INFO ] [MAIN ] AVK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:01.895892] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-28T02:47:01.912348] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVK took 1.1s. Estimated remaining: 9m 60s. Rate: 218.7 symbols/min [2025-09-28T02:47:01.986502] [INFO ] [MAIN ] AVNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:02.062685] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVNS took 1.2s. Estimated remaining: 9m 58s. Rate: 219.3 symbols/min [2025-09-28T02:47:02.124934] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:02.112895] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:02.194447] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-28T02:47:02.398057] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:02.466906] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:02.496208] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:47:02.499221] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-28T02:47:02.499355] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:47:02.500027] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-09-28T02:47:02.501427] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-28T02:47:02.501722] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:47:02.501920] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-28T02:47:02.502059] [INFO ] [MAIN ] AVNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:02.502466] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-28T02:47:02.502687] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNT took 0.8s. Estimated remaining: 9m 60s. Rate: 218.6 symbols/min [2025-09-28T02:47:02.508075] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-28T02:47:02.508479] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-28T02:47:02.514958] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVBC took 2.1s. Estimated remaining: 9m 56s. Rate: 219.7 symbols/min [2025-09-28T02:47:02.907242] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-28T02:47:02.909056] [DEBUG] [LOCAL ] AVY: Loaded 38102 existing records from primary storage. [2025-09-28T02:47:02.930856] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:02.932754] [INFO ] [MAIN ] AVY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:02.955906] [INFO ] [MAIN ] AVTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:02.955417] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:02.956405] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVY took 0.8s. Estimated remaining: 9m 58s. Rate: 219.0 symbols/min [2025-09-28T02:47:02.959357] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVTR took 1.0s. Estimated remaining: 9m 55s. Rate: 220.1 symbols/min [2025-09-28T02:47:03.255851] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-28T02:47:03.285984] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-28T02:47:03.320725] [INFO ] [MAIN ] AWF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:03.321093] [INFO ] [MAIN ] AWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:03.327887] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 0.8s. Estimated remaining: 9m 56s. Rate: 219.7 symbols/min [2025-09-28T02:47:03.364408] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:03.375002] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 0.8s. Estimated remaining: 9m 53s. Rate: 220.7 symbols/min [2025-09-28T02:47:03.414793] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:03.673298] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-28T02:47:03.735797] [INFO ] [MAIN ] AWP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:03.771366] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 0.8s. Estimated remaining: 9m 54s. Rate: 220.1 symbols/min [2025-09-28T02:47:03.812970] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:03.846507] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:04.013929] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-28T02:47:04.014530] [INFO ] [MAIN ] AWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:04.015203] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWK took 1.1s. Estimated remaining: 9m 53s. Rate: 220.3 symbols/min [2025-09-28T02:47:04.103759] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:04.104297] [DEBUG] [LOCAL ] AWR: Loaded 22993 existing records from primary storage. [2025-09-28T02:47:04.177858] [INFO ] [MAIN ] AWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:04.182479] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-28T02:47:04.182626] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWR took 0.8s. Estimated remaining: 9m 52s. Rate: 220.7 symbols/min [2025-09-28T02:47:04.220937] [INFO ] [MAIN ] AX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:04.310813] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 0.9s. Estimated remaining: 9m 50s. Rate: 221.3 symbols/min [2025-09-28T02:47:04.371967] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:04.584431] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:04.681571] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:04.683536] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-28T02:47:04.684889] [INFO ] [MAIN ] AXL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:04.685364] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 0.9s. Estimated remaining: 9m 51s. Rate: 220.9 symbols/min [2025-09-28T02:47:04.716954] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-28T02:47:04.778828] [INFO ] [MAIN ] AXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:04.817384] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 0.6s. Estimated remaining: 9m 49s. Rate: 221.5 symbols/min [2025-09-28T02:47:04.842120] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-28T02:47:04.843019] [INFO ] [MAIN ] AXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:04.844112] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 0.8s. Estimated remaining: 9m 46s. Rate: 222.5 symbols/min [2025-09-28T02:47:04.942369] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:04.962469] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-28T02:47:04.963089] [INFO ] [MAIN ] AXS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:04.963239] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXS took 0.6s. Estimated remaining: 9m 44s. Rate: 223.1 symbols/min [2025-09-28T02:47:05.014820] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-28T02:47:05.015205] [INFO ] [MAIN ] AXTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:05.015740] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 0.3s. Estimated remaining: 9m 42s. Rate: 224.0 symbols/min [2025-09-28T02:47:05.601430] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:05.731593] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:05.777827] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:05.743689] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-28T02:47:05.809571] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-28T02:47:05.817023] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-28T02:47:05.816907] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:05.820509] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-28T02:47:05.823058] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-28T02:47:05.824770] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-28T02:47:05.965076] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-28T02:47:05.972679] [INFO ] [MAIN ] AZO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:06.026469] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-28T02:47:05.996450] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. AZO took 1.0s. Estimated remaining: 9m 49s. Rate: 221.1 symbols/min [2025-09-28T02:47:06.045436] [INFO ] [MAIN ] AZZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:06.122031] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZZ took 1.1s. Estimated remaining: 9m 47s. Rate: 221.7 symbols/min [2025-09-28T02:47:06.100583] [DEBUG] [LOCAL ] AYI: Loaded 25446 existing records from primary storage. [2025-09-28T02:47:06.279056] [INFO ] [MAIN ] AYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:06.342977] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AYI took 1.3s. Estimated remaining: 9m 46s. Rate: 221.9 symbols/min [2025-09-28T02:47:06.528951] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:06.673884] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:06.674337] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-28T02:47:06.855079] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:06.914887] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:06.959300] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-28T02:47:06.960154] [INFO ] [MAIN ] BA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:06.960922] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. BA took 0.9s. Estimated remaining: 9m 50s. Rate: 220.5 symbols/min [2025-09-28T02:47:07.206861] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-28T02:47:07.213804] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-28T02:47:07.237419] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:07.238471] [INFO ] [MAIN ] BAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:07.239239] [INFO ] [MAIN ] BABA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:07.239038] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BAC took 0.8s. Estimated remaining: 9m 50s. Rate: 220.4 symbols/min [2025-09-28T02:47:07.242202] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BABA took 1.0s. Estimated remaining: 9m 46s. Rate: 221.5 symbols/min [2025-09-28T02:47:07.587804] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:07.660507] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:07.698055] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-28T02:47:07.698817] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-28T02:47:07.707621] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-28T02:47:07.707868] [INFO ] [MAIN ] BAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:07.709983] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAH took 0.7s. Estimated remaining: 9m 48s. Rate: 220.7 symbols/min [2025-09-28T02:47:07.957254] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:07.957590] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-28T02:47:07.957704] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-28T02:47:07.957913] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-28T02:47:07.958018] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-28T02:47:07.958114] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-28T02:47:07.958217] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-28T02:47:07.960211] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-28T02:47:07.996462] [INFO ] [MAIN ] BAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:08.035529] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAK took 0.8s. Estimated remaining: 9m 49s. Rate: 220.5 symbols/min [2025-09-28T02:47:08.102487] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-28T02:47:08.157466] [INFO ] [MAIN ] BALL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:08.198914] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BALL took 0.9s. Estimated remaining: 9m 47s. Rate: 220.9 symbols/min [2025-09-28T02:47:08.685617] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:08.733639] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:08.809549] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:08.810192] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-28T02:47:08.908868] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-28T02:47:08.911096] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-28T02:47:08.911809] [INFO ] [MAIN ] BAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:08.911983] [INFO ] [MAIN ] BANC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:08.912522] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BAM took 0.8s. Estimated remaining: 9m 51s. Rate: 219.2 symbols/min [2025-09-28T02:47:08.918704] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BANC took 0.7s. Estimated remaining: 9m 48s. Rate: 220.3 symbols/min [2025-09-28T02:47:09.248018] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:09.300951] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:09.342418] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-28T02:47:09.342786] [INFO ] [MAIN ] BAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:09.342959] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BAP took 0.4s. Estimated remaining: 9m 50s. Rate: 219.7 symbols/min [2025-09-28T02:47:09.490842] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-28T02:47:09.495033] [INFO ] [MAIN ] BARK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:09.496329] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BARK took 0.5s. Estimated remaining: 9m 48s. Rate: 220.1 symbols/min [2025-09-28T02:47:09.495679] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-28T02:47:09.523447] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-28T02:47:09.638264] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:09.777275] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:09.827253] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-28T02:47:09.827824] [INFO ] [MAIN ] BAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:09.828444] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAX took 0.5s. Estimated remaining: 9m 48s. Rate: 219.9 symbols/min [2025-09-28T02:47:09.997895] [DEBUG] [LOCAL ] BB: Loaded 53701 existing records from primary storage. [2025-09-28T02:47:10.041410] [INFO ] [MAIN ] BB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:10.043512] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BB took 0.5s. Estimated remaining: 9m 48s. Rate: 220.1 symbols/min [2025-09-28T02:47:10.070435] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:10.255268] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:10.316314] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-28T02:47:10.317001] [INFO ] [MAIN ] BBAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:10.317522] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BBAI took 0.5s. Estimated remaining: 9m 47s. Rate: 220.1 symbols/min [2025-09-28T02:47:10.446431] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-28T02:47:10.473843] [INFO ] [MAIN ] BBAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:10.489040] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BBAR took 0.4s. Estimated remaining: 9m 46s. Rate: 220.5 symbols/min [2025-09-28T02:47:10.511885] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-28T02:47:10.592410] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:10.626904] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (2.92 seconds). [2025-09-28T02:47:10.637785] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-28T02:47:10.670232] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-28T02:47:10.785308] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:10.833311] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-28T02:47:10.833835] [INFO ] [MAIN ] BBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:10.834773] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBD took 0.5s. Estimated remaining: 9m 47s. Rate: 220.2 symbols/min [2025-09-28T02:47:10.868151] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:47:10.901779] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-28T02:47:10.902113] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:47:10.927115] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-09-28T02:47:10.962472] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-28T02:47:10.962707] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:47:10.987225] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-28T02:47:10.988297] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-28T02:47:11.005494] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-28T02:47:11.021853] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-28T02:47:11.006010] [INFO ] [MAIN ] BBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:11.059516] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:11.060538] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBDC took 0.5s. Estimated remaining: 9m 46s. Rate: 220.4 symbols/min [2025-09-28T02:47:11.059609] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-28T02:47:11.074714] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-28T02:47:11.111137] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. B took 6.1s. Estimated remaining: 9m 43s. Rate: 221.2 symbols/min [2025-09-28T02:47:11.192201] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-28T02:47:11.197695] [INFO ] [MAIN ] BBDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:11.215973] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBDO took 0.4s. Estimated remaining: 9m 41s. Rate: 221.8 symbols/min [2025-09-28T02:47:11.548801] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:11.601189] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:11.614331] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-28T02:47:11.651476] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-28T02:47:11.667001] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-28T02:47:11.651152] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-28T02:47:11.667223] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-28T02:47:11.715831] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:11.716093] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-28T02:47:11.716570] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-28T02:47:11.717792] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-28T02:47:11.771853] [DEBUG] [LOCAL ] BBN: Loaded 18193 existing records from primary storage. [2025-09-28T02:47:11.807292] [INFO ] [MAIN ] BBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:11.818144] [DEBUG] [LOCAL ] BBU: Loaded 4478 existing records from primary storage. [2025-09-28T02:47:11.831726] [INFO ] [MAIN ] BBU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:11.831949] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBN took 0.8s. Estimated remaining: 9m 45s. Rate: 220.6 symbols/min [2025-09-28T02:47:11.855688] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBU took 0.6s. Estimated remaining: 9m 42s. Rate: 221.5 symbols/min [2025-09-28T02:47:12.408436] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:12.446528] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-28T02:47:12.510412] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:12.464260] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-28T02:47:12.592978] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:12.602081] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-28T02:47:12.602487] [DEBUG] [LOCAL ] BBUC: Loaded 13503 existing records from primary storage. [2025-09-28T02:47:12.605291] [INFO ] [MAIN ] BBUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:12.605456] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBUC took 0.8s. Estimated remaining: 9m 46s. Rate: 219.7 symbols/min [2025-09-28T02:47:12.812391] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:12.813302] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:47:12.832875] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-28T02:47:12.834179] [DEBUG] [LOCAL ] BBVA: Loaded 50167 existing records from primary storage. [2025-09-28T02:47:12.834350] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:47:12.834833] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-09-28T02:47:12.834784] [INFO ] [MAIN ] BBVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:12.834942] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:47:12.835191] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-28T02:47:12.835553] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBVA took 1.0s. Estimated remaining: 9m 46s. Rate: 219.9 symbols/min [2025-09-28T02:47:12.841204] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-28T02:47:12.859150] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-28T02:47:12.890388] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-28T02:47:12.944128] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBT took 1.8s. Estimated remaining: 9m 44s. Rate: 220.5 symbols/min [2025-09-28T02:47:13.165301] [DEBUG] [LOCAL ] BBW: Loaded 27177 existing records from primary storage. [2025-09-28T02:47:13.186190] [INFO ] [MAIN ] BBW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:13.177092] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:13.186436] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBW took 0.6s. Estimated remaining: 9m 43s. Rate: 220.6 symbols/min [2025-09-28T02:47:13.189952] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-28T02:47:13.274456] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-28T02:47:13.329978] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:13.479428] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:13.523480] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-09-28T02:47:13.524310] [INFO ] [MAIN ] BBWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:13.543029] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBWI took 0.7s. Estimated remaining: 9m 44s. Rate: 220.3 symbols/min [2025-09-28T02:47:13.704102] [DEBUG] [LOCAL ] BBY: Loaded 54253 existing records from primary storage. [2025-09-28T02:47:13.705592] [INFO ] [MAIN ] BBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:13.749210] [DEBUG] [LOCAL ] BC: Loaded 45020 existing records from primary storage. [2025-09-28T02:47:13.742439] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBY took 0.8s. Estimated remaining: 9m 43s. Rate: 220.5 symbols/min [2025-09-28T02:47:13.821697] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:13.812398] [INFO ] [MAIN ] BC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:13.859504] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BC took 0.7s. Estimated remaining: 9m 41s. Rate: 221.1 symbols/min [2025-09-28T02:47:13.990153] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-28T02:47:14.090697] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-28T02:47:14.132305] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:14.246430] [DEBUG] [LOCAL ] BCAT: Loaded 34910 existing records from primary storage. [2025-09-28T02:47:14.267953] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:14.268718] [INFO ] [MAIN ] BCAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:14.269820] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BCAT took 0.7s. Estimated remaining: 9m 42s. Rate: 220.6 symbols/min [2025-09-28T02:47:14.428255] [DEBUG] [LOCAL ] BCC: Loaded 28735 existing records from primary storage. [2025-09-28T02:47:14.440280] [INFO ] [MAIN ] BCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:14.489206] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCC took 0.7s. Estimated remaining: 9m 41s. Rate: 220.8 symbols/min [2025-09-28T02:47:14.494252] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:14.670742] [DEBUG] [LOCAL ] BCE: Loaded 53072 existing records from primary storage. [2025-09-28T02:47:14.742515] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:14.743125] [INFO ] [MAIN ] BCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:14.743936] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCE took 0.8s. Estimated remaining: 9m 41s. Rate: 220.9 symbols/min [2025-09-28T02:47:14.817109] [DEBUG] [LOCAL ] BCH: Loaded 30039 existing records from primary storage. [2025-09-28T02:47:14.784869] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-28T02:47:14.828966] [INFO ] [MAIN ] BCH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:14.843179] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-28T02:47:14.842583] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCH took 0.6s. Estimated remaining: 9m 39s. Rate: 221.5 symbols/min [2025-09-28T02:47:14.972107] [DEBUG] [LOCAL ] BCO: Loaded 26740 existing records from primary storage. [2025-09-28T02:47:14.994505] [INFO ] [MAIN ] BCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:14.999918] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCO took 0.5s. Estimated remaining: 9m 38s. Rate: 221.8 symbols/min [2025-09-28T02:47:15.185864] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:15.460535] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:15.462452] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:15.463137] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-28T02:47:15.467874] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-28T02:47:15.542079] [DEBUG] [LOCAL ] BCS: Loaded 54242 existing records from primary storage. [2025-09-28T02:47:15.539953] [DEBUG] [LOCAL ] BCX: Loaded 21920 existing records from primary storage. [2025-09-28T02:47:15.542926] [INFO ] [MAIN ] BCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:15.542834] [INFO ] [MAIN ] BCX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:15.544103] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCS took 0.8s. Estimated remaining: 9m 40s. Rate: 220.9 symbols/min [2025-09-28T02:47:15.549820] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCX took 0.5s. Estimated remaining: 9m 37s. Rate: 221.8 symbols/min [2025-09-28T02:47:15.627058] [DEBUG] [LOCAL ] BCSF: Loaded 28231 existing records from primary storage. [2025-09-28T02:47:15.663059] [INFO ] [MAIN ] BCSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:15.665858] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCSF took 0.8s. Estimated remaining: 9m 36s. Rate: 222.4 symbols/min [2025-09-28T02:47:15.739979] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:15.772958] [DEBUG] [LOCAL ] BDC: Loaded 25073 existing records from primary storage. [2025-09-28T02:47:15.773409] [INFO ] [MAIN ] BDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:15.773521] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BDC took 0.2s. Estimated remaining: 9m 34s. Rate: 222.9 symbols/min [2025-09-28T02:47:15.843313] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-28T02:47:15.846165] [INFO ] [REMOTE ] BALY: Full fetch complete (17169 records). [2025-09-28T02:47:15.846301] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-28T02:47:16.051064] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:47:16.051454] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:47:16.051533] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:47:16.051631] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-28T02:47:16.051774] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-28T02:47:16.051867] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-28T02:47:16.051975] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-28T02:47:16.052087] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BALY took 8.3s. Estimated remaining: 9m 34s. Rate: 222.9 symbols/min [2025-09-28T02:47:16.659002] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:16.777617] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:16.894358] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:16.930774] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:16.985710] [DEBUG] [LOCAL ] BDJ: Loaded 29325 existing records from primary storage. [2025-09-28T02:47:16.986616] [INFO ] [MAIN ] BDJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:16.986776] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 0.9s. Estimated remaining: 9m 39s. Rate: 220.6 symbols/min [2025-09-28T02:47:17.130043] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-28T02:47:17.175459] [INFO ] [MAIN ] BE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:17.195826] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BE took 1.1s. Estimated remaining: 9m 38s. Rate: 220.8 symbols/min [2025-09-28T02:47:17.213260] [DEBUG] [LOCAL ] BDN: Loaded 48230 existing records from primary storage. [2025-09-28T02:47:17.219814] [DEBUG] [LOCAL ] BDX: Loaded 53191 existing records from primary storage. [2025-09-28T02:47:17.236729] [INFO ] [MAIN ] BDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:17.242374] [INFO ] [MAIN ] BDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:17.269865] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDN took 1.2s. Estimated remaining: 9m 36s. Rate: 221.5 symbols/min [2025-09-28T02:47:17.371402] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BDX took 1.2s. Estimated remaining: 9m 35s. Rate: 222.1 symbols/min [2025-09-28T02:47:17.418898] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:17.556627] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-28T02:47:17.648155] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-28T02:47:17.700802] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:17.711454] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-28T02:47:17.799776] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-28T02:47:17.813912] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:17.867355] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-28T02:47:17.875671] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:17.876403] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-28T02:47:18.220490] [DEBUG] [LOCAL ] BEKE: Loaded 54025 existing records from primary storage. [2025-09-28T02:47:18.242427] [INFO ] [MAIN ] BEKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:18.243898] [DEBUG] [LOCAL ] BEP: Loaded 39244 existing records from primary storage. [2025-09-28T02:47:18.255265] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEKE took 1.1s. Estimated remaining: 9m 40s. Rate: 220.0 symbols/min [2025-09-28T02:47:18.306015] [INFO ] [MAIN ] BEP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:18.346388] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEP took 0.9s. Estimated remaining: 9m 38s. Rate: 220.6 symbols/min [2025-09-28T02:47:18.378744] [DEBUG] [LOCAL ] BEN: Loaded 53833 existing records from primary storage. [2025-09-28T02:47:18.415628] [INFO ] [MAIN ] BEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:18.505168] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEN took 1.1s. Estimated remaining: 9m 37s. Rate: 221.0 symbols/min [2025-09-28T02:47:18.686918] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:18.790102] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:18.782597] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-28T02:47:18.895892] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:18.977820] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:18.987293] [DEBUG] [LOCAL ] BEPH: Loaded 5208 existing records from primary storage. [2025-09-28T02:47:18.987977] [INFO ] [MAIN ] BEPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:18.989529] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEPH took 0.6s. Estimated remaining: 9m 38s. Rate: 220.3 symbols/min [2025-09-28T02:47:19.059194] [DEBUG] [LOCAL ] BEPI: Loaded 3487 existing records from primary storage. [2025-09-28T02:47:19.094050] [INFO ] [MAIN ] BEPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:19.099753] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPI took 0.5s. Estimated remaining: 9m 37s. Rate: 220.8 symbols/min [2025-09-28T02:47:19.188773] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-28T02:47:19.292199] [DEBUG] [LOCAL ] BEPC: Loaded 47209 existing records from primary storage. [2025-09-28T02:47:19.289467] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:19.309716] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-28T02:47:19.315177] [INFO ] [MAIN ] BEPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:19.351592] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPC took 1.1s. Estimated remaining: 9m 36s. Rate: 220.9 symbols/min [2025-09-28T02:47:19.423459] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:19.395931] [DEBUG] [LOCAL ] BEPJ: Loaded 3268 existing records from primary storage. [2025-09-28T02:47:19.473257] [INFO ] [MAIN ] BEPJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:19.488323] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPJ took 0.5s. Estimated remaining: 9m 35s. Rate: 221.3 symbols/min [2025-09-28T02:47:19.564177] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-28T02:47:19.606539] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-28T02:47:19.699955] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:19.812099] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:19.840840] [DEBUG] [LOCAL ] BFAM: Loaded 33519 existing records from primary storage. [2025-09-28T02:47:19.841779] [INFO ] [MAIN ] BFAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:19.845503] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BFAM took 0.7s. Estimated remaining: 9m 35s. Rate: 221.0 symbols/min [2025-09-28T02:47:19.912966] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-28T02:47:19.949634] [DEBUG] [LOCAL ] BFK: Loaded 14145 existing records from primary storage. [2025-09-28T02:47:19.982575] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-28T02:47:20.005355] [DEBUG] [LOCAL ] BFH: Loaded 42308 existing records from primary storage. [2025-09-28T02:47:20.006513] [INFO ] [MAIN ] BFK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:20.025754] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFK took 0.5s. Estimated remaining: 9m 34s. Rate: 221.3 symbols/min [2025-09-28T02:47:20.036813] [INFO ] [MAIN ] BFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:20.127931] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:20.134300] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFH took 0.7s. Estimated remaining: 9m 33s. Rate: 221.9 symbols/min [2025-09-28T02:47:20.375593] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-28T02:47:20.498430] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:20.506634] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-28T02:47:20.578273] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:20.600246] [DEBUG] [LOCAL ] BFLY: Loaded 52590 existing records from primary storage. [2025-09-28T02:47:20.604122] [INFO ] [MAIN ] BFLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:20.604700] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFLY took 0.8s. Estimated remaining: 9m 34s. Rate: 221.2 symbols/min [2025-09-28T02:47:20.633536] [DEBUG] [LOCAL ] BFS: Loaded 9240 existing records from primary storage. [2025-09-28T02:47:20.654738] [INFO ] [MAIN ] BFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:20.660334] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFS took 0.6s. Estimated remaining: 9m 32s. Rate: 221.9 symbols/min [2025-09-28T02:47:20.787323] [DEBUG] [LOCAL ] BFZ: Loaded 12223 existing records from primary storage. [2025-09-28T02:47:20.852591] [INFO ] [MAIN ] BFZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:20.945556] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-28T02:47:20.966624] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:20.876481] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFZ took 0.7s. Estimated remaining: 9m 31s. Rate: 222.1 symbols/min [2025-09-28T02:47:20.968777] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-28T02:47:21.137716] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:21.274905] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:21.304507] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-28T02:47:21.305608] [DEBUG] [LOCAL ] BGB: Loaded 17621 existing records from primary storage. [2025-09-28T02:47:21.307998] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-28T02:47:21.308823] [INFO ] [MAIN ] BGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:21.310273] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BGB took 0.6s. Estimated remaining: 9m 32s. Rate: 221.6 symbols/min [2025-09-28T02:47:21.453714] [DEBUG] [LOCAL ] BG: Loaded 51118 existing records from primary storage. [2025-09-28T02:47:21.473950] [INFO ] [MAIN ] BG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:21.512491] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BG took 0.9s. Estimated remaining: 9m 31s. Rate: 221.8 symbols/min [2025-09-28T02:47:21.473635] [DEBUG] [LOCAL ] BGH: Loaded 16728 existing records from primary storage. [2025-09-28T02:47:21.528151] [INFO ] [MAIN ] BGH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:21.555599] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGH took 0.6s. Estimated remaining: 9m 29s. Rate: 222.5 symbols/min [2025-09-28T02:47:21.592124] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-28T02:47:21.604723] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-28T02:47:21.575471] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:21.888199] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-28T02:47:21.867768] [DEBUG] [LOCAL ] BGR: Loaded 13658 existing records from primary storage. [2025-09-28T02:47:21.914275] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-28T02:47:21.966055] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:21.960599] [INFO ] [MAIN ] BGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:21.985801] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:21.986612] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGR took 0.7s. Estimated remaining: 9m 30s. Rate: 222.0 symbols/min [2025-09-28T02:47:22.114145] [DEBUG] [LOCAL ] BGSF: Loaded 7050 existing records from primary storage. [2025-09-28T02:47:22.145689] [INFO ] [MAIN ] BGSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:22.145917] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGSF took 0.6s. Estimated remaining: 9m 29s. Rate: 222.3 symbols/min [2025-09-28T02:47:22.139849] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-28T02:47:22.187162] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-28T02:47:22.318047] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:22.392191] [DEBUG] [LOCAL ] BGS: Loaded 51183 existing records from primary storage. [2025-09-28T02:47:22.427348] [INFO ] [MAIN ] BGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:22.445611] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGS took 0.9s. Estimated remaining: 9m 29s. Rate: 222.2 symbols/min [2025-09-28T02:47:22.449706] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:22.548176] [DEBUG] [LOCAL ] BGT: Loaded 16793 existing records from primary storage. [2025-09-28T02:47:22.569734] [INFO ] [MAIN ] BGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:22.579054] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGT took 0.6s. Estimated remaining: 9m 28s. Rate: 222.7 symbols/min [2025-09-28T02:47:22.708978] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-28T02:47:22.711546] [DEBUG] [LOCAL ] BGX: Loaded 10900 existing records from primary storage. [2025-09-28T02:47:22.766312] [INFO ] [REMOTE ] BEDU: Full fetch complete (1429 records). [2025-09-28T02:47:22.799014] [INFO ] [MAIN ] BGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:22.795862] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-28T02:47:22.801439] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:22.808267] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGX took 0.6s. Estimated remaining: 9m 27s. Rate: 222.8 symbols/min [2025-09-28T02:47:23.058906] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:23.186614] [DEBUG] [LOCAL ] BGY: Loaded 22790 existing records from primary storage. [2025-09-28T02:47:23.269623] [INFO ] [MAIN ] BGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:23.344836] [DEBUG] [LOCAL ] BH: Loaded 15938 existing records from primary storage. [2025-09-28T02:47:23.312269] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:23.345495] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGY took 0.9s. Estimated remaining: 9m 29s. Rate: 222.0 symbols/min [2025-09-28T02:47:23.343466] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-28T02:47:23.346172] [INFO ] [MAIN ] BH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:23.347255] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:47:23.352752] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BH took 0.8s. Estimated remaining: 9m 27s. Rate: 222.8 symbols/min [2025-09-28T02:47:23.360234] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:47:23.429520] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-28T02:47:23.456030] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-28T02:47:23.505379] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-28T02:47:23.556229] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-28T02:47:23.573564] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BEDU took 6.6s. Estimated remaining: 9m 26s. Rate: 222.9 symbols/min [2025-09-28T02:47:23.774389] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:23.888362] [DEBUG] [LOCAL ] BHC: Loaded 47495 existing records from primary storage. [2025-09-28T02:47:23.971960] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:23.994046] [INFO ] [MAIN ] BHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:24.030264] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHC took 1.2s. Estimated remaining: 9m 27s. Rate: 222.4 symbols/min [2025-09-28T02:47:24.084603] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:24.148999] [DEBUG] [LOCAL ] BHE: Loaded 25353 existing records from primary storage. [2025-09-28T02:47:24.189001] [INFO ] [MAIN ] BHE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:24.207361] [DEBUG] [LOCAL ] BHK: Loaded 22922 existing records from primary storage. [2025-09-28T02:47:24.226170] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHE took 0.9s. Estimated remaining: 9m 26s. Rate: 222.6 symbols/min [2025-09-28T02:47:24.237984] [INFO ] [MAIN ] BHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:24.294842] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 0.9s. Estimated remaining: 9m 25s. Rate: 223.2 symbols/min [2025-09-28T02:47:24.394232] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:24.670691] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:24.672445] [DEBUG] [LOCAL ] BHP: Loaded 54153 existing records from primary storage. [2025-09-28T02:47:24.719205] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-28T02:47:24.703481] [INFO ] [MAIN ] BHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:24.725024] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-28T02:47:24.728069] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHP took 1.1s. Estimated remaining: 9m 26s. Rate: 222.7 symbols/min [2025-09-28T02:47:24.728395] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-28T02:47:24.746964] [DEBUG] [LOCAL ] BHR: Loaded 21771 existing records from primary storage. [2025-09-28T02:47:24.748219] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:24.791509] [INFO ] [MAIN ] BHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:24.769870] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-28T02:47:24.806232] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHR took 0.7s. Estimated remaining: 9m 24s. Rate: 223.3 symbols/min [2025-09-28T02:47:24.815908] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-28T02:47:24.838140] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-28T02:47:25.117797] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:25.379693] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:25.419740] [DEBUG] [LOCAL ] BHVN: Loaded 50401 existing records from primary storage. [2025-09-28T02:47:25.436185] [INFO ] [MAIN ] BHVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:25.467218] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHVN took 1.1s. Estimated remaining: 9m 27s. Rate: 222.1 symbols/min [2025-09-28T02:47:25.686985] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:25.699322] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-28T02:47:25.736049] [DEBUG] [LOCAL ] BILL: Loaded 53105 existing records from primary storage. [2025-09-28T02:47:25.734074] [DEBUG] [LOCAL ] BIO: Loaded 25533 existing records from primary storage. [2025-09-28T02:47:25.748721] [INFO ] [MAIN ] BIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:25.737276] [INFO ] [MAIN ] BILL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:25.787384] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BIO took 1.0s. Estimated remaining: 9m 27s. Rate: 221.9 symbols/min [2025-09-28T02:47:25.817883] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:25.823249] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BILL took 1.1s. Estimated remaining: 9m 25s. Rate: 222.6 symbols/min [2025-09-28T02:47:26.014728] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-28T02:47:26.063235] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-28T02:47:26.164489] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:26.284505] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:26.287064] [DEBUG] [LOCAL ] BIP: Loaded 40240 existing records from primary storage. [2025-09-28T02:47:26.288417] [INFO ] [MAIN ] BIP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:26.288608] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIP took 0.8s. Estimated remaining: 9m 26s. Rate: 222.1 symbols/min [2025-09-28T02:47:26.295748] [DEBUG] [LOCAL ] BIPH: Loaded 2632 existing records from primary storage. [2025-09-28T02:47:26.296175] [INFO ] [MAIN ] BIPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:26.296418] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIPH took 0.4s. Estimated remaining: 9m 24s. Rate: 222.8 symbols/min [2025-09-28T02:47:26.334982] [DEBUG] [LOCAL ] BIPC: Loaded 42317 existing records from primary storage. [2025-09-28T02:47:26.335631] [INFO ] [MAIN ] BIPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:26.336048] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIPC took 0.5s. Estimated remaining: 9m 22s. Rate: 223.5 symbols/min [2025-09-28T02:47:26.445736] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-28T02:47:26.447284] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-28T02:47:26.606592] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.16 seconds). [2025-09-28T02:47:26.607882] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-28T02:47:26.832267] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-28T02:47:26.833598] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-28T02:47:27.057565] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-28T02:47:27.059253] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-28T02:47:27.293771] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-28T02:47:27.295085] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-28T02:47:27.677312] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-28T02:47:27.678742] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-28T02:47:27.896126] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-28T02:47:27.897756] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-28T02:47:28.193119] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-28T02:47:28.194332] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-28T02:47:28.488480] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-28T02:47:28.489629] [INFO ] [REMOTE ] BHV: Full fetch complete (1368 records). [2025-09-28T02:47:28.489914] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-28T02:47:28.681606] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-28T02:47:28.681901] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:47:28.681995] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:47:28.682084] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-28T02:47:28.682235] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-28T02:47:28.682343] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-28T02:47:28.682471] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-28T02:47:28.682608] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BHV took 4.4s. Estimated remaining: 9m 37s. Rate: 217.5 symbols/min [2025-09-28T02:47:29.420960] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:29.364884] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:29.365841] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:29.425449] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:29.431891] [DEBUG] [LOCAL ] BIPJ: Loaded 3026 existing records from primary storage. [2025-09-28T02:47:29.433135] [INFO ] [MAIN ] BIPJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:29.433405] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 0.7s. Estimated remaining: 9m 40s. Rate: 216.2 symbols/min [2025-09-28T02:47:29.436200] [DEBUG] [LOCAL ] BIPI: Loaded 3282 existing records from primary storage. [2025-09-28T02:47:29.442684] [INFO ] [MAIN ] BIPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:29.475728] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPI took 0.8s. Estimated remaining: 9m 38s. Rate: 216.8 symbols/min [2025-09-28T02:47:29.704345] [DEBUG] [LOCAL ] BIT: Loaded 22765 existing records from primary storage. [2025-09-28T02:47:29.730124] [INFO ] [MAIN ] BIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:29.850537] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:29.885257] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:29.860399] [DEBUG] [LOCAL ] BIRK: Loaded 51674 existing records from primary storage. [2025-09-28T02:47:29.860512] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIT took 1.2s. Estimated remaining: 9m 39s. Rate: 216.5 symbols/min [2025-09-28T02:47:29.885925] [INFO ] [MAIN ] BIRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:29.911328] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 1.2s. Estimated remaining: 9m 37s. Rate: 217.2 symbols/min [2025-09-28T02:47:30.207133] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:30.299529] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:30.317438] [DEBUG] [LOCAL ] BK: Loaded 54319 existing records from primary storage. [2025-09-28T02:47:30.319546] [INFO ] [MAIN ] BK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:30.320340] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BK took 0.8s. Estimated remaining: 9m 37s. Rate: 216.8 symbols/min [2025-09-28T02:47:30.373807] [DEBUG] [LOCAL ] BJ: Loaded 52156 existing records from primary storage. [2025-09-28T02:47:30.416032] [INFO ] [MAIN ] BJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:30.460730] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BJ took 1.0s. Estimated remaining: 9m 36s. Rate: 217.2 symbols/min [2025-09-28T02:47:30.662453] [DEBUG] [LOCAL ] BKD: Loaded 50889 existing records from primary storage. [2025-09-28T02:47:30.660802] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:30.695728] [INFO ] [MAIN ] BKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:30.697001] [DEBUG] [LOCAL ] BKE: Loaded 35206 existing records from primary storage. [2025-09-28T02:47:30.720312] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKD took 0.8s. Estimated remaining: 9m 36s. Rate: 217.2 symbols/min [2025-09-28T02:47:30.756783] [INFO ] [MAIN ] BKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:30.788713] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:30.810730] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKE took 0.9s. Estimated remaining: 9m 34s. Rate: 217.7 symbols/min [2025-09-28T02:47:31.088335] [DEBUG] [LOCAL ] BKH: Loaded 37133 existing records from primary storage. [2025-09-28T02:47:31.109996] [INFO ] [MAIN ] BKH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:31.120751] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKH took 0.8s. Estimated remaining: 9m 34s. Rate: 217.6 symbols/min [2025-09-28T02:47:31.128449] [DEBUG] [LOCAL ] BKKT: Loaded 35164 existing records from primary storage. [2025-09-28T02:47:31.134799] [INFO ] [MAIN ] BKKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:31.155597] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:31.156441] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKKT took 0.7s. Estimated remaining: 9m 32s. Rate: 218.3 symbols/min [2025-09-28T02:47:31.326439] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:31.396743] [DEBUG] [LOCAL ] BKN: Loaded 7853 existing records from primary storage. [2025-09-28T02:47:31.471448] [INFO ] [MAIN ] BKN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:31.516464] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKN took 0.8s. Estimated remaining: 9m 32s. Rate: 218.1 symbols/min [2025-09-28T02:47:31.614483] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:31.696368] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:31.839993] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:31.862123] [DEBUG] [LOCAL ] BKT: Loaded 11125 existing records from primary storage. [2025-09-28T02:47:31.862417] [INFO ] [MAIN ] BKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:31.862745] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKT took 0.7s. Estimated remaining: 9m 33s. Rate: 217.9 symbols/min [2025-09-28T02:47:31.870474] [DEBUG] [LOCAL ] BKSY: Loaded 48993 existing records from primary storage. [2025-09-28T02:47:31.906101] [INFO ] [MAIN ] BKSY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:31.931447] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKSY took 1.1s. Estimated remaining: 9m 31s. Rate: 218.4 symbols/min [2025-09-28T02:47:32.102147] [DEBUG] [LOCAL ] BKV: Loaded 30278 existing records from primary storage. [2025-09-28T02:47:32.140541] [DEBUG] [LOCAL ] BKU: Loaded 42412 existing records from primary storage. [2025-09-28T02:47:32.151349] [INFO ] [MAIN ] BKV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:32.156892] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKV took 0.6s. Estimated remaining: 9m 30s. Rate: 218.6 symbols/min [2025-09-28T02:47:32.223436] [INFO ] [MAIN ] BKU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:32.290339] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:32.311483] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKU took 1.1s. Estimated remaining: 9m 29s. Rate: 218.9 symbols/min [2025-09-28T02:47:32.431172] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:32.711613] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:32.723016] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:32.750978] [DEBUG] [LOCAL ] BLD: Loaded 28408 existing records from primary storage. [2025-09-28T02:47:32.760031] [INFO ] [MAIN ] BLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:32.760253] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLD took 0.8s. Estimated remaining: 9m 30s. Rate: 218.4 symbols/min [2025-09-28T02:47:32.762082] [DEBUG] [LOCAL ] BLCO: Loaded 36110 existing records from primary storage. [2025-09-28T02:47:32.812949] [INFO ] [MAIN ] BLCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:32.837446] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLCO took 1.0s. Estimated remaining: 9m 28s. Rate: 218.9 symbols/min [2025-09-28T02:47:32.870367] [DEBUG] [LOCAL ] BLE: Loaded 14718 existing records from primary storage. [2025-09-28T02:47:32.939732] [INFO ] [MAIN ] BLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:33.049817] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 0.7s. Estimated remaining: 9m 28s. Rate: 219.1 symbols/min [2025-09-28T02:47:33.127730] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:33.245851] [DEBUG] [LOCAL ] BLDR: Loaded 52403 existing records from primary storage. [2025-09-28T02:47:33.295899] [INFO ] [MAIN ] BLDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:33.297740] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLDR took 1.1s. Estimated remaining: 9m 27s. Rate: 219.2 symbols/min [2025-09-28T02:47:33.377945] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:33.476607] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:33.503071] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-28T02:47:33.503403] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-28T02:47:33.503596] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-28T02:47:33.509035] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-28T02:47:33.509180] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-28T02:47:33.538536] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-28T02:47:33.635132] [DEBUG] [LOCAL ] BLK: Loaded 35240 existing records from primary storage. [2025-09-28T02:47:33.685870] [INFO ] [MAIN ] BLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:33.748761] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLK took 1.0s. Estimated remaining: 9m 28s. Rate: 218.7 symbols/min [2025-09-28T02:47:33.786505] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:33.972118] [DEBUG] [LOCAL ] BLND: Loaded 50107 existing records from primary storage. [2025-09-28T02:47:33.995782] [INFO ] [MAIN ] BLND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:34.071334] [DEBUG] [LOCAL ] BLW: Loaded 13044 existing records from primary storage. [2025-09-28T02:47:34.092571] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLND took 1.2s. Estimated remaining: 9m 28s. Rate: 218.5 symbols/min [2025-09-28T02:47:34.104026] [INFO ] [MAIN ] BLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:34.223005] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLW took 0.9s. Estimated remaining: 9m 27s. Rate: 218.9 symbols/min [2025-09-28T02:47:34.326957] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:34.610301] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:34.654991] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-28T02:47:34.658426] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:34.749605] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:34.759218] [DEBUG] [LOCAL ] BLX: Loaded 15880 existing records from primary storage. [2025-09-28T02:47:34.759740] [INFO ] [MAIN ] BLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:34.759904] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLX took 1.0s. Estimated remaining: 9m 29s. Rate: 218.2 symbols/min [2025-09-28T02:47:34.855118] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:47:34.897242] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-28T02:47:34.898475] [DEBUG] [LOCAL ] BME: Loaded 10968 existing records from primary storage. [2025-09-28T02:47:34.899087] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:47:34.906722] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-09-28T02:47:34.906989] [INFO ] [MAIN ] BME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:34.938725] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:47:34.956420] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BME took 0.7s. Estimated remaining: 9m 28s. Rate: 218.4 symbols/min [2025-09-28T02:47:34.968679] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-28T02:47:34.982708] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-28T02:47:34.995859] [DEBUG] [LOCAL ] BMA: Loaded 35645 existing records from primary storage. [2025-09-28T02:47:35.028259] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:35.023972] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-28T02:47:35.062041] [INFO ] [MAIN ] BMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:35.062223] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-28T02:47:35.066611] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 0.9s. Estimated remaining: 9m 26s. Rate: 218.8 symbols/min [2025-09-28T02:47:35.095574] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BLSH took 2.0s. Estimated remaining: 9m 25s. Rate: 219.5 symbols/min [2025-09-28T02:47:35.438881] [DEBUG] [LOCAL ] BMEZ: Loaded 26421 existing records from primary storage. [2025-09-28T02:47:35.479547] [INFO ] [MAIN ] BMEZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:35.486360] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:35.512810] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMEZ took 0.8s. Estimated remaining: 9m 25s. Rate: 219.1 symbols/min [2025-09-28T02:47:35.637544] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:35.673226] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:35.747700] [DEBUG] [LOCAL ] BMN: Loaded 2548 existing records from primary storage. [2025-09-28T02:47:35.755367] [INFO ] [MAIN ] BMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:35.755767] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMN took 0.7s. Estimated remaining: 9m 25s. Rate: 219.2 symbols/min [2025-09-28T02:47:35.931325] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:35.970878] [DEBUG] [LOCAL ] BMI: Loaded 24611 existing records from primary storage. [2025-09-28T02:47:35.975581] [INFO ] [MAIN ] BMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:36.035069] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMI took 1.1s. Estimated remaining: 9m 24s. Rate: 219.2 symbols/min [2025-09-28T02:47:36.042600] [DEBUG] [LOCAL ] BMO: Loaded 41940 existing records from primary storage. [2025-09-28T02:47:36.090902] [INFO ] [MAIN ] BMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:36.113013] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 1.0s. Estimated remaining: 9m 23s. Rate: 219.7 symbols/min [2025-09-28T02:47:36.090755] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:36.471456] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:36.514334] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:36.516281] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-28T02:47:36.517317] [INFO ] [MAIN ] BMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:36.518084] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 1.0s. Estimated remaining: 9m 24s. Rate: 219.3 symbols/min [2025-09-28T02:47:36.636621] [DEBUG] [LOCAL ] BNH: Loaded 4926 existing records from primary storage. [2025-09-28T02:47:36.658634] [INFO ] [MAIN ] BNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:36.670169] [DEBUG] [LOCAL ] BN: Loaded 53774 existing records from primary storage. [2025-09-28T02:47:36.686232] [INFO ] [MAIN ] BN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:36.680765] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BNH took 0.6s. Estimated remaining: 9m 23s. Rate: 219.6 symbols/min [2025-09-28T02:47:36.753480] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:36.797858] [DEBUG] [LOCAL ] BNED: Loaded 30226 existing records from primary storage. [2025-09-28T02:47:36.735170] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BN took 0.9s. Estimated remaining: 9m 21s. Rate: 220.2 symbols/min [2025-09-28T02:47:36.830737] [INFO ] [MAIN ] BNED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:36.895455] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNED took 0.8s. Estimated remaining: 9m 20s. Rate: 220.5 symbols/min [2025-09-28T02:47:36.931919] [DEBUG] [LOCAL ] BNJ: Loaded 2631 existing records from primary storage. [2025-09-28T02:47:36.943612] [INFO ] [MAIN ] BNJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:37.080346] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 0.6s. Estimated remaining: 9m 19s. Rate: 220.7 symbols/min [2025-09-28T02:47:37.122160] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:37.399597] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:37.424067] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:37.548845] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:37.552759] [DEBUG] [LOCAL ] BNT: Loaded 3473 existing records from primary storage. [2025-09-28T02:47:37.553227] [INFO ] [MAIN ] BNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:37.553955] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNT took 0.6s. Estimated remaining: 9m 20s. Rate: 220.2 symbols/min [2025-09-28T02:47:37.690808] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-28T02:47:37.696500] [DEBUG] [LOCAL ] BNL: Loaded 47577 existing records from primary storage. [2025-09-28T02:47:37.697462] [INFO ] [MAIN ] BNY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:37.703609] [INFO ] [MAIN ] BNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:37.703431] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNY took 0.5s. Estimated remaining: 9m 19s. Rate: 220.5 symbols/min [2025-09-28T02:47:37.734106] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNL took 1.0s. Estimated remaining: 9m 17s. Rate: 221.1 symbols/min [2025-09-28T02:47:37.817352] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:37.847927] [DEBUG] [LOCAL ] BNS: Loaded 52212 existing records from primary storage. [2025-09-28T02:47:37.848539] [INFO ] [MAIN ] BNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:37.849112] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNS took 1.0s. Estimated remaining: 9m 16s. Rate: 221.5 symbols/min [2025-09-28T02:47:37.857875] [DEBUG] [LOCAL ] BOC: Loaded 18626 existing records from primary storage. [2025-09-28T02:47:37.858124] [INFO ] [MAIN ] BOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:37.858224] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 0.3s. Estimated remaining: 9m 14s. Rate: 222.2 symbols/min [2025-09-28T02:47:38.539810] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:38.575405] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:38.580164] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:38.610141] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:38.641451] [DEBUG] [LOCAL ] BOE: Loaded 17816 existing records from primary storage. [2025-09-28T02:47:38.642394] [INFO ] [MAIN ] BOE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:38.642609] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOE took 0.8s. Estimated remaining: 9m 17s. Rate: 220.9 symbols/min [2025-09-28T02:47:38.778739] [DEBUG] [LOCAL ] BOH: Loaded 31676 existing records from primary storage. [2025-09-28T02:47:38.820147] [INFO ] [MAIN ] BOH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:38.884443] [DEBUG] [LOCAL ] BOND: Loaded 32554 existing records from primary storage. [2025-09-28T02:47:38.907509] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOH took 1.0s. Estimated remaining: 9m 17s. Rate: 220.9 symbols/min [2025-09-28T02:47:38.909236] [DEBUG] [LOCAL ] BOOT: Loaded 41409 existing records from primary storage. [2025-09-28T02:47:38.908250] [INFO ] [MAIN ] BOND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:38.907217] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:38.915733] [INFO ] [MAIN ] BOOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:38.909784] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOND took 1.1s. Estimated remaining: 9m 15s. Rate: 221.6 symbols/min [2025-09-28T02:47:38.952199] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOOT took 1.1s. Estimated remaining: 9m 13s. Rate: 222.1 symbols/min [2025-09-28T02:47:39.477974] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:39.533679] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:39.537302] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:39.539479] [DEBUG] [LOCAL ] BORR: Loaded 51902 existing records from primary storage. [2025-09-28T02:47:39.540710] [INFO ] [MAIN ] BORR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:39.541291] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BORR took 0.9s. Estimated remaining: 9m 15s. Rate: 221.3 symbols/min [2025-09-28T02:47:39.755066] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:39.770289] [DEBUG] [LOCAL ] BOW: Loaded 23974 existing records from primary storage. [2025-09-28T02:47:39.785597] [INFO ] [MAIN ] BOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:39.786190] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BOW took 0.9s. Estimated remaining: 9m 14s. Rate: 221.4 symbols/min [2025-09-28T02:47:39.916817] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-28T02:47:39.928958] [DEBUG] [LOCAL ] BOX: Loaded 51017 existing records from primary storage. [2025-09-28T02:47:39.944118] [INFO ] [MAIN ] BP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:39.944982] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BP took 1.0s. Estimated remaining: 9m 13s. Rate: 221.7 symbols/min [2025-09-28T02:47:39.945876] [INFO ] [MAIN ] BOX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:39.974094] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BOX took 1.0s. Estimated remaining: 9m 11s. Rate: 222.3 symbols/min [2025-09-28T02:47:40.228101] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:40.333541] [DEBUG] [LOCAL ] BR: Loaded 35251 existing records from primary storage. [2025-09-28T02:47:40.369811] [INFO ] [MAIN ] BR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:40.406603] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 0.9s. Estimated remaining: 9m 12s. Rate: 221.9 symbols/min [2025-09-28T02:47:40.410915] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:40.461222] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:40.675516] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:40.708272] [DEBUG] [LOCAL ] BRC: Loaded 19567 existing records from primary storage. [2025-09-28T02:47:40.708716] [INFO ] [MAIN ] BRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:40.708841] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRC took 0.8s. Estimated remaining: 9m 12s. Rate: 221.8 symbols/min [2025-09-28T02:47:40.741960] [DEBUG] [LOCAL ] BRBR: Loaded 51987 existing records from primary storage. [2025-09-28T02:47:40.754733] [INFO ] [MAIN ] BRBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:40.754984] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRBR took 1.0s. Estimated remaining: 9m 10s. Rate: 222.4 symbols/min [2025-09-28T02:47:40.892255] [DEBUG] [LOCAL ] BRCC: Loaded 40896 existing records from primary storage. [2025-09-28T02:47:40.977547] [INFO ] [MAIN ] BRCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:40.988948] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRCC took 1.0s. Estimated remaining: 9m 10s. Rate: 222.5 symbols/min [2025-09-28T02:47:41.133895] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:41.138282] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:41.149407] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-28T02:47:41.217719] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-28T02:47:41.260286] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-28T02:47:41.276624] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-28T02:47:41.289164] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-28T02:47:41.289038] [DEBUG] [LOCAL ] BRO: Loaded 52664 existing records from primary storage. [2025-09-28T02:47:41.318397] [INFO ] [MAIN ] BRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:41.318207] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-28T02:47:41.341984] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRO took 0.9s. Estimated remaining: 9m 10s. Rate: 222.3 symbols/min [2025-09-28T02:47:41.341441] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:41.681628] [DEBUG] [LOCAL ] BROS: Loaded 54067 existing records from primary storage. [2025-09-28T02:47:41.752630] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:41.752912] [INFO ] [MAIN ] BROS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:41.819554] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BROS took 1.1s. Estimated remaining: 9m 11s. Rate: 221.7 symbols/min [2025-09-28T02:47:41.965807] [DEBUG] [LOCAL ] BRSP: Loaded 37442 existing records from primary storage. [2025-09-28T02:47:42.028425] [DEBUG] [LOCAL ] BRT: Loaded 5034 existing records from primary storage. [2025-09-28T02:47:42.028611] [INFO ] [MAIN ] BRSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:42.070161] [INFO ] [MAIN ] BRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:42.058956] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSP took 1.0s. Estimated remaining: 9m 11s. Rate: 221.8 symbols/min [2025-09-28T02:47:42.171885] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRT took 0.8s. Estimated remaining: 9m 10s. Rate: 222.2 symbols/min [2025-09-28T02:47:42.297072] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:42.364113] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-28T02:47:42.516326] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:42.620309] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:42.702333] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:42.702880] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:47:42.712398] [DEBUG] [LOCAL ] BRW: Loaded 19862 existing records from primary storage. [2025-09-28T02:47:42.713563] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-28T02:47:42.713753] [INFO ] [MAIN ] BRW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:42.716291] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:47:42.716608] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRW took 0.9s. Estimated remaining: 9m 11s. Rate: 221.5 symbols/min [2025-09-28T02:47:42.717537] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-09-28T02:47:42.722956] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:47:42.731851] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-28T02:47:42.757866] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-28T02:47:42.788457] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-28T02:47:42.807026] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-28T02:47:42.830350] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRSL took 2.1s. Estimated remaining: 9m 10s. Rate: 221.9 symbols/min [2025-09-28T02:47:43.061511] [DEBUG] [LOCAL ] BSAC: Loaded 33389 existing records from primary storage. [2025-09-28T02:47:43.054486] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:43.103486] [DEBUG] [LOCAL ] BRX: Loaded 52462 existing records from primary storage. [2025-09-28T02:47:43.124728] [INFO ] [MAIN ] BSAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:43.143016] [INFO ] [MAIN ] BRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:43.159034] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BRX took 1.1s. Estimated remaining: 9m 10s. Rate: 221.8 symbols/min [2025-09-28T02:47:43.165189] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:43.186734] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSAC took 1.0s. Estimated remaining: 9m 8s. Rate: 222.4 symbols/min [2025-09-28T02:47:43.357524] [DEBUG] [LOCAL ] BSL: Loaded 8196 existing records from primary storage. [2025-09-28T02:47:43.386147] [INFO ] [MAIN ] BSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:43.386400] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSL took 0.6s. Estimated remaining: 9m 7s. Rate: 222.5 symbols/min [2025-09-28T02:47:43.675348] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:43.710683] [DEBUG] [LOCAL ] BSBR: Loaded 35731 existing records from primary storage. [2025-09-28T02:47:43.741984] [INFO ] [MAIN ] BSBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:43.741082] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:43.743824] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSBR took 1.0s. Estimated remaining: 9m 8s. Rate: 222.3 symbols/min [2025-09-28T02:47:43.920617] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:43.997467] [DEBUG] [LOCAL ] BST: Loaded 19385 existing records from primary storage. [2025-09-28T02:47:44.017778] [INFO ] [MAIN ] BST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:44.021985] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BST took 0.8s. Estimated remaining: 9m 7s. Rate: 222.3 symbols/min [2025-09-28T02:47:44.061012] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:44.062497] [DEBUG] [LOCAL ] BSM: Loaded 32809 existing records from primary storage. [2025-09-28T02:47:44.074448] [INFO ] [MAIN ] BSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:44.097090] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BSM took 0.9s. Estimated remaining: 9m 6s. Rate: 222.8 symbols/min [2025-09-28T02:47:44.217504] [DEBUG] [LOCAL ] BSTZ: Loaded 25188 existing records from primary storage. [2025-09-28T02:47:44.293287] [INFO ] [MAIN ] BSTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:44.357590] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSTZ took 0.9s. Estimated remaining: 9m 6s. Rate: 222.8 symbols/min [2025-09-28T02:47:44.385534] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:44.535773] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:44.604126] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-28T02:47:44.610384] [DEBUG] [LOCAL ] BTA: Loaded 5464 existing records from primary storage. [2025-09-28T02:47:44.616136] [INFO ] [MAIN ] BSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:44.622588] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BSX took 0.9s. Estimated remaining: 9m 5s. Rate: 222.8 symbols/min [2025-09-28T02:47:44.622884] [INFO ] [MAIN ] BTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:44.633637] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BTA took 0.6s. Estimated remaining: 9m 4s. Rate: 223.4 symbols/min [2025-09-28T02:47:44.792612] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:44.836028] [DEBUG] [LOCAL ] BTCM: Loaded 15122 existing records from primary storage. [2025-09-28T02:47:44.901524] [INFO ] [MAIN ] BTCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:44.943045] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 0.8s. Estimated remaining: 9m 4s. Rate: 223.3 symbols/min [2025-09-28T02:47:45.150169] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:45.151369] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:45.244317] [DEBUG] [LOCAL ] BTO: Loaded 8982 existing records from primary storage. [2025-09-28T02:47:45.314973] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:45.315376] [INFO ] [MAIN ] BTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:45.316157] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTO took 0.7s. Estimated remaining: 9m 4s. Rate: 223.1 symbols/min [2025-09-28T02:47:45.455431] [DEBUG] [LOCAL ] BTE: Loaded 53505 existing records from primary storage. [2025-09-28T02:47:45.512683] [INFO ] [MAIN ] BTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:45.552557] [DEBUG] [LOCAL ] BTT: Loaded 16126 existing records from primary storage. [2025-09-28T02:47:45.552087] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTE took 1.2s. Estimated remaining: 9m 3s. Rate: 223.1 symbols/min [2025-09-28T02:47:45.556564] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:45.615871] [INFO ] [MAIN ] BTT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:45.615673] [DEBUG] [LOCAL ] BTI: Loaded 54335 existing records from primary storage. [2025-09-28T02:47:45.616931] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTT took 0.7s. Estimated remaining: 9m 2s. Rate: 223.6 symbols/min [2025-09-28T02:47:45.661035] [INFO ] [MAIN ] BTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:45.713179] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTI took 1.1s. Estimated remaining: 9m 1s. Rate: 224.0 symbols/min [2025-09-28T02:47:45.973855] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:46.006509] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-28T02:47:46.057471] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-28T02:47:46.130042] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:46.179799] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:46.175682] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-28T02:47:46.198331] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-28T02:47:46.198586] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-28T02:47:46.200274] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-28T02:47:46.200068] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-28T02:47:46.227287] [INFO ] [MAIN ] BTU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:46.243393] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTU took 0.9s. Estimated remaining: 9m 2s. Rate: 223.4 symbols/min [2025-09-28T02:47:46.437376] [DEBUG] [LOCAL ] BTZ: Loaded 23002 existing records from primary storage. [2025-09-28T02:47:46.469224] [INFO ] [MAIN ] BTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:46.469398] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTZ took 0.8s. Estimated remaining: 9m 1s. Rate: 223.5 symbols/min [2025-09-28T02:47:46.675049] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:46.902606] [DEBUG] [LOCAL ] BUD: Loaded 53504 existing records from primary storage. [2025-09-28T02:47:46.968403] [INFO ] [MAIN ] BUD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:46.970291] [DEBUG] [LOCAL ] BUI: Loaded 11615 existing records from primary storage. [2025-09-28T02:47:47.011597] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BUD took 1.3s. Estimated remaining: 9m 3s. Rate: 222.9 symbols/min [2025-09-28T02:47:46.969824] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:47.041638] [INFO ] [MAIN ] BUI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:47.083885] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:47.118141] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BUI took 0.9s. Estimated remaining: 9m 2s. Rate: 223.3 symbols/min [2025-09-28T02:47:47.134246] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-28T02:47:47.364077] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:47:47.376060] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:47.438337] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:47.422509] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-28T02:47:47.438792] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:47:47.439149] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-09-28T02:47:47.439671] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:47:47.439861] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-28T02:47:47.439957] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-28T02:47:47.440108] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-28T02:47:47.440282] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-28T02:47:47.440446] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BTX took 1.9s. Estimated remaining: 9m 2s. Rate: 223.1 symbols/min [2025-09-28T02:47:47.461603] [DEBUG] [LOCAL ] BUR: Loaded 45700 existing records from primary storage. [2025-09-28T02:47:47.462151] [INFO ] [MAIN ] BUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:47.462730] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUR took 1.0s. Estimated remaining: 8m 60s. Rate: 223.7 symbols/min [2025-09-28T02:47:47.476806] [DEBUG] [LOCAL ] BUXX: Loaded 15364 existing records from primary storage. [2025-09-28T02:47:47.477229] [INFO ] [MAIN ] BUXX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:47.477348] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUXX took 0.4s. Estimated remaining: 8m 58s. Rate: 224.3 symbols/min [2025-09-28T02:47:47.531596] [DEBUG] [LOCAL ] BURL: Loaded 46896 existing records from primary storage. [2025-09-28T02:47:47.532059] [INFO ] [MAIN ] BURL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:47.532477] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 0.5s. Estimated remaining: 8m 57s. Rate: 224.8 symbols/min [2025-09-28T02:47:48.128999] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:48.254484] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:48.261353] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:48.318587] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:48.358198] [DEBUG] [LOCAL ] BV: Loaded 39048 existing records from primary storage. [2025-09-28T02:47:48.358630] [INFO ] [MAIN ] BV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:48.358910] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 0.8s. Estimated remaining: 8m 60s. Rate: 223.5 symbols/min [2025-09-28T02:47:48.553433] [DEBUG] [LOCAL ] BW: Loaded 40297 existing records from primary storage. [2025-09-28T02:47:48.596941] [INFO ] [MAIN ] BW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:48.618596] [DEBUG] [LOCAL ] BVN: Loaded 44520 existing records from primary storage. [2025-09-28T02:47:48.623323] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:48.637707] [INFO ] [MAIN ] BVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:48.637313] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BW took 1.1s. Estimated remaining: 8m 59s. Rate: 223.5 symbols/min [2025-09-28T02:47:48.645995] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BVN took 1.1s. Estimated remaining: 8m 58s. Rate: 224.1 symbols/min [2025-09-28T02:47:48.691390] [DEBUG] [LOCAL ] BWA: Loaded 52976 existing records from primary storage. [2025-09-28T02:47:48.784539] [INFO ] [MAIN ] BWA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:48.821257] [DEBUG] [LOCAL ] BWG: Loaded 12478 existing records from primary storage. [2025-09-28T02:47:48.856984] [INFO ] [MAIN ] BWG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:48.826967] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BWA took 1.3s. Estimated remaining: 8m 57s. Rate: 224.3 symbols/min [2025-09-28T02:47:48.885987] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWG took 0.5s. Estimated remaining: 8m 56s. Rate: 224.7 symbols/min [2025-09-28T02:47:49.177614] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:49.168377] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:49.389341] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:49.444126] [DEBUG] [LOCAL ] BWMX: Loaded 7676 existing records from primary storage. [2025-09-28T02:47:49.439142] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:49.453709] [INFO ] [MAIN ] BWMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:49.454241] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWMX took 0.8s. Estimated remaining: 8m 57s. Rate: 224.1 symbols/min [2025-09-28T02:47:49.542483] [DEBUG] [LOCAL ] BWNB: Loaded 4468 existing records from primary storage. [2025-09-28T02:47:49.561475] [DEBUG] [LOCAL ] BWSN: Loaded 5130 existing records from primary storage. [2025-09-28T02:47:49.561931] [INFO ] [MAIN ] BWSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:49.568217] [DEBUG] [LOCAL ] BWLP: Loaded 33185 existing records from primary storage. [2025-09-28T02:47:49.579356] [INFO ] [MAIN ] BWLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:49.573584] [INFO ] [MAIN ] BWNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:49.579215] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWSN took 0.6s. Estimated remaining: 8m 56s. Rate: 224.4 symbols/min [2025-09-28T02:47:49.597135] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWLP took 0.9s. Estimated remaining: 8m 54s. Rate: 225.0 symbols/min [2025-09-28T02:47:49.602575] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWNB took 0.7s. Estimated remaining: 8m 53s. Rate: 225.6 symbols/min [2025-09-28T02:47:49.899718] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:50.180565] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:50.181522] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:50.260957] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:50.280724] [DEBUG] [LOCAL ] BXC: Loaded 13880 existing records from primary storage. [2025-09-28T02:47:50.281552] [INFO ] [MAIN ] BXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:50.296451] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BXC took 0.7s. Estimated remaining: 8m 55s. Rate: 224.6 symbols/min [2025-09-28T02:47:50.303171] [DEBUG] [LOCAL ] BWXT: Loaded 47442 existing records from primary storage. [2025-09-28T02:47:50.335393] [INFO ] [MAIN ] BWXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:50.342260] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BWXT took 0.9s. Estimated remaining: 8m 53s. Rate: 225.1 symbols/min [2025-09-28T02:47:50.628060] [DEBUG] [LOCAL ] BX: Loaded 54270 existing records from primary storage. [2025-09-28T02:47:50.724410] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:50.734115] [INFO ] [MAIN ] BX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:50.735541] [DEBUG] [LOCAL ] BXMT: Loaded 47994 existing records from primary storage. [2025-09-28T02:47:50.739733] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BX took 1.1s. Estimated remaining: 8m 54s. Rate: 224.8 symbols/min [2025-09-28T02:47:50.742534] [INFO ] [MAIN ] BXMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:50.782334] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:50.801867] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXMT took 1.1s. Estimated remaining: 8m 52s. Rate: 225.2 symbols/min [2025-09-28T02:47:51.052717] [DEBUG] [LOCAL ] BXMX: Loaded 19855 existing records from primary storage. [2025-09-28T02:47:51.151477] [INFO ] [MAIN ] BXMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:51.153277] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:51.153611] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 0.9s. Estimated remaining: 8m 52s. Rate: 225.1 symbols/min [2025-09-28T02:47:51.207770] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:51.400304] [DEBUG] [LOCAL ] BXP: Loaded 50577 existing records from primary storage. [2025-09-28T02:47:51.453341] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:51.454579] [DEBUG] [LOCAL ] BY: Loaded 21895 existing records from primary storage. [2025-09-28T02:47:51.453537] [INFO ] [MAIN ] BXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:51.455450] [INFO ] [MAIN ] BY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:51.455900] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXP took 1.1s. Estimated remaining: 8m 52s. Rate: 225.0 symbols/min [2025-09-28T02:47:51.457363] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BY took 0.6s. Estimated remaining: 8m 51s. Rate: 225.6 symbols/min [2025-09-28T02:47:51.628295] [DEBUG] [LOCAL ] BXSL: Loaded 48276 existing records from primary storage. [2025-09-28T02:47:51.651297] [INFO ] [MAIN ] BXSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:51.685104] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BXSL took 0.9s. Estimated remaining: 8m 50s. Rate: 225.7 symbols/min [2025-09-28T02:47:51.918012] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:52.015465] [DEBUG] [LOCAL ] BYD: Loaded 45804 existing records from primary storage. [2025-09-28T02:47:52.010257] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:52.016680] [INFO ] [MAIN ] BYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:52.029463] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BYD took 0.9s. Estimated remaining: 8m 50s. Rate: 225.5 symbols/min [2025-09-28T02:47:52.114702] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:52.211445] [DEBUG] [LOCAL ] BYM: Loaded 12225 existing records from primary storage. [2025-09-28T02:47:52.248749] [INFO ] [MAIN ] BYM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:52.253684] [DEBUG] [LOCAL ] BZH: Loaded 33088 existing records from primary storage. [2025-09-28T02:47:52.254537] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 0.8s. Estimated remaining: 8m 50s. Rate: 225.6 symbols/min [2025-09-28T02:47:52.254716] [INFO ] [MAIN ] BZH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:52.360368] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 0.9s. Estimated remaining: 8m 49s. Rate: 225.9 symbols/min [2025-09-28T02:47:52.523741] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:52.809582] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:52.812873] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-28T02:47:52.814430] [DEBUG] [LOCAL ] CAAP: Loaded 20021 existing records from primary storage. [2025-09-28T02:47:52.816105] [INFO ] [MAIN ] CAAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:52.813933] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:52.815839] [INFO ] [MAIN ] C: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:52.816299] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. CAAP took 0.7s. Estimated remaining: 8m 49s. Rate: 225.5 symbols/min [2025-09-28T02:47:52.829811] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. C took 1.1s. Estimated remaining: 8m 48s. Rate: 226.1 symbols/min [2025-09-28T02:47:53.059104] [DEBUG] [LOCAL ] CABO: Loaded 17549 existing records from primary storage. [2025-09-28T02:47:53.174107] [INFO ] [MAIN ] CABO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:53.179313] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:53.132268] [DEBUG] [LOCAL ] CACI: Loaded 25384 existing records from primary storage. [2025-09-28T02:47:53.201481] [INFO ] [MAIN ] CACI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:53.211228] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. CABO took 0.9s. Estimated remaining: 8m 48s. Rate: 225.8 symbols/min [2025-09-28T02:47:53.232893] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CACI took 0.8s. Estimated remaining: 8m 47s. Rate: 226.3 symbols/min [2025-09-28T02:47:53.237257] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:53.631352] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:53.632668] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:53.645031] [DEBUG] [LOCAL ] CAF: Loaded 3471 existing records from primary storage. [2025-09-28T02:47:53.646216] [INFO ] [MAIN ] CAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:53.666862] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 0.4s. Estimated remaining: 8m 47s. Rate: 226.0 symbols/min [2025-09-28T02:47:53.698489] [DEBUG] [LOCAL ] CAE: Loaded 39622 existing records from primary storage. [2025-09-28T02:47:53.733917] [INFO ] [MAIN ] CAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:53.746536] [DEBUG] [LOCAL ] CADE: Loaded 49496 existing records from primary storage. [2025-09-28T02:47:53.744853] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CAE took 0.9s. Estimated remaining: 8m 46s. Rate: 226.4 symbols/min [2025-09-28T02:47:53.776638] [INFO ] [MAIN ] CADE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:53.788119] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CADE took 1.0s. Estimated remaining: 8m 45s. Rate: 226.9 symbols/min [2025-09-28T02:47:54.152488] [DEBUG] [LOCAL ] CAG: Loaded 54439 existing records from primary storage. [2025-09-28T02:47:54.153066] [INFO ] [MAIN ] CAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:54.181518] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAG took 0.9s. Estimated remaining: 8m 45s. Rate: 226.6 symbols/min [2025-09-28T02:47:54.198787] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:54.351552] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:54.379951] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:54.555234] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:54.597401] [DEBUG] [LOCAL ] CALX: Loaded 38931 existing records from primary storage. [2025-09-28T02:47:54.598169] [INFO ] [MAIN ] CALX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:54.598284] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CALX took 0.8s. Estimated remaining: 8m 46s. Rate: 226.3 symbols/min [2025-09-28T02:47:54.732932] [DEBUG] [LOCAL ] CAL: Loaded 43833 existing records from primary storage. [2025-09-28T02:47:54.764994] [INFO ] [MAIN ] CAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:54.733918] [DEBUG] [LOCAL ] CAH: Loaded 52209 existing records from primary storage. [2025-09-28T02:47:54.787010] [DEBUG] [LOCAL ] CANG: Loaded 27132 existing records from primary storage. [2025-09-28T02:47:54.841407] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:54.841828] [INFO ] [MAIN ] CAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:54.813380] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAL took 1.0s. Estimated remaining: 8m 45s. Rate: 226.4 symbols/min [2025-09-28T02:47:54.842294] [INFO ] [MAIN ] CANG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:54.848550] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CANG took 0.6s. Estimated remaining: 8m 44s. Rate: 226.9 symbols/min [2025-09-28T02:47:54.893227] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CAH took 1.2s. Estimated remaining: 8m 42s. Rate: 227.4 symbols/min [2025-09-28T02:47:55.083850] [DEBUG] [LOCAL ] CAPL: Loaded 5930 existing records from primary storage. [2025-09-28T02:47:55.191070] [INFO ] [MAIN ] CAPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:55.212054] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CAPL took 0.6s. Estimated remaining: 8m 42s. Rate: 227.2 symbols/min [2025-09-28T02:47:55.319336] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:55.452341] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:55.554214] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:55.648863] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:55.701702] [DEBUG] [LOCAL ] CATO: Loaded 7286 existing records from primary storage. [2025-09-28T02:47:55.702103] [INFO ] [MAIN ] CATO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:55.702424] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CATO took 0.4s. Estimated remaining: 8m 43s. Rate: 226.7 symbols/min [2025-09-28T02:47:55.860201] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-09-28T02:47:55.861905] [DEBUG] [LOCAL ] CARS: Loaded 40616 existing records from primary storage. [2025-09-28T02:47:55.866962] [INFO ] [MAIN ] CARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:55.867206] [INFO ] [MAIN ] CARS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:55.868961] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CARR took 1.0s. Estimated remaining: 8m 42s. Rate: 227.0 symbols/min [2025-09-28T02:47:55.868195] [DEBUG] [LOCAL ] CAT: Loaded 53693 existing records from primary storage. [2025-09-28T02:47:55.895759] [INFO ] [MAIN ] CAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:55.890428] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CARS took 1.0s. Estimated remaining: 8m 41s. Rate: 227.5 symbols/min [2025-09-28T02:47:55.995406] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CAT took 1.0s. Estimated remaining: 8m 40s. Rate: 227.8 symbols/min [2025-09-28T02:47:56.048201] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:56.270118] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:56.331387] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:56.362023] [DEBUG] [LOCAL ] CBAN: Loaded 11141 existing records from primary storage. [2025-09-28T02:47:56.362450] [INFO ] [MAIN ] CBAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:56.362555] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CBAN took 0.4s. Estimated remaining: 8m 40s. Rate: 227.6 symbols/min [2025-09-28T02:47:56.382241] [DEBUG] [LOCAL ] CAVA: Loaded 54330 existing records from primary storage. [2025-09-28T02:47:56.382744] [INFO ] [MAIN ] CAVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:56.383308] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 0.7s. Estimated remaining: 8m 39s. Rate: 228.1 symbols/min [2025-09-28T02:47:56.420495] [DEBUG] [LOCAL ] CB: Loaded 50773 existing records from primary storage. [2025-09-28T02:47:56.420931] [INFO ] [MAIN ] CB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:56.421033] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 0.5s. Estimated remaining: 8m 37s. Rate: 228.6 symbols/min [2025-09-28T02:47:57.151217] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:57.129522] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:57.191533] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:57.192941] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:57.194292] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-28T02:47:57.194376] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-28T02:47:57.194521] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-28T02:47:57.195628] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-28T02:47:57.196015] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-28T02:47:57.196139] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-28T02:47:57.231994] [DEBUG] [LOCAL ] CBNA: Loaded 2923 existing records from primary storage. [2025-09-28T02:47:57.268749] [INFO ] [MAIN ] CBNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:57.279751] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBNA took 0.8s. Estimated remaining: 8m 40s. Rate: 227.3 symbols/min [2025-09-28T02:47:57.426903] [DEBUG] [LOCAL ] CBL: Loaded 16862 existing records from primary storage. [2025-09-28T02:47:57.521630] [INFO ] [MAIN ] CBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:57.593794] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBL took 1.2s. Estimated remaining: 8m 40s. Rate: 227.2 symbols/min [2025-09-28T02:47:57.775294] [DEBUG] [LOCAL ] CBRE: Loaded 51366 existing records from primary storage. [2025-09-28T02:47:57.851801] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:57.862624] [INFO ] [MAIN ] CBRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:57.873384] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBRE took 1.4s. Estimated remaining: 8m 40s. Rate: 227.2 symbols/min [2025-09-28T02:47:58.044506] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:58.095152] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-28T02:47:58.156281] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:58.274074] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:58.274607] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-28T02:47:58.274792] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-28T02:47:58.275123] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-28T02:47:58.275282] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-28T02:47:58.275488] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-28T02:47:58.275639] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-28T02:47:58.288320] [DEBUG] [LOCAL ] CBT: Loaded 31567 existing records from primary storage. [2025-09-28T02:47:58.352387] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:47:58.346020] [INFO ] [MAIN ] CBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:58.357972] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBT took 1.1s. Estimated remaining: 8m 41s. Rate: 226.7 symbols/min [2025-09-28T02:47:58.368844] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-28T02:47:58.419213] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:47:58.462765] [DEBUG] [LOCAL ] CBU: Loaded 23130 existing records from primary storage. [2025-09-28T02:47:58.483158] [INFO ] [MAIN ] CBU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:58.483433] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-09-28T02:47:58.483568] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBU took 0.8s. Estimated remaining: 8m 40s. Rate: 227.0 symbols/min [2025-09-28T02:47:58.520042] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:47:58.585669] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-28T02:47:58.676349] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-28T02:47:58.740743] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-28T02:47:58.819617] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-28T02:47:58.800389] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:58.858003] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBO took 2.4s. Estimated remaining: 8m 40s. Rate: 226.8 symbols/min [2025-09-28T02:47:59.132320] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:59.214314] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:47:59.273338] [DEBUG] [LOCAL ] CBZ: Loaded 34130 existing records from primary storage. [2025-09-28T02:47:59.296372] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:59.273866] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-28T02:47:59.297134] [INFO ] [MAIN ] CBZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:59.298533] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBZ took 0.9s. Estimated remaining: 8m 40s. Rate: 226.4 symbols/min [2025-09-28T02:47:59.476353] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:47:59.509828] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-28T02:47:59.514106] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:47:59.514662] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-28T02:47:59.514506] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:47:59.514752] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-28T02:47:59.515010] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-28T02:47:59.514939] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-09-28T02:47:59.515329] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-28T02:47:59.515500] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-28T02:47:59.515400] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:47:59.515577] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-28T02:47:59.515772] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-28T02:47:59.569026] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-28T02:47:59.645527] [DEBUG] [LOCAL ] CC: Loaded 53801 existing records from primary storage. [2025-09-28T02:47:59.627690] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-28T02:47:59.677591] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-28T02:47:59.677466] [INFO ] [MAIN ] CC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:59.677793] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CBX took 1.8s. Estimated remaining: 8m 41s. Rate: 226.2 symbols/min [2025-09-28T02:47:59.684274] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CC took 1.1s. Estimated remaining: 8m 39s. Rate: 226.7 symbols/min [2025-09-28T02:47:59.718366] [DEBUG] [LOCAL ] CCI: Loaded 53922 existing records from primary storage. [2025-09-28T02:47:59.809422] [INFO ] [MAIN ] CCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:47:59.882147] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CCI took 1.0s. Estimated remaining: 8m 39s. Rate: 226.9 symbols/min [2025-09-28T02:48:00.482633] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:00.489852] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:00.536220] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:00.531185] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:00.537472] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-28T02:48:00.560476] [DEBUG] [LOCAL ] CCIF: Loaded 15698 existing records from primary storage. [2025-09-28T02:48:00.560897] [INFO ] [MAIN ] CCIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:00.561039] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCIF took 0.9s. Estimated remaining: 8m 40s. Rate: 226.0 symbols/min [2025-09-28T02:48:00.781309] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:00.800676] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-28T02:48:00.803058] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-28T02:48:00.807298] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-09-28T02:48:00.820843] [INFO ] [MAIN ] CCJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:00.822553] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCJ took 1.1s. Estimated remaining: 8m 40s. Rate: 226.0 symbols/min [2025-09-28T02:48:00.859069] [DEBUG] [LOCAL ] CCK: Loaded 47083 existing records from primary storage. [2025-09-28T02:48:00.901590] [INFO ] [MAIN ] CCK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:00.919604] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCK took 1.0s. Estimated remaining: 8m 39s. Rate: 226.4 symbols/min [2025-09-28T02:48:01.107906] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:01.221494] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:01.240107] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-28T02:48:01.241086] [INFO ] [MAIN ] CCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:01.241315] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCL took 0.7s. Estimated remaining: 8m 39s. Rate: 226.2 symbols/min [2025-09-28T02:48:01.267524] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-28T02:48:01.312895] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-28T02:48:01.371137] [DEBUG] [LOCAL ] CCRD: Loaded 9100 existing records from primary storage. [2025-09-28T02:48:01.385509] [INFO ] [MAIN ] CCRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:01.429588] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCRD took 0.5s. Estimated remaining: 8m 38s. Rate: 226.4 symbols/min [2025-09-28T02:48:01.466966] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:01.574088] [DEBUG] [LOCAL ] CCO: Loaded 48387 existing records from primary storage. [2025-09-28T02:48:01.601697] [INFO ] [MAIN ] CCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:01.608114] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCO took 0.8s. Estimated remaining: 8m 38s. Rate: 226.6 symbols/min [2025-09-28T02:48:01.774300] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-28T02:48:01.781300] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-28T02:48:01.771561] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:01.837528] [DEBUG] [LOCAL ] CCS: Loaded 31155 existing records from primary storage. [2025-09-28T02:48:01.854605] [INFO ] [MAIN ] CCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:01.873315] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCS took 0.6s. Estimated remaining: 8m 37s. Rate: 226.6 symbols/min [2025-09-28T02:48:01.934804] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:01.994035] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-28T02:48:02.030800] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-28T02:48:02.030544] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-28T02:48:02.040502] [DEBUG] [LOCAL ] CCU: Loaded 23800 existing records from primary storage. [2025-09-28T02:48:02.039891] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-28T02:48:02.039780] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-28T02:48:02.051636] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-28T02:48:02.051859] [INFO ] [MAIN ] CCU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:02.063230] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCU took 0.6s. Estimated remaining: 8m 37s. Rate: 226.7 symbols/min [2025-09-28T02:48:02.052881] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-28T02:48:02.097723] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-28T02:48:02.169624] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:02.488609] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-28T02:48:02.450761] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:02.522008] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-28T02:48:02.633747] [DEBUG] [LOCAL ] CDLR: Loaded 9966 existing records from primary storage. [2025-09-28T02:48:02.664199] [INFO ] [MAIN ] CDLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:02.719409] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CDLR took 0.7s. Estimated remaining: 8m 38s. Rate: 225.9 symbols/min [2025-09-28T02:48:02.721062] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-28T02:48:02.773367] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:02.761684] [INFO ] [MAIN ] CDE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:02.788674] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CDE took 0.9s. Estimated remaining: 8m 37s. Rate: 226.3 symbols/min [2025-09-28T02:48:02.789076] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-28T02:48:02.951851] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-28T02:48:02.973761] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-28T02:48:03.117799] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:03.111410] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-28T02:48:03.167215] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-28T02:48:03.171273] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:03.211886] [DEBUG] [LOCAL ] CDRE: Loaded 25747 existing records from primary storage. [2025-09-28T02:48:03.212215] [INFO ] [MAIN ] CDRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:03.212317] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDRE took 0.4s. Estimated remaining: 8m 38s. Rate: 226.0 symbols/min [2025-09-28T02:48:03.288792] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-28T02:48:03.327580] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-28T02:48:03.353918] [DEBUG] [LOCAL ] CDP: Loaded 43357 existing records from primary storage. [2025-09-28T02:48:03.341352] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.17 seconds). [2025-09-28T02:48:03.360588] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-28T02:48:03.394508] [INFO ] [MAIN ] CDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:03.424213] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:03.425274] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDP took 0.7s. Estimated remaining: 8m 37s. Rate: 226.1 symbols/min [2025-09-28T02:48:03.599532] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-28T02:48:03.622500] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-28T02:48:03.621289] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:03.649004] [DEBUG] [LOCAL ] CEE: Loaded 6697 existing records from primary storage. [2025-09-28T02:48:03.649308] [INFO ] [MAIN ] CEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:03.649413] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CEE took 0.2s. Estimated remaining: 8m 37s. Rate: 226.2 symbols/min [2025-09-28T02:48:03.740799] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-28T02:48:03.780606] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-28T02:48:03.783286] [DEBUG] [LOCAL ] CE: Loaded 52316 existing records from primary storage. [2025-09-28T02:48:03.841216] [INFO ] [MAIN ] CE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:03.811541] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.19 seconds). [2025-09-28T02:48:03.842523] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CE took 0.6s. Estimated remaining: 8m 36s. Rate: 226.3 symbols/min [2025-09-28T02:48:03.863334] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:03.864421] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-28T02:48:04.072928] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:04.083303] [DEBUG] [LOCAL ] CEPU: Loaded 26454 existing records from primary storage. [2025-09-28T02:48:04.087170] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-28T02:48:04.089209] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-28T02:48:04.087730] [INFO ] [MAIN ] CEPU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:04.089554] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CEPU took 0.4s. Estimated remaining: 8m 36s. Rate: 226.4 symbols/min [2025-09-28T02:48:04.169837] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-28T02:48:04.195761] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-28T02:48:04.288225] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:04.329189] [DEBUG] [LOCAL ] CF: Loaded 52983 existing records from primary storage. [2025-09-28T02:48:04.329590] [INFO ] [MAIN ] CF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:04.329838] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CF took 0.5s. Estimated remaining: 8m 35s. Rate: 226.4 symbols/min [2025-09-28T02:48:04.421103] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-28T02:48:04.439185] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-28T02:48:04.480191] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-28T02:48:04.487620] [INFO ] [REMOTE ] CCIA: Full fetch complete (2044 records). [2025-09-28T02:48:04.537189] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:04.537535] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-28T02:48:04.537982] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-28T02:48:04.576327] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-28T02:48:04.632419] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-28T02:48:04.642913] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-28T02:48:04.630702] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:48:04.648228] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-28T02:48:04.666254] [INFO ] [MAIN ] CFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:04.666564] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-28T02:48:04.671458] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-28T02:48:04.671182] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CFG took 0.6s. Estimated remaining: 8m 35s. Rate: 226.3 symbols/min [2025-09-28T02:48:04.666771] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-28T02:48:04.672059] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:48:04.698569] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-09-28T02:48:04.944381] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:48:04.949596] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:48:04.981892] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:48:04.987542] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-28T02:48:04.999090] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:48:05.062007] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-28T02:48:05.089234] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-28T02:48:05.087374] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-28T02:48:05.121890] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-28T02:48:05.129447] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-28T02:48:05.121810] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:05.141834] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CCZ took 3.5s. Estimated remaining: 8m 36s. Rate: 225.9 symbols/min [2025-09-28T02:48:05.174470] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-28T02:48:05.241759] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-28T02:48:05.338717] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CCIA took 6.0s. Estimated remaining: 8m 36s. Rate: 226.0 symbols/min [2025-09-28T02:48:05.653395] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:05.647343] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:05.665798] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-28T02:48:05.712994] [DEBUG] [LOCAL ] CFR: Loaded 33971 existing records from primary storage. [2025-09-28T02:48:05.736265] [INFO ] [MAIN ] CFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:05.773894] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFR took 1.1s. Estimated remaining: 8m 36s. Rate: 225.7 symbols/min [2025-09-28T02:48:05.773536] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:05.865405] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:48:05.899289] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-28T02:48:05.917484] [DEBUG] [LOCAL ] CGV: Loaded 1431 existing records from primary storage. [2025-09-28T02:48:05.927908] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:48:05.977859] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:05.949051] [INFO ] [MAIN ] CGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:05.976728] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-09-28T02:48:05.978253] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:48:05.978366] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-28T02:48:05.978972] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-28T02:48:05.978495] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CGV took 0.6s. Estimated remaining: 8m 36s. Rate: 225.8 symbols/min [2025-09-28T02:48:05.985288] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-28T02:48:06.019713] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-28T02:48:06.082022] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CFND took 1.8s. Estimated remaining: 8m 35s. Rate: 226.1 symbols/min [2025-09-28T02:48:06.122212] [DEBUG] [LOCAL ] CGAU: Loaded 43406 existing records from primary storage. [2025-09-28T02:48:06.214074] [INFO ] [MAIN ] CGAU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:06.263870] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:06.250433] [DEBUG] [LOCAL ] CHCT: Loaded 24309 existing records from primary storage. [2025-09-28T02:48:06.280930] [INFO ] [MAIN ] CHCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:06.264370] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGAU took 1.1s. Estimated remaining: 8m 34s. Rate: 226.3 symbols/min [2025-09-28T02:48:06.297254] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CHCT took 0.5s. Estimated remaining: 8m 33s. Rate: 226.7 symbols/min [2025-09-28T02:48:06.645896] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:06.723634] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:06.796725] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:06.832502] [DEBUG] [LOCAL ] CHE: Loaded 14983 existing records from primary storage. [2025-09-28T02:48:06.834550] [INFO ] [MAIN ] CHE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:06.836412] [DEBUG] [LOCAL ] CHD: Loaded 52767 existing records from primary storage. [2025-09-28T02:48:06.837140] [INFO ] [MAIN ] CHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:06.836630] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHE took 0.7s. Estimated remaining: 8m 34s. Rate: 226.2 symbols/min [2025-09-28T02:48:06.843393] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHD took 0.9s. Estimated remaining: 8m 32s. Rate: 226.7 symbols/min [2025-09-28T02:48:07.117492] [DEBUG] [LOCAL ] CHH: Loaded 32744 existing records from primary storage. [2025-09-28T02:48:07.255694] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:07.256000] [INFO ] [MAIN ] CHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:07.266824] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHH took 1.0s. Estimated remaining: 8m 33s. Rate: 226.4 symbols/min [2025-09-28T02:48:07.327463] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:07.329691] [DEBUG] [LOCAL ] CHGG: Loaded 48434 existing records from primary storage. [2025-09-28T02:48:07.330300] [INFO ] [MAIN ] CHGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:07.331327] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHGG took 1.0s. Estimated remaining: 8m 31s. Rate: 226.8 symbols/min [2025-09-28T02:48:07.338267] [DEBUG] [LOCAL ] CHN: Loaded 4900 existing records from primary storage. [2025-09-28T02:48:07.338600] [INFO ] [MAIN ] CHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:07.338747] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHN took 0.5s. Estimated remaining: 8m 30s. Rate: 227.3 symbols/min [2025-09-28T02:48:07.354143] [DEBUG] [LOCAL ] CHMI: Loaded 22359 existing records from primary storage. [2025-09-28T02:48:07.354429] [INFO ] [MAIN ] CHMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:07.354558] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 0.5s. Estimated remaining: 8m 29s. Rate: 227.8 symbols/min [2025-09-28T02:48:08.083946] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:08.154635] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:08.166070] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:08.189557] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:08.220437] [DEBUG] [LOCAL ] CHT: Loaded 19816 existing records from primary storage. [2025-09-28T02:48:08.220838] [INFO ] [MAIN ] CHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:08.220993] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 0.8s. Estimated remaining: 8m 31s. Rate: 226.6 symbols/min [2025-09-28T02:48:08.447093] [DEBUG] [LOCAL ] CI: Loaded 50561 existing records from primary storage. [2025-09-28T02:48:08.511749] [INFO ] [MAIN ] CI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:08.516257] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:08.511496] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-09-28T02:48:08.518737] [INFO ] [MAIN ] CHWY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:08.519076] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CI took 1.2s. Estimated remaining: 8m 31s. Rate: 226.5 symbols/min [2025-09-28T02:48:08.518418] [DEBUG] [LOCAL ] CHPT: Loaded 49765 existing records from primary storage. [2025-09-28T02:48:08.524892] [INFO ] [MAIN ] CHPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:08.525890] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHWY took 1.2s. Estimated remaining: 8m 30s. Rate: 227.0 symbols/min [2025-09-28T02:48:08.588505] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHPT took 1.2s. Estimated remaining: 8m 28s. Rate: 227.4 symbols/min [2025-09-28T02:48:08.832887] [DEBUG] [LOCAL ] CIA: Loaded 17213 existing records from primary storage. [2025-09-28T02:48:08.997853] [INFO ] [MAIN ] CIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:09.006988] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:09.048331] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CIA took 0.8s. Estimated remaining: 8m 29s. Rate: 227.0 symbols/min [2025-09-28T02:48:09.147532] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:09.223008] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:09.228497] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-28T02:48:09.240403] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-28T02:48:09.281816] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-28T02:48:09.287288] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-28T02:48:09.287603] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-28T02:48:09.287809] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-28T02:48:09.376213] [DEBUG] [LOCAL ] CIB: Loaded 31435 existing records from primary storage. [2025-09-28T02:48:09.448066] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:09.448681] [INFO ] [MAIN ] CIB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:09.461320] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CIB took 0.9s. Estimated remaining: 8m 29s. Rate: 226.7 symbols/min [2025-09-28T02:48:09.522000] [DEBUG] [LOCAL ] CIF: Loaded 4396 existing records from primary storage. [2025-09-28T02:48:09.600338] [INFO ] [MAIN ] CIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:09.781609] [DEBUG] [LOCAL ] CIEN: Loaded 52854 existing records from primary storage. [2025-09-28T02:48:09.734609] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIF took 0.7s. Estimated remaining: 8m 29s. Rate: 226.7 symbols/min [2025-09-28T02:48:09.835106] [INFO ] [MAIN ] CIEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:09.882122] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIEN took 1.3s. Estimated remaining: 8m 28s. Rate: 227.0 symbols/min [2025-09-28T02:48:09.911719] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:10.210501] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:10.221480] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-28T02:48:10.312559] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:10.385805] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:10.404477] [DEBUG] [LOCAL ] CIG: Loaded 44447 existing records from primary storage. [2025-09-28T02:48:10.407089] [INFO ] [MAIN ] CIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:10.407216] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIG took 0.9s. Estimated remaining: 8m 29s. Rate: 226.5 symbols/min [2025-09-28T02:48:10.482064] [DEBUG] [LOCAL ] CII: Loaded 15638 existing records from primary storage. [2025-09-28T02:48:10.515545] [INFO ] [MAIN ] CII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:10.527685] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CII took 0.7s. Estimated remaining: 8m 28s. Rate: 226.7 symbols/min [2025-09-28T02:48:10.688805] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-28T02:48:10.738769] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:10.762061] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-28T02:48:10.763952] [DEBUG] [LOCAL ] CIM: Loaded 37858 existing records from primary storage. [2025-09-28T02:48:10.765876] [INFO ] [MAIN ] CIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:10.783271] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIM took 0.9s. Estimated remaining: 8m 28s. Rate: 226.7 symbols/min [2025-09-28T02:48:10.802078] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-09-28T02:48:10.802431] [INFO ] [MAIN ] CIMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:10.842403] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMN took 0.4s. Estimated remaining: 8m 27s. Rate: 227.1 symbols/min [2025-09-28T02:48:10.894398] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:10.908788] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-28T02:48:10.952422] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-28T02:48:10.957811] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-28T02:48:11.036348] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-28T02:48:11.162222] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:11.164707] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-28T02:48:11.181158] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-28T02:48:11.181353] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-28T02:48:11.182808] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-28T02:48:11.180965] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-28T02:48:11.194879] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-28T02:48:11.258197] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-28T02:48:11.289639] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:11.289863] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-28T02:48:11.325390] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-28T02:48:11.351071] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-28T02:48:11.564823] [DEBUG] [LOCAL ] CINT: Loaded 18868 existing records from primary storage. [2025-09-28T02:48:11.599467] [INFO ] [MAIN ] CINT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:11.627012] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CINT took 0.8s. Estimated remaining: 8m 29s. Rate: 226.2 symbols/min [2025-09-28T02:48:11.746173] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-28T02:48:11.800086] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-28T02:48:12.163969] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:12.244311] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-28T02:48:12.266204] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:12.270930] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:12.271534] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-28T02:48:12.288326] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-28T02:48:12.289671] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-28T02:48:12.298737] [DEBUG] [LOCAL ] CIO: Loaded 20406 existing records from primary storage. [2025-09-28T02:48:12.299032] [INFO ] [MAIN ] CIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:12.299202] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIO took 0.6s. Estimated remaining: 8m 30s. Rate: 225.4 symbols/min [2025-09-28T02:48:12.424701] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:48:12.462112] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-28T02:48:12.484553] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:12.483501] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:48:12.485686] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-09-28T02:48:12.485778] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:48:12.485888] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-28T02:48:12.486003] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-28T02:48:12.486109] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-28T02:48:12.486246] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-28T02:48:12.486473] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIMP took 1.7s. Estimated remaining: 8m 30s. Rate: 225.5 symbols/min [2025-09-28T02:48:12.683959] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-28T02:48:12.680468] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:12.685583] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-28T02:48:12.700451] [DEBUG] [LOCAL ] CION: Loaded 29661 existing records from primary storage. [2025-09-28T02:48:12.700996] [INFO ] [MAIN ] CION: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:12.701122] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CION took 0.4s. Estimated remaining: 8m 29s. Rate: 225.6 symbols/min [2025-09-28T02:48:12.783351] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-28T02:48:12.821592] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-28T02:48:12.921466] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:12.924437] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-28T02:48:12.926089] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-28T02:48:12.948322] [DEBUG] [LOCAL ] CIVI: Loaded 53363 existing records from primary storage. [2025-09-28T02:48:12.948821] [INFO ] [MAIN ] CIVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:12.949406] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CIVI took 0.5s. Estimated remaining: 8m 29s. Rate: 225.7 symbols/min [2025-09-28T02:48:13.147546] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:13.172288] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-28T02:48:13.172716] [INFO ] [MAIN ] CL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:13.173084] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CL took 0.5s. Estimated remaining: 8m 28s. Rate: 225.7 symbols/min [2025-09-28T02:48:13.265078] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-28T02:48:13.292045] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-28T02:48:13.291684] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-28T02:48:13.313450] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-28T02:48:13.406893] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:13.407774] [DEBUG] [LOCAL ] CLB: Loaded 33475 existing records from primary storage. [2025-09-28T02:48:13.408663] [INFO ] [MAIN ] CLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:13.408823] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CLB took 0.5s. Estimated remaining: 8m 28s. Rate: 225.8 symbols/min [2025-09-28T02:48:13.542947] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-09-28T02:48:13.573127] [INFO ] [MAIN ] CLCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:13.588712] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLCO took 0.4s. Estimated remaining: 8m 27s. Rate: 226.0 symbols/min [2025-09-28T02:48:13.610881] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:13.722506] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-28T02:48:13.744419] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-28T02:48:13.803688] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-28T02:48:13.826476] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:13.827577] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-28T02:48:13.852450] [DEBUG] [LOCAL ] CLDT: Loaded 26082 existing records from primary storage. [2025-09-28T02:48:13.853119] [INFO ] [MAIN ] CLDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:13.853273] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CLDT took 0.4s. Estimated remaining: 8m 27s. Rate: 226.0 symbols/min [2025-09-28T02:48:14.048342] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:14.075837] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-28T02:48:14.077447] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-28T02:48:14.079461] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-09-28T02:48:14.080200] [INFO ] [MAIN ] CLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:14.080433] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLF took 0.5s. Estimated remaining: 8m 27s. Rate: 226.0 symbols/min [2025-09-28T02:48:14.214688] [DEBUG] [LOCAL ] CLH: Loaded 28493 existing records from primary storage. [2025-09-28T02:48:14.226393] [INFO ] [MAIN ] CLH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:14.220815] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-28T02:48:14.238892] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-28T02:48:14.239542] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLH took 0.4s. Estimated remaining: 8m 26s. Rate: 226.2 symbols/min [2025-09-28T02:48:14.303577] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:14.338670] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-28T02:48:14.356283] [INFO ] [REMOTE ] CICB: Full fetch complete (2111 records). [2025-09-28T02:48:14.389364] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-28T02:48:14.619017] [DEBUG] [LOCAL ] CLPR: Loaded 11615 existing records from primary storage. [2025-09-28T02:48:14.682154] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-28T02:48:14.658098] [INFO ] [MAIN ] CLPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:14.687491] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:14.700464] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-28T02:48:14.726509] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLPR took 0.6s. Estimated remaining: 8m 27s. Rate: 225.8 symbols/min [2025-09-28T02:48:14.820913] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:48:14.821191] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:48:14.826613] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:48:14.857988] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-28T02:48:14.875783] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-28T02:48:14.875969] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-28T02:48:14.887987] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-28T02:48:14.894171] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CICB took 6.3s. Estimated remaining: 8m 26s. Rate: 226.0 symbols/min [2025-09-28T02:48:15.053097] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-28T02:48:15.039403] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:15.070360] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-28T02:48:15.203327] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:15.206052] [DEBUG] [LOCAL ] CLS: Loaded 54412 existing records from primary storage. [2025-09-28T02:48:15.207040] [INFO ] [MAIN ] CLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:15.209033] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLS took 0.9s. Estimated remaining: 8m 26s. Rate: 225.9 symbols/min [2025-09-28T02:48:15.415761] [DEBUG] [LOCAL ] CLW: Loaded 22226 existing records from primary storage. [2025-09-28T02:48:15.453404] [INFO ] [MAIN ] CLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:15.454840] [DEBUG] [LOCAL ] CLVT: Loaded 52713 existing records from primary storage. [2025-09-28T02:48:15.437349] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-28T02:48:15.462367] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-28T02:48:15.459773] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLW took 0.6s. Estimated remaining: 8m 26s. Rate: 225.9 symbols/min [2025-09-28T02:48:15.462756] [INFO ] [MAIN ] CLVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:15.459216] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:15.464811] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLVT took 0.7s. Estimated remaining: 8m 24s. Rate: 226.4 symbols/min [2025-09-28T02:48:15.828014] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:15.859302] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:15.903627] [DEBUG] [LOCAL ] CLX: Loaded 52189 existing records from primary storage. [2025-09-28T02:48:15.904256] [INFO ] [MAIN ] CLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:15.904817] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLX took 0.7s. Estimated remaining: 8m 25s. Rate: 226.1 symbols/min [2025-09-28T02:48:15.958199] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-28T02:48:16.018030] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-28T02:48:16.148237] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:16.143333] [DEBUG] [LOCAL ] CM: Loaded 49317 existing records from primary storage. [2025-09-28T02:48:16.162339] [INFO ] [MAIN ] CM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:16.163389] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CM took 0.7s. Estimated remaining: 8m 24s. Rate: 226.1 symbols/min [2025-09-28T02:48:16.164248] [DEBUG] [LOCAL ] CMA: Loaded 50721 existing records from primary storage. [2025-09-28T02:48:16.200106] [INFO ] [MAIN ] CMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:16.226287] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CMA took 0.7s. Estimated remaining: 8m 23s. Rate: 226.5 symbols/min [2025-09-28T02:48:16.477096] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:16.473106] [DEBUG] [LOCAL ] CMBT: Loaded 22911 existing records from primary storage. [2025-09-28T02:48:16.526787] [INFO ] [MAIN ] CMBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:16.557952] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-28T02:48:16.557075] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:16.552221] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMBT took 0.6s. Estimated remaining: 8m 23s. Rate: 226.4 symbols/min [2025-09-28T02:48:16.560204] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-28T02:48:16.659593] [DEBUG] [LOCAL ] CMCM: Loaded 4834 existing records from primary storage. [2025-09-28T02:48:16.677331] [INFO ] [MAIN ] CMCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:16.677551] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CMCM took 0.4s. Estimated remaining: 8m 23s. Rate: 226.6 symbols/min [2025-09-28T02:48:16.800051] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:16.852289] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-28T02:48:16.852513] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-28T02:48:16.879014] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-28T02:48:16.885666] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-28T02:48:16.937924] [DEBUG] [LOCAL ] CMC: Loaded 46311 existing records from primary storage. [2025-09-28T02:48:16.920447] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-28T02:48:16.972742] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:16.973130] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-28T02:48:16.973245] [INFO ] [MAIN ] CMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:16.995947] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMC took 0.8s. Estimated remaining: 8m 22s. Rate: 226.5 symbols/min [2025-09-28T02:48:17.124852] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-28T02:48:17.170321] [INFO ] [REMOTE ] CIMO: Full fetch complete (5472 records). [2025-09-28T02:48:17.203113] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-28T02:48:17.501184] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:17.670429] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-09-28T02:48:17.717199] [INFO ] [MAIN ] CMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:17.739939] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMG took 1.1s. Estimated remaining: 8m 24s. Rate: 225.7 symbols/min [2025-09-28T02:48:17.870539] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:48:17.928838] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:17.934237] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:48:17.934912] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:48:17.934847] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-28T02:48:17.935085] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-28T02:48:17.948694] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-28T02:48:17.971942] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-28T02:48:17.990008] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-28T02:48:17.997147] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CIMO took 7.5s. Estimated remaining: 8m 24s. Rate: 225.7 symbols/min [2025-09-28T02:48:18.066802] [DEBUG] [LOCAL ] CMI: Loaded 42484 existing records from primary storage. [2025-09-28T02:48:18.135862] [INFO ] [MAIN ] CMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:18.154770] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:48:18.154416] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:18.164589] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMI took 1.1s. Estimated remaining: 8m 23s. Rate: 225.9 symbols/min [2025-09-28T02:48:18.164967] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-28T02:48:18.185897] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:48:18.211293] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-09-28T02:48:18.211464] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:48:18.211534] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-28T02:48:18.212117] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-28T02:48:18.217761] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-28T02:48:18.229107] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-28T02:48:18.234511] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMDB took 1.7s. Estimated remaining: 8m 22s. Rate: 226.2 symbols/min [2025-09-28T02:48:18.290987] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:18.318093] [DEBUG] [LOCAL ] CMP: Loaded 36848 existing records from primary storage. [2025-09-28T02:48:18.318465] [INFO ] [MAIN ] CMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:18.318625] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMP took 0.6s. Estimated remaining: 8m 21s. Rate: 226.5 symbols/min [2025-09-28T02:48:18.355058] [DEBUG] [LOCAL ] CMPO: Loaded 40071 existing records from primary storage. [2025-09-28T02:48:18.355443] [INFO ] [MAIN ] CMPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:18.355547] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMPO took 0.3s. Estimated remaining: 8m 20s. Rate: 226.9 symbols/min [2025-09-28T02:48:18.993676] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:19.047152] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:19.104600] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:19.135793] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:19.144424] [DEBUG] [LOCAL ] CMSA: Loaded 3421 existing records from primary storage. [2025-09-28T02:48:19.146573] [INFO ] [MAIN ] CMSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:19.147437] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSA took 0.8s. Estimated remaining: 8m 22s. Rate: 226.0 symbols/min [2025-09-28T02:48:19.163719] [DEBUG] [LOCAL ] CMSC: Loaded 5131 existing records from primary storage. [2025-09-28T02:48:19.180744] [INFO ] [MAIN ] CMSC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:19.189697] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSC took 0.8s. Estimated remaining: 8m 21s. Rate: 226.4 symbols/min [2025-09-28T02:48:19.544156] [DEBUG] [LOCAL ] CMRE: Loaded 36068 existing records from primary storage. [2025-09-28T02:48:19.622158] [INFO ] [MAIN ] CMRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:19.605247] [DEBUG] [LOCAL ] CMS: Loaded 53371 existing records from primary storage. [2025-09-28T02:48:19.673753] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMRE took 1.3s. Estimated remaining: 8m 21s. Rate: 226.0 symbols/min [2025-09-28T02:48:19.750009] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:19.770474] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:19.711249] [INFO ] [MAIN ] CMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:19.819479] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMS took 1.5s. Estimated remaining: 8m 21s. Rate: 226.2 symbols/min [2025-09-28T02:48:19.941628] [DEBUG] [LOCAL ] CMSD: Loaded 8184 existing records from primary storage. [2025-09-28T02:48:20.000628] [INFO ] [MAIN ] CMSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:20.020949] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMSD took 0.9s. Estimated remaining: 8m 20s. Rate: 226.3 symbols/min [2025-09-28T02:48:20.262376] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:20.290247] [DEBUG] [LOCAL ] CMTG: Loaded 37931 existing records from primary storage. [2025-09-28T02:48:20.333890] [INFO ] [MAIN ] CMTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:20.400712] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMTG took 1.2s. Estimated remaining: 8m 20s. Rate: 226.1 symbols/min [2025-09-28T02:48:20.483623] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:20.494945] [DEBUG] [LOCAL ] CMU: Loaded 7303 existing records from primary storage. [2025-09-28T02:48:20.659715] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:20.643068] [INFO ] [MAIN ] CMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:20.675514] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMU took 1.0s. Estimated remaining: 8m 20s. Rate: 226.1 symbols/min [2025-09-28T02:48:20.837257] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:20.944191] [DEBUG] [LOCAL ] CNA: Loaded 33235 existing records from primary storage. [2025-09-28T02:48:20.992563] [DEBUG] [LOCAL ] CNF: Loaded 11166 existing records from primary storage. [2025-09-28T02:48:20.997902] [INFO ] [MAIN ] CNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:21.017503] [INFO ] [MAIN ] CNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:21.022327] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNA took 1.2s. Estimated remaining: 8m 20s. Rate: 226.0 symbols/min [2025-09-28T02:48:21.048939] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:21.049068] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNF took 0.6s. Estimated remaining: 8m 19s. Rate: 226.4 symbols/min [2025-09-28T02:48:21.291591] [DEBUG] [LOCAL ] CNC: Loaded 54518 existing records from primary storage. [2025-09-28T02:48:21.306160] [INFO ] [MAIN ] CNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:21.328175] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNC took 1.3s. Estimated remaining: 8m 19s. Rate: 226.4 symbols/min [2025-09-28T02:48:21.480893] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:21.567836] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:21.621356] [DEBUG] [LOCAL ] CNH: Loaded 54337 existing records from primary storage. [2025-09-28T02:48:21.656232] [INFO ] [MAIN ] CNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:21.675184] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNH took 1.0s. Estimated remaining: 8m 19s. Rate: 226.2 symbols/min [2025-09-28T02:48:21.687086] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:21.912112] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:21.949590] [DEBUG] [LOCAL ] CNI: Loaded 52419 existing records from primary storage. [2025-09-28T02:48:21.965505] [INFO ] [MAIN ] CNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:21.966127] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNI took 0.9s. Estimated remaining: 8m 18s. Rate: 226.2 symbols/min [2025-09-28T02:48:21.967254] [DEBUG] [LOCAL ] CNK: Loaded 53658 existing records from primary storage. [2025-09-28T02:48:21.973308] [INFO ] [MAIN ] CNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:22.006813] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNK took 0.9s. Estimated remaining: 8m 17s. Rate: 226.6 symbols/min [2025-09-28T02:48:22.114465] [DEBUG] [LOCAL ] CNM: Loaded 51747 existing records from primary storage. [2025-09-28T02:48:22.180546] [INFO ] [MAIN ] CNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:22.206533] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNM took 0.8s. Estimated remaining: 8m 17s. Rate: 226.7 symbols/min [2025-09-28T02:48:22.265600] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:22.370633] [DEBUG] [LOCAL ] CNMD: Loaded 32884 existing records from primary storage. [2025-09-28T02:48:22.413561] [INFO ] [MAIN ] CNMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:22.537586] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:22.536237] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNMD took 0.8s. Estimated remaining: 8m 17s. Rate: 226.6 symbols/min [2025-09-28T02:48:22.735030] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:22.832323] [DEBUG] [LOCAL ] CNNE: Loaded 37257 existing records from primary storage. [2025-09-28T02:48:22.855266] [INFO ] [MAIN ] CNNE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:22.868053] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 0.9s. Estimated remaining: 8m 17s. Rate: 226.4 symbols/min [2025-09-28T02:48:22.854942] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:22.875196] [DEBUG] [LOCAL ] CNO: Loaded 41901 existing records from primary storage. [2025-09-28T02:48:22.914199] [INFO ] [MAIN ] CNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:22.938699] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNO took 0.9s. Estimated remaining: 8m 16s. Rate: 226.8 symbols/min [2025-09-28T02:48:23.218163] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:23.238466] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-28T02:48:23.280170] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-28T02:48:23.296917] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:23.297194] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-28T02:48:23.269222] [DEBUG] [LOCAL ] CNP: Loaded 54249 existing records from primary storage. [2025-09-28T02:48:23.297303] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-28T02:48:23.313343] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-28T02:48:23.315448] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-28T02:48:23.315206] [INFO ] [MAIN ] CNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:23.321024] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNP took 1.1s. Estimated remaining: 8m 16s. Rate: 226.6 symbols/min [2025-09-28T02:48:23.495266] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-09-28T02:48:23.556913] [INFO ] [MAIN ] CNQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:23.652853] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNQ took 1.1s. Estimated remaining: 8m 16s. Rate: 226.5 symbols/min [2025-09-28T02:48:23.721805] [DEBUG] [LOCAL ] CNS: Loaded 21245 existing records from primary storage. [2025-09-28T02:48:23.744093] [INFO ] [MAIN ] CNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:23.760786] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNS took 0.8s. Estimated remaining: 8m 15s. Rate: 226.7 symbols/min [2025-09-28T02:48:24.036571] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:24.182477] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:24.266386] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-28T02:48:24.308635] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:24.378889] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:24.433583] [DEBUG] [LOCAL ] CNX: Loaded 52150 existing records from primary storage. [2025-09-28T02:48:24.434293] [INFO ] [MAIN ] CNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:24.434579] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNX took 1.1s. Estimated remaining: 8m 16s. Rate: 226.0 symbols/min [2025-09-28T02:48:24.479554] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:48:24.512470] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-28T02:48:24.534564] [DEBUG] [LOCAL ] CODI: Loaded 40312 existing records from primary storage. [2025-09-28T02:48:24.580383] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:48:24.585129] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-09-28T02:48:24.580568] [INFO ] [MAIN ] CODI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:24.596524] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:48:24.614346] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CODI took 0.9s. Estimated remaining: 8m 16s. Rate: 226.2 symbols/min [2025-09-28T02:48:24.634104] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-28T02:48:24.715765] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-28T02:48:24.744790] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-09-28T02:48:24.742903] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:24.771560] [INFO ] [MAIN ] COF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:24.766155] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-28T02:48:24.777862] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. COF took 0.9s. Estimated remaining: 8m 15s. Rate: 226.3 symbols/min [2025-09-28T02:48:24.794514] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-28T02:48:24.818926] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. CNR took 2.0s. Estimated remaining: 8m 14s. Rate: 226.7 symbols/min [2025-09-28T02:48:25.033577] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:25.297004] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:25.316234] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:25.319891] [DEBUG] [LOCAL ] COHR: Loaded 54144 existing records from primary storage. [2025-09-28T02:48:25.322974] [INFO ] [MAIN ] COHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:25.323301] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COHR took 0.9s. Estimated remaining: 8m 15s. Rate: 226.3 symbols/min [2025-09-28T02:48:25.555974] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:25.558494] [DEBUG] [LOCAL ] COLD: Loaded 52785 existing records from primary storage. [2025-09-28T02:48:25.574047] [INFO ] [MAIN ] COLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:25.574965] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COLD took 0.9s. Estimated remaining: 8m 14s. Rate: 226.3 symbols/min [2025-09-28T02:48:25.658845] [DEBUG] [LOCAL ] CON: Loaded 39289 existing records from primary storage. [2025-09-28T02:48:25.712404] [INFO ] [MAIN ] CON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:25.733279] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. CON took 0.9s. Estimated remaining: 8m 14s. Rate: 226.5 symbols/min [2025-09-28T02:48:25.733040] [DEBUG] [LOCAL ] COMP: Loaded 54166 existing records from primary storage. [2025-09-28T02:48:25.776439] [DEBUG] [LOCAL ] COOK: Loaded 24850 existing records from primary storage. [2025-09-28T02:48:25.766743] [INFO ] [MAIN ] COMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:25.861133] [INFO ] [MAIN ] COOK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:25.860809] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. COMP took 1.1s. Estimated remaining: 8m 13s. Rate: 226.8 symbols/min [2025-09-28T02:48:25.866727] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COOK took 0.5s. Estimated remaining: 8m 12s. Rate: 227.2 symbols/min [2025-09-28T02:48:26.074171] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:26.211453] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:26.364283] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:26.412221] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:26.484468] [DEBUG] [LOCAL ] COR: Loaded 47937 existing records from primary storage. [2025-09-28T02:48:26.501150] [INFO ] [MAIN ] COR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:26.502704] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COR took 0.8s. Estimated remaining: 8m 13s. Rate: 226.6 symbols/min [2025-09-28T02:48:26.504204] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-09-28T02:48:26.538127] [INFO ] [MAIN ] COP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:26.539003] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COP took 1.0s. Estimated remaining: 8m 12s. Rate: 227.0 symbols/min [2025-09-28T02:48:26.659143] [DEBUG] [LOCAL ] COUR: Loaded 49636 existing records from primary storage. [2025-09-28T02:48:26.743165] [INFO ] [MAIN ] COUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:26.802224] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COUR took 0.9s. Estimated remaining: 8m 11s. Rate: 227.0 symbols/min [2025-09-28T02:48:26.845971] [DEBUG] [LOCAL ] COTY: Loaded 54014 existing records from primary storage. [2025-09-28T02:48:26.916565] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:26.938619] [INFO ] [MAIN ] COTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:26.968500] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. COTY took 1.1s. Estimated remaining: 8m 11s. Rate: 227.1 symbols/min [2025-09-28T02:48:27.025489] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:27.270995] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:27.296252] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-28T02:48:27.328540] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-28T02:48:27.369940] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:27.370098] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-28T02:48:27.374188] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-28T02:48:27.401803] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-28T02:48:27.402421] [DEBUG] [LOCAL ] CPA: Loaded 29208 existing records from primary storage. [2025-09-28T02:48:27.402558] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-28T02:48:27.403061] [INFO ] [MAIN ] CPA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:27.415183] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CPA took 0.9s. Estimated remaining: 8m 11s. Rate: 226.8 symbols/min [2025-09-28T02:48:27.417041] [DEBUG] [LOCAL ] CP: Loaded 54051 existing records from primary storage. [2025-09-28T02:48:27.442592] [INFO ] [MAIN ] CP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:27.458850] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CP took 1.0s. Estimated remaining: 8m 10s. Rate: 227.2 symbols/min [2025-09-28T02:48:28.039747] [DEBUG] [LOCAL ] CPAY: Loaded 31286 existing records from primary storage. [2025-09-28T02:48:28.075729] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:28.103252] [INFO ] [MAIN ] CPAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:28.150324] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CPAY took 1.2s. Estimated remaining: 8m 11s. Rate: 226.5 symbols/min [2025-09-28T02:48:28.151347] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:28.346153] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:28.358150] [DEBUG] [LOCAL ] CPK: Loaded 13588 existing records from primary storage. [2025-09-28T02:48:28.382672] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-28T02:48:28.383694] [DEBUG] [LOCAL ] CPF: Loaded 15618 existing records from primary storage. [2025-09-28T02:48:28.391071] [INFO ] [MAIN ] CPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:28.383103] [INFO ] [MAIN ] CPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:28.412391] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPK took 0.9s. Estimated remaining: 8m 11s. Rate: 226.5 symbols/min [2025-09-28T02:48:28.433462] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPF took 1.0s. Estimated remaining: 8m 10s. Rate: 226.9 symbols/min [2025-09-28T02:48:28.462507] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:28.524827] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-09-28T02:48:28.525327] [INFO ] [MAIN ] CPNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:28.525887] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPNG took 0.4s. Estimated remaining: 8m 9s. Rate: 227.2 symbols/min [2025-09-28T02:48:28.733383] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-28T02:48:28.734699] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-28T02:48:28.882618] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.15 seconds). [2025-09-28T02:48:28.884232] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-28T02:48:29.108292] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-28T02:48:29.109393] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-28T02:48:29.332505] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-28T02:48:29.333724] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-28T02:48:29.483721] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.15 seconds). [2025-09-28T02:48:29.484899] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-28T02:48:29.717572] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-28T02:48:29.718792] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-28T02:48:29.946459] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-28T02:48:29.947724] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-28T02:48:30.263865] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-28T02:48:30.265081] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-28T02:48:30.495917] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-28T02:48:30.497158] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-28T02:48:30.651713] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.15 seconds). [2025-09-28T02:48:30.652714] [INFO ] [REMOTE ] CPAC: Full fetch complete (1887 records). [2025-09-28T02:48:30.652810] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-28T02:48:30.838619] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:48:30.838854] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:48:30.838954] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:48:30.839108] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-28T02:48:30.839212] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-28T02:48:30.839303] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-28T02:48:30.839411] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-28T02:48:30.839510] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPAC took 4.0s. Estimated remaining: 8m 16s. Rate: 223.8 symbols/min [2025-09-28T02:48:31.500191] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:31.564288] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:31.597816] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:31.622789] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:31.669519] [DEBUG] [LOCAL ] CPS: Loaded 26476 existing records from primary storage. [2025-09-28T02:48:31.670182] [DEBUG] [LOCAL ] CQP: Loaded 20033 existing records from primary storage. [2025-09-28T02:48:31.670543] [INFO ] [MAIN ] CPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:31.671130] [INFO ] [MAIN ] CQP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:31.671399] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 0.8s. Estimated remaining: 8m 18s. Rate: 222.9 symbols/min [2025-09-28T02:48:31.671752] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 0.8s. Estimated remaining: 8m 17s. Rate: 223.3 symbols/min [2025-09-28T02:48:31.965516] [DEBUG] [LOCAL ] CPRI: Loaded 53326 existing records from primary storage. [2025-09-28T02:48:32.039438] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:32.040734] [INFO ] [MAIN ] CPRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:32.076638] [DEBUG] [LOCAL ] CPT: Loaded 45034 existing records from primary storage. [2025-09-28T02:48:32.131761] [INFO ] [MAIN ] CPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:32.077623] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPRI took 1.2s. Estimated remaining: 8m 17s. Rate: 223.1 symbols/min [2025-09-28T02:48:32.132926] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPT took 1.3s. Estimated remaining: 8m 16s. Rate: 223.5 symbols/min [2025-09-28T02:48:32.144369] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:32.401075] [DEBUG] [LOCAL ] CR: Loaded 25019 existing records from primary storage. [2025-09-28T02:48:32.417625] [INFO ] [MAIN ] CR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:32.418727] [DEBUG] [LOCAL ] CRBD: Loaded 9131 existing records from primary storage. [2025-09-28T02:48:32.419968] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CR took 0.7s. Estimated remaining: 8m 16s. Rate: 223.4 symbols/min [2025-09-28T02:48:32.420414] [INFO ] [MAIN ] CRBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:32.473977] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CRBD took 0.7s. Estimated remaining: 8m 15s. Rate: 223.8 symbols/min [2025-09-28T02:48:32.646590] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:32.722677] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:32.985094] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:33.008984] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:33.009982] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-28T02:48:33.010283] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-28T02:48:33.010450] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-28T02:48:33.010511] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-28T02:48:33.010562] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-28T02:48:33.010603] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-28T02:48:33.179779] [DEBUG] [LOCAL ] CRC: Loaded 44946 existing records from primary storage. [2025-09-28T02:48:33.248016] [DEBUG] [LOCAL ] CRBG: Loaded 53110 existing records from primary storage. [2025-09-28T02:48:33.232092] [INFO ] [MAIN ] CRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:33.248999] [INFO ] [MAIN ] CRBG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:33.254863] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBG took 1.1s. Estimated remaining: 8m 16s. Rate: 223.0 symbols/min [2025-09-28T02:48:33.311430] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRC took 1.2s. Estimated remaining: 8m 15s. Rate: 223.3 symbols/min [2025-09-28T02:48:33.633821] [DEBUG] [LOCAL ] CRGY: Loaded 53290 existing records from primary storage. [2025-09-28T02:48:33.719461] [INFO ] [MAIN ] CRGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:33.826778] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:33.823497] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRGY took 1.3s. Estimated remaining: 8m 16s. Rate: 222.9 symbols/min [2025-09-28T02:48:33.919069] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:33.973929] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-28T02:48:34.037700] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:34.170899] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:34.229555] [DEBUG] [LOCAL ] CRH: Loaded 54243 existing records from primary storage. [2025-09-28T02:48:34.230503] [INFO ] [MAIN ] CRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:34.231261] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRH took 1.0s. Estimated remaining: 8m 16s. Rate: 222.7 symbols/min [2025-09-28T02:48:34.238065] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:48:34.239577] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-28T02:48:34.281339] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:48:34.334264] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-09-28T02:48:34.334487] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:48:34.365037] [DEBUG] [LOCAL ] CRI: Loaded 50713 existing records from primary storage. [2025-09-28T02:48:34.357948] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-28T02:48:34.365825] [INFO ] [MAIN ] CRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:34.371382] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-28T02:48:34.377510] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRI took 1.0s. Estimated remaining: 8m 15s. Rate: 222.9 symbols/min [2025-09-28T02:48:34.400314] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-28T02:48:34.416851] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-28T02:48:34.481711] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRCL took 2.0s. Estimated remaining: 8m 14s. Rate: 223.2 symbols/min [2025-09-28T02:48:34.470767] [DEBUG] [LOCAL ] CRK: Loaded 52891 existing records from primary storage. [2025-09-28T02:48:34.565843] [INFO ] [MAIN ] CRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:34.597990] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:34.622097] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRK took 0.7s. Estimated remaining: 8m 14s. Rate: 223.4 symbols/min [2025-09-28T02:48:34.768113] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:35.128448] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:35.130160] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:35.133931] [DEBUG] [LOCAL ] CRL: Loaded 43853 existing records from primary storage. [2025-09-28T02:48:35.135038] [INFO ] [MAIN ] CRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:35.155051] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRL took 0.9s. Estimated remaining: 8m 14s. Rate: 222.9 symbols/min [2025-09-28T02:48:35.211706] [DEBUG] [LOCAL ] CRT: Loaded 5018 existing records from primary storage. [2025-09-28T02:48:35.238093] [INFO ] [MAIN ] CRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:35.258799] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRT took 0.6s. Estimated remaining: 8m 14s. Rate: 223.2 symbols/min [2025-09-28T02:48:35.310145] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-09-28T02:48:35.403811] [INFO ] [MAIN ] CRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:35.455739] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:35.467554] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRM took 1.1s. Estimated remaining: 8m 13s. Rate: 223.3 symbols/min [2025-09-28T02:48:35.630112] [DEBUG] [LOCAL ] CRS: Loaded 43928 existing records from primary storage. [2025-09-28T02:48:35.663989] [INFO ] [MAIN ] CRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:35.677470] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRS took 1.1s. Estimated remaining: 8m 13s. Rate: 223.4 symbols/min [2025-09-28T02:48:35.783058] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:35.956893] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:35.980922] [DEBUG] [LOCAL ] CSAN: Loaded 42951 existing records from primary storage. [2025-09-28T02:48:36.004862] [INFO ] [MAIN ] CSAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:36.020959] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSAN took 0.9s. Estimated remaining: 8m 13s. Rate: 223.3 symbols/min [2025-09-28T02:48:36.043376] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:36.121109] [DEBUG] [LOCAL ] CSR: Loaded 12808 existing records from primary storage. [2025-09-28T02:48:36.147982] [INFO ] [MAIN ] CSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:36.159474] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSR took 0.7s. Estimated remaining: 8m 12s. Rate: 223.5 symbols/min [2025-09-28T02:48:36.261003] [DEBUG] [LOCAL ] CSL: Loaded 32100 existing records from primary storage. [2025-09-28T02:48:36.329389] [INFO ] [MAIN ] CSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:36.382294] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:36.387552] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSL took 1.1s. Estimated remaining: 8m 11s. Rate: 223.5 symbols/min [2025-09-28T02:48:36.479950] [DEBUG] [LOCAL ] CSTM: Loaded 48360 existing records from primary storage. [2025-09-28T02:48:36.617865] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:36.618798] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-28T02:48:36.618526] [DEBUG] [LOCAL ] CSV: Loaded 13198 existing records from primary storage. [2025-09-28T02:48:36.591861] [INFO ] [MAIN ] CSTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:36.619043] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-28T02:48:36.619369] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSTM took 0.9s. Estimated remaining: 8m 11s. Rate: 223.6 symbols/min [2025-09-28T02:48:36.635715] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-28T02:48:36.619493] [INFO ] [MAIN ] CSV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:36.657427] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-28T02:48:36.687061] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSV took 0.6s. Estimated remaining: 8m 10s. Rate: 223.9 symbols/min [2025-09-28T02:48:36.721235] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-28T02:48:36.825236] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:36.818744] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-28T02:48:37.121774] [DEBUG] [LOCAL ] CTBB: Loaded 7168 existing records from primary storage. [2025-09-28T02:48:37.153403] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:37.184781] [INFO ] [MAIN ] CTBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:37.213714] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTBB took 0.8s. Estimated remaining: 8m 11s. Rate: 223.5 symbols/min [2025-09-28T02:48:37.290330] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:37.320059] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-28T02:48:37.347730] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-28T02:48:37.374349] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-28T02:48:37.400766] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-28T02:48:37.435772] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-28T02:48:37.445121] [DEBUG] [LOCAL ] CTDD: Loaded 5947 existing records from primary storage. [2025-09-28T02:48:37.512407] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-28T02:48:37.512735] [INFO ] [MAIN ] CTDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:37.546002] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTDD took 0.9s. Estimated remaining: 8m 11s. Rate: 223.4 symbols/min [2025-09-28T02:48:37.886871] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:37.859438] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:37.955398] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-28T02:48:37.913503] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-28T02:48:37.989412] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-28T02:48:38.027877] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-28T02:48:38.047870] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-28T02:48:38.069336] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-28T02:48:38.114269] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-28T02:48:38.210253] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:38.283938] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:48:38.358828] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-28T02:48:38.386386] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:48:38.396854] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-09-28T02:48:38.451116] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:38.494381] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-28T02:48:38.494007] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:48:38.495164] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-28T02:48:38.515560] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-28T02:48:38.567563] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-28T02:48:38.633530] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-28T02:48:38.645565] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CSW took 2.5s. Estimated remaining: 8m 13s. Rate: 222.1 symbols/min [2025-09-28T02:48:38.707382] [DEBUG] [LOCAL ] CTO: Loaded 28661 existing records from primary storage. [2025-09-28T02:48:38.732351] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:48:38.737922] [INFO ] [MAIN ] CTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:38.750926] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-28T02:48:38.822994] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:48:38.766597] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTO took 1.2s. Estimated remaining: 8m 12s. Rate: 222.4 symbols/min [2025-09-28T02:48:38.833569] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-09-28T02:48:38.857878] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:48:38.875336] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:38.891150] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-28T02:48:38.891248] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-28T02:48:38.953633] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-28T02:48:39.008111] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:39.013564] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-28T02:48:39.066569] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-28T02:48:39.067418] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTEST took 2.3s. Estimated remaining: 8m 12s. Rate: 222.3 symbols/min [2025-09-28T02:48:39.276782] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:39.275583] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:48:39.311123] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-28T02:48:39.346829] [DEBUG] [LOCAL ] CTOS: Loaded 37246 existing records from primary storage. [2025-09-28T02:48:39.382342] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:48:39.382586] [INFO ] [MAIN ] CTOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:39.382706] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-09-28T02:48:39.384441] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTOS took 0.7s. Estimated remaining: 8m 12s. Rate: 222.3 symbols/min [2025-09-28T02:48:39.390479] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:48:39.421859] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:39.437857] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-28T02:48:39.483208] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-28T02:48:39.494618] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-28T02:48:39.510812] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-28T02:48:39.528448] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTEV took 2.3s. Estimated remaining: 8m 11s. Rate: 222.4 symbols/min [2025-09-28T02:48:39.682717] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:39.781752] [DEBUG] [LOCAL ] CTRA: Loaded 54428 existing records from primary storage. [2025-09-28T02:48:39.807566] [INFO ] [MAIN ] CTRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:39.824217] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 1.0s. Estimated remaining: 8m 11s. Rate: 222.4 symbols/min [2025-09-28T02:48:39.859198] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:40.008314] [DEBUG] [LOCAL ] CTRE: Loaded 49964 existing records from primary storage. [2025-09-28T02:48:40.086524] [INFO ] [MAIN ] CTRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:40.091638] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:40.092784] [DEBUG] [LOCAL ] CTRI: Loaded 38571 existing records from primary storage. [2025-09-28T02:48:40.093500] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRE took 1.0s. Estimated remaining: 8m 11s. Rate: 222.4 symbols/min [2025-09-28T02:48:40.094404] [INFO ] [MAIN ] CTRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:40.101174] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRI took 0.7s. Estimated remaining: 8m 10s. Rate: 222.8 symbols/min [2025-09-28T02:48:40.221890] [DEBUG] [LOCAL ] CTS: Loaded 19637 existing records from primary storage. [2025-09-28T02:48:40.297737] [INFO ] [MAIN ] CTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:40.303438] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTS took 0.8s. Estimated remaining: 8m 9s. Rate: 222.9 symbols/min [2025-09-28T02:48:40.514381] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:40.604855] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-28T02:48:40.605962] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:40.627601] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-28T02:48:40.653969] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-28T02:48:40.654537] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-28T02:48:40.654637] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-28T02:48:40.665406] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-28T02:48:40.689709] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:40.797502] [DEBUG] [LOCAL ] CTVA: Loaded 54002 existing records from primary storage. [2025-09-28T02:48:40.827156] [INFO ] [MAIN ] CTVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:40.830064] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CTVA took 1.0s. Estimated remaining: 8m 10s. Rate: 222.5 symbols/min [2025-09-28T02:48:41.091801] [DEBUG] [LOCAL ] CUBI: Loaded 27667 existing records from primary storage. [2025-09-28T02:48:41.189775] [INFO ] [MAIN ] CUBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:41.256823] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CUBI took 0.9s. Estimated remaining: 8m 10s. Rate: 222.3 symbols/min [2025-09-28T02:48:41.302291] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:41.258149] [DEBUG] [LOCAL ] CUBE: Loaded 51391 existing records from primary storage. [2025-09-28T02:48:41.407745] [INFO ] [MAIN ] CUBE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:41.463564] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:41.480778] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-28T02:48:41.487115] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBE took 1.4s. Estimated remaining: 8m 10s. Rate: 222.3 symbols/min [2025-09-28T02:48:41.633915] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:41.784038] [DEBUG] [LOCAL ] CULP: Loaded 3111 existing records from primary storage. [2025-09-28T02:48:41.825046] [INFO ] [MAIN ] CULP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:41.807132] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:41.824727] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-28T02:48:41.826488] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-28T02:48:41.826939] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CULP took 0.6s. Estimated remaining: 8m 10s. Rate: 222.2 symbols/min [2025-09-28T02:48:41.830500] [DEBUG] [LOCAL ] CUK: Loaded 51762 existing records from primary storage. [2025-09-28T02:48:41.831016] [INFO ] [MAIN ] CUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:41.831339] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CUK took 1.0s. Estimated remaining: 8m 9s. Rate: 222.6 symbols/min [2025-09-28T02:48:41.869239] [DEBUG] [LOCAL ] CURB: Loaded 33350 existing records from primary storage. [2025-09-28T02:48:41.869583] [INFO ] [MAIN ] CURB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:41.869731] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CURB took 0.3s. Estimated remaining: 8m 8s. Rate: 223.0 symbols/min [2025-09-28T02:48:42.058242] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-09-28T02:48:42.059283] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-28T02:48:42.284602] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-28T02:48:42.285580] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-28T02:48:42.507195] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-28T02:48:42.508272] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-28T02:48:42.741907] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-28T02:48:42.743106] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-28T02:48:42.967575] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-28T02:48:42.968666] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-28T02:48:43.118580] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.15 seconds). [2025-09-28T02:48:43.119536] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-28T02:48:43.272256] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.15 seconds). [2025-09-28T02:48:43.273383] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-28T02:48:43.495123] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-28T02:48:43.496202] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-28T02:48:43.726220] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-28T02:48:43.727178] [INFO ] [REMOTE ] CUBB: Full fetch complete (928 records). [2025-09-28T02:48:43.727279] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-28T02:48:43.921283] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-28T02:48:43.921485] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:48:43.921560] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:48:43.921736] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-28T02:48:43.921844] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-28T02:48:43.921935] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-28T02:48:43.922059] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-28T02:48:43.922166] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CUBB took 3.8s. Estimated remaining: 8m 13s. Rate: 220.4 symbols/min [2025-09-28T02:48:44.522873] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:44.628717] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:44.685610] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:44.707556] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:44.740480] [DEBUG] [LOCAL ] CURV: Loaded 26933 existing records from primary storage. [2025-09-28T02:48:44.749660] [INFO ] [MAIN ] CURV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:44.750102] [DEBUG] [LOCAL ] CVEO: Loaded 15402 existing records from primary storage. [2025-09-28T02:48:44.750832] [INFO ] [MAIN ] CVEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:44.750697] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CURV took 0.8s. Estimated remaining: 8m 15s. Rate: 219.6 symbols/min [2025-09-28T02:48:44.761734] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CVEO took 0.8s. Estimated remaining: 8m 14s. Rate: 219.9 symbols/min [2025-09-28T02:48:45.090145] [DEBUG] [LOCAL ] CUZ: Loaded 50140 existing records from primary storage. [2025-09-28T02:48:45.098701] [INFO ] [MAIN ] CUZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:45.121438] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CUZ took 1.2s. Estimated remaining: 8m 14s. Rate: 219.8 symbols/min [2025-09-28T02:48:45.125554] [DEBUG] [LOCAL ] CVE: Loaded 54336 existing records from primary storage. [2025-09-28T02:48:45.139753] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:45.208628] [INFO ] [MAIN ] CVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:45.300819] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CVE took 1.4s. Estimated remaining: 8m 13s. Rate: 219.9 symbols/min [2025-09-28T02:48:45.289829] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:45.489725] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:45.596933] [DEBUG] [LOCAL ] CVLG: Loaded 15730 existing records from primary storage. [2025-09-28T02:48:45.635612] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:45.636294] [INFO ] [MAIN ] CVLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:45.637811] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 0.8s. Estimated remaining: 8m 13s. Rate: 219.9 symbols/min [2025-09-28T02:48:45.639177] [DEBUG] [LOCAL ] CVI: Loaded 47160 existing records from primary storage. [2025-09-28T02:48:45.667049] [INFO ] [MAIN ] CVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:45.690705] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 0.9s. Estimated remaining: 8m 12s. Rate: 220.2 symbols/min [2025-09-28T02:48:46.014996] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:46.109421] [DEBUG] [LOCAL ] CVS: Loaded 54476 existing records from primary storage. [2025-09-28T02:48:46.084911] [DEBUG] [LOCAL ] CVNA: Loaded 53766 existing records from primary storage. [2025-09-28T02:48:46.110570] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:46.111287] [INFO ] [MAIN ] CVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:46.111675] [INFO ] [MAIN ] CVNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:46.112839] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVS took 0.8s. Estimated remaining: 8m 12s. Rate: 220.0 symbols/min [2025-09-28T02:48:46.119224] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVNA took 1.0s. Estimated remaining: 8m 11s. Rate: 220.3 symbols/min [2025-09-28T02:48:46.444856] [DEBUG] [LOCAL ] CW: Loaded 22705 existing records from primary storage. [2025-09-28T02:48:46.516529] [INFO ] [MAIN ] CW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:46.520550] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:46.534061] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CW took 0.8s. Estimated remaining: 8m 11s. Rate: 220.1 symbols/min [2025-09-28T02:48:46.554161] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:46.674126] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-09-28T02:48:46.706733] [INFO ] [MAIN ] CVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:46.769219] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CVX took 1.1s. Estimated remaining: 8m 11s. Rate: 220.2 symbols/min [2025-09-28T02:48:46.773096] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:47.003035] [DEBUG] [LOCAL ] CWAN: Loaded 53154 existing records from primary storage. [2025-09-28T02:48:47.005256] [DEBUG] [LOCAL ] CWEN: Loaded 45717 existing records from primary storage. [2025-09-28T02:48:47.025599] [INFO ] [MAIN ] CWAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:47.025359] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:47.026558] [INFO ] [MAIN ] CWEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:47.026407] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWAN took 0.9s. Estimated remaining: 8m 10s. Rate: 220.2 symbols/min [2025-09-28T02:48:47.032617] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWEN took 0.9s. Estimated remaining: 8m 9s. Rate: 220.6 symbols/min [2025-09-28T02:48:47.316888] [DEBUG] [LOCAL ] CWH: Loaded 52151 existing records from primary storage. [2025-09-28T02:48:47.391187] [INFO ] [MAIN ] CWH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:47.402256] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:47.395856] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWH took 0.8s. Estimated remaining: 8m 9s. Rate: 220.5 symbols/min [2025-09-28T02:48:47.527756] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:47.535290] [DEBUG] [LOCAL ] CWK: Loaded 50158 existing records from primary storage. [2025-09-28T02:48:47.593024] [INFO ] [MAIN ] CWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:47.611700] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWK took 0.8s. Estimated remaining: 8m 9s. Rate: 220.5 symbols/min [2025-09-28T02:48:47.830536] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:47.866373] [DEBUG] [LOCAL ] CWT: Loaded 28294 existing records from primary storage. [2025-09-28T02:48:47.925176] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:47.920262] [INFO ] [MAIN ] CWT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:47.930891] [DEBUG] [LOCAL ] CXE: Loaded 7247 existing records from primary storage. [2025-09-28T02:48:47.930426] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWT took 0.9s. Estimated remaining: 8m 9s. Rate: 220.5 symbols/min [2025-09-28T02:48:47.945587] [INFO ] [MAIN ] CXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:47.992627] [DEBUG] [LOCAL ] CX: Loaded 53603 existing records from primary storage. [2025-09-28T02:48:47.979618] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CXE took 0.6s. Estimated remaining: 8m 8s. Rate: 220.8 symbols/min [2025-09-28T02:48:48.063746] [DEBUG] [LOCAL ] CXH: Loaded 4436 existing records from primary storage. [2025-09-28T02:48:48.023179] [INFO ] [MAIN ] CX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:48.097276] [INFO ] [MAIN ] CXH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:48.097456] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXH took 0.5s. Estimated remaining: 8m 7s. Rate: 221.0 symbols/min [2025-09-28T02:48:48.184744] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CX took 1.1s. Estimated remaining: 8m 6s. Rate: 221.3 symbols/min [2025-09-28T02:48:48.377251] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:48.553318] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:48.684334] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:48.714430] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:48.751463] [DEBUG] [LOCAL ] CXT: Loaded 31611 existing records from primary storage. [2025-09-28T02:48:48.752197] [INFO ] [MAIN ] CXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:48.752322] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXT took 0.7s. Estimated remaining: 8m 7s. Rate: 220.8 symbols/min [2025-09-28T02:48:48.898469] [DEBUG] [LOCAL ] CYD: Loaded 27145 existing records from primary storage. [2025-09-28T02:48:48.880790] [DEBUG] [LOCAL ] CXM: Loaded 48607 existing records from primary storage. [2025-09-28T02:48:48.899086] [INFO ] [MAIN ] CYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:48.899297] [INFO ] [MAIN ] CXM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:48.920899] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXM took 1.0s. Estimated remaining: 8m 6s. Rate: 221.0 symbols/min [2025-09-28T02:48:48.931668] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CYD took 0.7s. Estimated remaining: 8m 5s. Rate: 221.3 symbols/min [2025-09-28T02:48:49.048370] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:49.170686] [DEBUG] [LOCAL ] CXW: Loaded 44899 existing records from primary storage. [2025-09-28T02:48:49.217426] [INFO ] [MAIN ] CXW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:49.241885] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CXW took 1.1s. Estimated remaining: 8m 5s. Rate: 221.3 symbols/min [2025-09-28T02:48:49.542823] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:49.562251] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:49.661223] [DEBUG] [LOCAL ] CYH: Loaded 48352 existing records from primary storage. [2025-09-28T02:48:49.666002] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:49.666836] [INFO ] [MAIN ] CYH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:49.668271] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. CYH took 0.9s. Estimated remaining: 8m 5s. Rate: 221.1 symbols/min [2025-09-28T02:48:49.715750] [DEBUG] [LOCAL ] DAC: Loaded 12769 existing records from primary storage. [2025-09-28T02:48:49.772164] [INFO ] [MAIN ] DAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:49.785982] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. DAC took 0.8s. Estimated remaining: 8m 5s. Rate: 221.3 symbols/min [2025-09-28T02:48:50.001444] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:50.096872] [DEBUG] [LOCAL ] D: Loaded 54426 existing records from primary storage. [2025-09-28T02:48:50.122350] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:50.123703] [INFO ] [MAIN ] D: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:50.124466] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. D took 1.2s. Estimated remaining: 8m 4s. Rate: 221.2 symbols/min [2025-09-28T02:48:50.197094] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-09-28T02:48:50.237016] [INFO ] [MAIN ] DAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:50.260448] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAL took 1.0s. Estimated remaining: 8m 4s. Rate: 221.4 symbols/min [2025-09-28T02:48:50.358931] [DEBUG] [LOCAL ] DAO: Loaded 21546 existing records from primary storage. [2025-09-28T02:48:50.438784] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:50.449729] [INFO ] [MAIN ] DAO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:50.477926] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAO took 0.7s. Estimated remaining: 8m 3s. Rate: 221.5 symbols/min [2025-09-28T02:48:50.467012] [DEBUG] [LOCAL ] DAN: Loaded 49753 existing records from primary storage. [2025-09-28T02:48:50.516537] [INFO ] [MAIN ] DAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:50.572639] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAN took 0.9s. Estimated remaining: 8m 3s. Rate: 221.7 symbols/min [2025-09-28T02:48:50.737316] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:51.002974] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:50.983980] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:51.009759] [DEBUG] [LOCAL ] DAR: Loaded 52603 existing records from primary storage. [2025-09-28T02:48:51.010819] [INFO ] [MAIN ] DAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:51.011737] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 0.9s. Estimated remaining: 8m 3s. Rate: 221.5 symbols/min [2025-09-28T02:48:51.168172] [DEBUG] [LOCAL ] DAVA: Loaded 41308 existing records from primary storage. [2025-09-28T02:48:51.191556] [INFO ] [MAIN ] DAVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:51.223223] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAVA took 0.9s. Estimated remaining: 8m 2s. Rate: 221.6 symbols/min [2025-09-28T02:48:51.276802] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:51.379198] [DEBUG] [LOCAL ] DAY: Loaded 50491 existing records from primary storage. [2025-09-28T02:48:51.410011] [INFO ] [MAIN ] DAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:51.409709] [DEBUG] [LOCAL ] DB: Loaded 53377 existing records from primary storage. [2025-09-28T02:48:51.416059] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAY took 0.9s. Estimated remaining: 8m 2s. Rate: 221.7 symbols/min [2025-09-28T02:48:51.421599] [INFO ] [MAIN ] DB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:51.448942] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DB took 0.8s. Estimated remaining: 8m 1s. Rate: 222.0 symbols/min [2025-09-28T02:48:51.595321] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:51.641679] [DEBUG] [LOCAL ] DBD: Loaded 24109 existing records from primary storage. [2025-09-28T02:48:51.713598] [INFO ] [MAIN ] DBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:51.751950] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DBD took 0.7s. Estimated remaining: 8m 1s. Rate: 221.9 symbols/min [2025-09-28T02:48:51.847582] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:51.926867] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:52.023774] [DEBUG] [LOCAL ] DBL: Loaded 9259 existing records from primary storage. [2025-09-28T02:48:52.084840] [DEBUG] [LOCAL ] DBI: Loaded 45524 existing records from primary storage. [2025-09-28T02:48:52.113698] [INFO ] [MAIN ] DBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:52.113373] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:52.115598] [INFO ] [MAIN ] DBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:52.115143] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 0.7s. Estimated remaining: 8m 1s. Rate: 221.8 symbols/min [2025-09-28T02:48:52.121953] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBI took 0.9s. Estimated remaining: 7m 60s. Rate: 222.2 symbols/min [2025-09-28T02:48:52.434196] [DEBUG] [LOCAL ] DBRG: Loaded 50526 existing records from primary storage. [2025-09-28T02:48:52.510787] [INFO ] [MAIN ] DBRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:52.526900] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:52.563805] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:52.565418] [DEBUG] [LOCAL ] DCI: Loaded 38065 existing records from primary storage. [2025-09-28T02:48:52.564524] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBRG took 1.0s. Estimated remaining: 7m 60s. Rate: 221.9 symbols/min [2025-09-28T02:48:52.567178] [INFO ] [MAIN ] DCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:52.599931] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DCI took 0.8s. Estimated remaining: 7m 59s. Rate: 222.3 symbols/min [2025-09-28T02:48:52.682426] [DEBUG] [LOCAL ] DCO: Loaded 14003 existing records from primary storage. [2025-09-28T02:48:52.695383] [INFO ] [MAIN ] DCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:52.695986] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 0.6s. Estimated remaining: 7m 58s. Rate: 222.5 symbols/min [2025-09-28T02:48:52.771984] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:52.814256] [DEBUG] [LOCAL ] DD: Loaded 53595 existing records from primary storage. [2025-09-28T02:48:52.814815] [INFO ] [MAIN ] DD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:52.815422] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 0.7s. Estimated remaining: 7m 57s. Rate: 222.7 symbols/min [2025-09-28T02:48:52.863478] [DEBUG] [LOCAL ] DDD: Loaded 51647 existing records from primary storage. [2025-09-28T02:48:52.863926] [INFO ] [MAIN ] DDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:52.864375] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 0.3s. Estimated remaining: 7m 56s. Rate: 223.0 symbols/min [2025-09-28T02:48:53.424111] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:53.549290] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:53.615983] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:53.652460] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:53.660537] [DEBUG] [LOCAL ] DDT: Loaded 2117 existing records from primary storage. [2025-09-28T02:48:53.671229] [INFO ] [MAIN ] DDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:53.671568] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 0.8s. Estimated remaining: 7m 58s. Rate: 222.3 symbols/min [2025-09-28T02:48:53.745138] [DEBUG] [LOCAL ] DDS: Loaded 13374 existing records from primary storage. [2025-09-28T02:48:53.770239] [INFO ] [MAIN ] DDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:53.770625] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 0.9s. Estimated remaining: 7m 57s. Rate: 222.5 symbols/min [2025-09-28T02:48:53.831756] [DEBUG] [LOCAL ] DDL: Loaded 37016 existing records from primary storage. [2025-09-28T02:48:53.865295] [INFO ] [MAIN ] DDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:53.929308] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 1.1s. Estimated remaining: 7m 56s. Rate: 222.7 symbols/min [2025-09-28T02:48:54.076227] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:54.095693] [DEBUG] [LOCAL ] DE: Loaded 48397 existing records from primary storage. [2025-09-28T02:48:54.127565] [INFO ] [MAIN ] DE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:54.149004] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 1.3s. Estimated remaining: 7m 56s. Rate: 222.7 symbols/min [2025-09-28T02:48:54.341554] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:54.463127] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:54.564246] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:54.587277] [DEBUG] [LOCAL ] DEA: Loaded 41860 existing records from primary storage. [2025-09-28T02:48:54.588108] [INFO ] [MAIN ] DEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:54.588266] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 0.9s. Estimated remaining: 7m 56s. Rate: 222.5 symbols/min [2025-09-28T02:48:54.736412] [DEBUG] [LOCAL ] DEC: Loaded 31121 existing records from primary storage. [2025-09-28T02:48:54.752781] [INFO ] [MAIN ] DEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:54.793553] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEC took 1.0s. Estimated remaining: 7m 56s. Rate: 222.6 symbols/min [2025-09-28T02:48:54.823412] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:54.895275] [DEBUG] [LOCAL ] DECK: Loaded 54078 existing records from primary storage. [2025-09-28T02:48:54.939050] [INFO ] [MAIN ] DECK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:54.952261] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DECK took 0.9s. Estimated remaining: 7m 55s. Rate: 222.7 symbols/min [2025-09-28T02:48:55.020338] [DEBUG] [LOCAL ] DEI: Loaded 49204 existing records from primary storage. [2025-09-28T02:48:55.063422] [INFO ] [MAIN ] DEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:55.152245] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DEI took 1.0s. Estimated remaining: 7m 55s. Rate: 222.8 symbols/min [2025-09-28T02:48:55.173972] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:55.304016] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:55.431838] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-09-28T02:48:55.483976] [INFO ] [MAIN ] DELL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:55.514896] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 0.9s. Estimated remaining: 7m 55s. Rate: 222.7 symbols/min [2025-09-28T02:48:55.514367] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:55.641913] [DEBUG] [LOCAL ] DFH: Loaded 33106 existing records from primary storage. [2025-09-28T02:48:55.677555] [INFO ] [MAIN ] DFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:55.677830] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DFH took 0.7s. Estimated remaining: 7m 54s. Rate: 222.9 symbols/min [2025-09-28T02:48:55.694912] [DEBUG] [LOCAL ] DEO: Loaded 49777 existing records from primary storage. [2025-09-28T02:48:55.754770] [INFO ] [MAIN ] DEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:55.830558] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DEO took 1.0s. Estimated remaining: 7m 54s. Rate: 223.0 symbols/min [2025-09-28T02:48:55.810854] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:55.964098] [DEBUG] [LOCAL ] DFIN: Loaded 23650 existing records from primary storage. [2025-09-28T02:48:55.994559] [INFO ] [MAIN ] DFIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:56.041105] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFIN took 0.9s. Estimated remaining: 7m 53s. Rate: 223.1 symbols/min [2025-09-28T02:48:56.147608] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:56.183474] [DEBUG] [LOCAL ] DFP: Loaded 11771 existing records from primary storage. [2025-09-28T02:48:56.205708] [INFO ] [MAIN ] DFP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:56.236619] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFP took 0.7s. Estimated remaining: 7m 53s. Rate: 223.2 symbols/min [2025-09-28T02:48:56.297494] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:56.566068] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:56.672534] [DEBUG] [LOCAL ] DG: Loaded 54068 existing records from primary storage. [2025-09-28T02:48:56.670228] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:56.677787] [INFO ] [MAIN ] DG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:56.678888] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 1.0s. Estimated remaining: 7m 53s. Rate: 223.0 symbols/min [2025-09-28T02:48:56.748842] [DEBUG] [LOCAL ] DHF: Loaded 20835 existing records from primary storage. [2025-09-28T02:48:56.771886] [INFO ] [MAIN ] DHF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:56.789386] [DEBUG] [LOCAL ] DGX: Loaded 45736 existing records from primary storage. [2025-09-28T02:48:56.800062] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DHF took 0.6s. Estimated remaining: 7m 52s. Rate: 223.2 symbols/min [2025-09-28T02:48:56.800622] [INFO ] [MAIN ] DGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:56.856563] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DGX took 1.0s. Estimated remaining: 7m 51s. Rate: 223.4 symbols/min [2025-09-28T02:48:57.082321] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:57.265012] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:57.273242] [DEBUG] [LOCAL ] DHI: Loaded 54147 existing records from primary storage. [2025-09-28T02:48:57.310853] [INFO ] [MAIN ] DHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:57.329802] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHI took 1.0s. Estimated remaining: 7m 52s. Rate: 223.2 symbols/min [2025-09-28T02:48:57.350376] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:57.564923] [DEBUG] [LOCAL ] DHX: Loaded 13404 existing records from primary storage. [2025-09-28T02:48:57.617953] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:57.619851] [INFO ] [MAIN ] DHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:57.622335] [DEBUG] [LOCAL ] DHR: Loaded 54139 existing records from primary storage. [2025-09-28T02:48:57.622682] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHX took 0.7s. Estimated remaining: 7m 51s. Rate: 223.1 symbols/min [2025-09-28T02:48:57.637872] [INFO ] [MAIN ] DHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:57.639446] [DEBUG] [LOCAL ] DHT: Loaded 48583 existing records from primary storage. [2025-09-28T02:48:57.657359] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHR took 1.0s. Estimated remaining: 7m 50s. Rate: 223.4 symbols/min [2025-09-28T02:48:57.725064] [INFO ] [MAIN ] DHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:57.763765] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHT took 1.0s. Estimated remaining: 7m 50s. Rate: 223.7 symbols/min [2025-09-28T02:48:57.944914] [DEBUG] [LOCAL ] DIAX: Loaded 12780 existing records from primary storage. [2025-09-28T02:48:58.043105] [INFO ] [MAIN ] DIAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:58.146743] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DIAX took 0.8s. Estimated remaining: 7m 50s. Rate: 223.5 symbols/min [2025-09-28T02:48:58.155299] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:58.187182] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:58.287271] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:58.461099] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:58.473548] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-28T02:48:58.475273] [DEBUG] [LOCAL ] DIN: Loaded 37823 existing records from primary storage. [2025-09-28T02:48:58.473892] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-28T02:48:58.492273] [INFO ] [MAIN ] DIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:58.492537] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-28T02:48:58.492950] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-28T02:48:58.493100] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIN took 0.9s. Estimated remaining: 7m 50s. Rate: 223.4 symbols/min [2025-09-28T02:48:58.493282] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-28T02:48:58.498802] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-28T02:48:58.783458] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-09-28T02:48:58.778180] [DEBUG] [LOCAL ] DINO: Loaded 53729 existing records from primary storage. [2025-09-28T02:48:58.811749] [INFO ] [MAIN ] DINO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:58.801215] [INFO ] [MAIN ] DIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:58.843505] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DINO took 1.2s. Estimated remaining: 7m 50s. Rate: 223.3 symbols/min [2025-09-28T02:48:58.922775] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIS took 1.1s. Estimated remaining: 7m 49s. Rate: 223.5 symbols/min [2025-09-28T02:48:59.073984] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:59.468006] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:59.549198] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:48:59.595336] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:48:59.613343] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-28T02:48:59.663607] [DEBUG] [LOCAL ] DK: Loaded 50093 existing records from primary storage. [2025-09-28T02:48:59.669182] [INFO ] [MAIN ] DK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:59.669464] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DK took 1.2s. Estimated remaining: 7m 50s. Rate: 222.9 symbols/min [2025-09-28T02:48:59.717851] [DEBUG] [LOCAL ] DKL: Loaded 19229 existing records from primary storage. [2025-09-28T02:48:59.752807] [INFO ] [MAIN ] DKL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:59.792545] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DKL took 0.9s. Estimated remaining: 7m 49s. Rate: 223.1 symbols/min [2025-09-28T02:48:59.826793] [DEBUG] [LOCAL ] DKS: Loaded 50579 existing records from primary storage. [2025-09-28T02:48:59.911544] [INFO ] [MAIN ] DKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:48:59.957422] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKS took 0.9s. Estimated remaining: 7m 49s. Rate: 223.2 symbols/min [2025-09-28T02:49:00.004411] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:00.092263] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-28T02:49:00.145068] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-28T02:49:00.211741] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:00.300376] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:00.310920] [DEBUG] [LOCAL ] DLNG: Loaded 6276 existing records from primary storage. [2025-09-28T02:49:00.322535] [INFO ] [MAIN ] DLNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:00.323997] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DLNG took 0.5s. Estimated remaining: 7m 49s. Rate: 223.1 symbols/min [2025-09-28T02:49:00.323802] [DEBUG] [LOCAL ] DLB: Loaded 32601 existing records from primary storage. [2025-09-28T02:49:00.354441] [INFO ] [MAIN ] DLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:00.366286] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DLB took 0.7s. Estimated remaining: 7m 48s. Rate: 223.4 symbols/min [2025-09-28T02:49:00.686060] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-28T02:49:00.732810] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-28T02:49:00.723628] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:00.756846] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:00.780891] [DEBUG] [LOCAL ] DLR: Loaded 51825 existing records from primary storage. [2025-09-28T02:49:00.781928] [INFO ] [MAIN ] DLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:00.782481] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLR took 0.8s. Estimated remaining: 7m 48s. Rate: 223.2 symbols/min [2025-09-28T02:49:00.949382] [DEBUG] [LOCAL ] DLY: Loaded 19800 existing records from primary storage. [2025-09-28T02:49:01.019230] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:01.017009] [INFO ] [MAIN ] DLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:01.020845] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLY took 0.7s. Estimated remaining: 7m 48s. Rate: 223.3 symbols/min [2025-09-28T02:49:01.024059] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-28T02:49:01.025419] [DEBUG] [LOCAL ] DLX: Loaded 29284 existing records from primary storage. [2025-09-28T02:49:01.034370] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-28T02:49:01.067929] [INFO ] [MAIN ] DLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:01.119948] [DEBUG] [LOCAL ] DMA: Loaded 4604 existing records from primary storage. [2025-09-28T02:49:01.079224] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DLX took 0.8s. Estimated remaining: 7m 47s. Rate: 223.5 symbols/min [2025-09-28T02:49:01.152130] [INFO ] [MAIN ] DMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:01.199424] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DMA took 0.4s. Estimated remaining: 7m 46s. Rate: 223.7 symbols/min [2025-09-28T02:49:01.333929] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:01.575860] [DEBUG] [LOCAL ] DMB: Loaded 10254 existing records from primary storage. [2025-09-28T02:49:01.581347] [INFO ] [MAIN ] DMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:01.581089] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:01.595378] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-28T02:49:01.581605] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DMB took 0.6s. Estimated remaining: 7m 46s. Rate: 223.6 symbols/min [2025-09-28T02:49:01.622294] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-28T02:49:01.695706] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:01.777075] [DEBUG] [LOCAL ] DMO: Loaded 9981 existing records from primary storage. [2025-09-28T02:49:01.783018] [INFO ] [MAIN ] DMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:01.783541] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMO took 0.6s. Estimated remaining: 7m 46s. Rate: 223.7 symbols/min [2025-09-28T02:49:01.930783] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:02.046259] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-28T02:49:02.076100] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:02.078557] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-28T02:49:02.099759] [DEBUG] [LOCAL ] DNA: Loaded 48990 existing records from primary storage. [2025-09-28T02:49:02.112794] [INFO ] [MAIN ] DNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:02.113479] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DNA took 0.8s. Estimated remaining: 7m 46s. Rate: 223.6 symbols/min [2025-09-28T02:49:02.252569] [DEBUG] [LOCAL ] DNOW: Loaded 44205 existing records from primary storage. [2025-09-28T02:49:02.310151] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-28T02:49:02.324937] [DEBUG] [LOCAL ] DNP: Loaded 33786 existing records from primary storage. [2025-09-28T02:49:02.294402] [INFO ] [MAIN ] DNOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:02.351450] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNOW took 0.7s. Estimated remaining: 7m 45s. Rate: 223.6 symbols/min [2025-09-28T02:49:02.328572] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-28T02:49:02.351192] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:02.353533] [INFO ] [MAIN ] DNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:02.353681] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNP took 0.6s. Estimated remaining: 7m 44s. Rate: 224.0 symbols/min [2025-09-28T02:49:02.423390] [DEBUG] [LOCAL ] DOC: Loaded 54317 existing records from primary storage. [2025-09-28T02:49:02.423906] [INFO ] [MAIN ] DOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:02.424445] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DOC took 0.3s. Estimated remaining: 7m 43s. Rate: 224.2 symbols/min [2025-09-28T02:49:02.587523] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-28T02:49:02.588593] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-28T02:49:02.889012] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-28T02:49:02.890182] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-28T02:49:03.107751] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-28T02:49:03.108912] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-28T02:49:03.259940] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.15 seconds). [2025-09-28T02:49:03.260861] [INFO ] [REMOTE ] DIVY: Full fetch complete (1720 records). [2025-09-28T02:49:03.260957] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-28T02:49:03.484681] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:49:03.484941] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:03.485019] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:03.485098] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-28T02:49:03.485197] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-28T02:49:03.485271] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-28T02:49:03.485368] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-28T02:49:03.485468] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DIVY took 5.3s. Estimated remaining: 7m 45s. Rate: 223.2 symbols/min [2025-09-28T02:49:04.122631] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:04.205327] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:04.280340] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:04.308513] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:04.382038] [DEBUG] [LOCAL ] DOUG: Loaded 35254 existing records from primary storage. [2025-09-28T02:49:04.396894] [DEBUG] [LOCAL ] DOCS: Loaded 51956 existing records from primary storage. [2025-09-28T02:49:04.395306] [INFO ] [MAIN ] DOUG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:04.397869] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOUG took 0.9s. Estimated remaining: 7m 47s. Rate: 222.4 symbols/min [2025-09-28T02:49:04.398483] [INFO ] [MAIN ] DOCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:04.414370] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOCS took 0.9s. Estimated remaining: 7m 46s. Rate: 222.7 symbols/min [2025-09-28T02:49:04.662567] [DEBUG] [LOCAL ] DOLE: Loaded 38568 existing records from primary storage. [2025-09-28T02:49:04.674110] [DEBUG] [LOCAL ] DOCN: Loaded 51245 existing records from primary storage. [2025-09-28T02:49:04.722079] [INFO ] [MAIN ] DOLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:04.734268] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOLE took 1.2s. Estimated remaining: 7m 46s. Rate: 222.6 symbols/min [2025-09-28T02:49:04.722684] [INFO ] [MAIN ] DOCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:04.806888] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCN took 1.3s. Estimated remaining: 7m 45s. Rate: 222.9 symbols/min [2025-09-28T02:49:04.901372] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:04.952943] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:05.287352] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:05.314485] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:05.332178] [DEBUG] [LOCAL ] DOV: Loaded 46376 existing records from primary storage. [2025-09-28T02:49:05.333264] [INFO ] [MAIN ] DOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:05.333857] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DOV took 0.9s. Estimated remaining: 7m 45s. Rate: 222.6 symbols/min [2025-09-28T02:49:05.421666] [DEBUG] [LOCAL ] DPG: Loaded 13683 existing records from primary storage. [2025-09-28T02:49:05.474286] [INFO ] [MAIN ] DPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:05.480759] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DPG took 0.7s. Estimated remaining: 7m 45s. Rate: 222.7 symbols/min [2025-09-28T02:49:05.597544] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-09-28T02:49:05.648129] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:05.648268] [INFO ] [MAIN ] DOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:05.693691] [DEBUG] [LOCAL ] DQ: Loaded 43880 existing records from primary storage. [2025-09-28T02:49:05.718841] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DOW took 1.3s. Estimated remaining: 7m 44s. Rate: 222.8 symbols/min [2025-09-28T02:49:05.734746] [INFO ] [MAIN ] DQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:05.805021] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DQ took 0.9s. Estimated remaining: 7m 44s. Rate: 223.0 symbols/min [2025-09-28T02:49:05.925860] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:06.091829] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:06.159176] [DEBUG] [LOCAL ] DRD: Loaded 37397 existing records from primary storage. [2025-09-28T02:49:06.186069] [INFO ] [MAIN ] DRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:06.212314] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 0.9s. Estimated remaining: 7m 44s. Rate: 222.8 symbols/min [2025-09-28T02:49:06.245132] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:06.456413] [DEBUG] [LOCAL ] DRH: Loaded 51205 existing records from primary storage. [2025-09-28T02:49:06.487481] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:06.433945] [DEBUG] [LOCAL ] DRLL: Loaded 9737 existing records from primary storage. [2025-09-28T02:49:06.488678] [INFO ] [MAIN ] DRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:06.488818] [INFO ] [MAIN ] DRLL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:06.504072] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRH took 1.0s. Estimated remaining: 7m 44s. Rate: 222.8 symbols/min [2025-09-28T02:49:06.509777] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRLL took 0.6s. Estimated remaining: 7m 43s. Rate: 223.1 symbols/min [2025-09-28T02:49:06.522966] [DEBUG] [LOCAL ] DRI: Loaded 48554 existing records from primary storage. [2025-09-28T02:49:06.569795] [INFO ] [MAIN ] DRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:06.622509] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 0.9s. Estimated remaining: 7m 42s. Rate: 223.3 symbols/min [2025-09-28T02:49:06.938401] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:06.914311] [DEBUG] [LOCAL ] DSL: Loaded 28651 existing records from primary storage. [2025-09-28T02:49:07.004965] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:07.021177] [INFO ] [MAIN ] DSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:07.033601] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSL took 0.8s. Estimated remaining: 7m 42s. Rate: 223.1 symbols/min [2025-09-28T02:49:07.090341] [DEBUG] [LOCAL ] DSMC: Loaded 1974 existing records from primary storage. [2025-09-28T02:49:07.115772] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:07.146049] [INFO ] [MAIN ] DSMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:07.170088] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSMC took 0.7s. Estimated remaining: 7m 41s. Rate: 223.3 symbols/min [2025-09-28T02:49:07.261014] [DEBUG] [LOCAL ] DSM: Loaded 15895 existing records from primary storage. [2025-09-28T02:49:07.312505] [INFO ] [MAIN ] DSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:07.371133] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSM took 0.9s. Estimated remaining: 7m 41s. Rate: 223.4 symbols/min [2025-09-28T02:49:07.377126] [DEBUG] [LOCAL ] DSU: Loaded 22684 existing records from primary storage. [2025-09-28T02:49:07.397680] [INFO ] [MAIN ] DSU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:07.464430] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:07.451247] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSU took 0.8s. Estimated remaining: 7m 40s. Rate: 223.6 symbols/min [2025-09-28T02:49:07.713505] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:07.862404] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:07.901122] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:07.914489] [DEBUG] [LOCAL ] DSX: Loaded 24642 existing records from primary storage. [2025-09-28T02:49:07.915340] [INFO ] [MAIN ] DSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:07.915620] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSX took 0.8s. Estimated remaining: 7m 40s. Rate: 223.4 symbols/min [2025-09-28T02:49:07.919415] [DEBUG] [LOCAL ] DTB: Loaded 4817 existing records from primary storage. [2025-09-28T02:49:07.952187] [INFO ] [MAIN ] DTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:07.980525] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 0.6s. Estimated remaining: 7m 40s. Rate: 223.6 symbols/min [2025-09-28T02:49:08.240279] [DEBUG] [LOCAL ] DT: Loaded 53708 existing records from primary storage. [2025-09-28T02:49:08.276997] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:08.278680] [INFO ] [MAIN ] DT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:08.279419] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 1.1s. Estimated remaining: 7m 39s. Rate: 223.6 symbols/min [2025-09-28T02:49:08.284880] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-28T02:49:08.351155] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-28T02:49:08.455569] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:08.426613] [DEBUG] [LOCAL ] DTE: Loaded 48557 existing records from primary storage. [2025-09-28T02:49:08.475260] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-28T02:49:08.479412] [INFO ] [MAIN ] DTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:08.500805] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-28T02:49:08.501205] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTE took 1.0s. Estimated remaining: 7m 39s. Rate: 223.7 symbols/min [2025-09-28T02:49:08.551298] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-28T02:49:08.572800] [DEBUG] [LOCAL ] DTG: Loaded 5952 existing records from primary storage. [2025-09-28T02:49:08.578696] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-28T02:49:08.578873] [INFO ] [MAIN ] DTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:08.613044] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTG took 0.6s. Estimated remaining: 7m 38s. Rate: 223.9 symbols/min [2025-09-28T02:49:08.614308] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:08.755411] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-28T02:49:08.895468] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-28T02:49:08.931840] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-28T02:49:08.964777] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-28T02:49:09.047531] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-28T02:49:09.110502] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-28T02:49:09.098054] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:09.254935] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:09.482434] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:09.510589] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-28T02:49:09.550556] [DEBUG] [LOCAL ] DTW: Loaded 4923 existing records from primary storage. [2025-09-28T02:49:09.597994] [INFO ] [MAIN ] DTW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:09.598347] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTW took 0.9s. Estimated remaining: 7m 40s. Rate: 223.0 symbols/min [2025-09-28T02:49:09.723778] [DEBUG] [LOCAL ] DTM: Loaded 45043 existing records from primary storage. [2025-09-28T02:49:09.770396] [INFO ] [MAIN ] DTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:09.868954] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTM took 1.3s. Estimated remaining: 7m 40s. Rate: 223.0 symbols/min [2025-09-28T02:49:09.927608] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:09.969794] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-28T02:49:10.033664] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:10.067840] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-28T02:49:10.098565] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-28T02:49:10.183554] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:10.195582] [DEBUG] [LOCAL ] DUKB: Loaded 6414 existing records from primary storage. [2025-09-28T02:49:10.195914] [INFO ] [MAIN ] DUKB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:10.196017] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DUKB took 0.3s. Estimated remaining: 7m 40s. Rate: 222.9 symbols/min [2025-09-28T02:49:10.244602] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:49:10.258950] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-28T02:49:10.289160] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:49:10.325402] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-09-28T02:49:10.348447] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:49:10.360996] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-28T02:49:10.402556] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-28T02:49:10.402333] [DEBUG] [LOCAL ] DUK: Loaded 54238 existing records from primary storage. [2025-09-28T02:49:10.429315] [INFO ] [MAIN ] DUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:10.426545] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-28T02:49:10.431527] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:10.432494] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-28T02:49:10.432994] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DUK took 0.8s. Estimated remaining: 7m 39s. Rate: 222.9 symbols/min [2025-09-28T02:49:10.438718] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DTK took 2.2s. Estimated remaining: 7m 38s. Rate: 223.2 symbols/min [2025-09-28T02:49:10.450501] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-28T02:49:10.505769] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-28T02:49:10.825321] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:10.866379] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:10.869961] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-28T02:49:10.871618] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-28T02:49:10.875441] [DEBUG] [LOCAL ] DV: Loaded 52038 existing records from primary storage. [2025-09-28T02:49:10.876746] [INFO ] [MAIN ] DV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:10.877264] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DV took 0.7s. Estimated remaining: 7m 38s. Rate: 223.0 symbols/min [2025-09-28T02:49:11.098863] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:11.146508] [DEBUG] [LOCAL ] DVA: Loaded 41877 existing records from primary storage. [2025-09-28T02:49:11.147431] [INFO ] [MAIN ] DVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:11.148605] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DVA took 0.7s. Estimated remaining: 7m 38s. Rate: 223.0 symbols/min [2025-09-28T02:49:11.148431] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-09-28T02:49:11.201366] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-28T02:49:11.187342] [INFO ] [MAIN ] DVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:11.230033] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DVN took 0.8s. Estimated remaining: 7m 37s. Rate: 223.3 symbols/min [2025-09-28T02:49:11.232063] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-28T02:49:11.500678] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:11.577161] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:11.579363] [DEBUG] [LOCAL ] DX: Loaded 53228 existing records from primary storage. [2025-09-28T02:49:11.580248] [INFO ] [MAIN ] DX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:11.580852] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DX took 0.7s. Estimated remaining: 7m 37s. Rate: 223.2 symbols/min [2025-09-28T02:49:11.645441] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-28T02:49:11.669757] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-28T02:49:11.836610] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:11.858059] [DEBUG] [LOCAL ] DXC: Loaded 50456 existing records from primary storage. [2025-09-28T02:49:11.869175] [INFO ] [MAIN ] DXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:11.872094] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DXC took 0.7s. Estimated remaining: 7m 37s. Rate: 223.1 symbols/min [2025-09-28T02:49:11.884954] [DEBUG] [LOCAL ] DXYZ: Loaded 37246 existing records from primary storage. [2025-09-28T02:49:11.923993] [INFO ] [MAIN ] DXYZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:11.973433] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXYZ took 0.7s. Estimated remaining: 7m 36s. Rate: 223.3 symbols/min [2025-09-28T02:49:12.124259] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-28T02:49:12.227980] [DEBUG] [LOCAL ] DY: Loaded 30160 existing records from primary storage. [2025-09-28T02:49:12.205933] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-28T02:49:12.229037] [INFO ] [MAIN ] DY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:12.291413] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DY took 0.7s. Estimated remaining: 7m 36s. Rate: 223.3 symbols/min [2025-09-28T02:49:12.336553] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:12.601283] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:12.619297] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-28T02:49:12.668041] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-28T02:49:12.728120] [DEBUG] [LOCAL ] E: Loaded 33848 existing records from primary storage. [2025-09-28T02:49:12.763095] [INFO ] [MAIN ] E: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:12.792918] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. E took 0.9s. Estimated remaining: 7m 37s. Rate: 223.0 symbols/min [2025-09-28T02:49:12.796311] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:13.039514] [DEBUG] [LOCAL ] EAI: Loaded 4008 existing records from primary storage. [2025-09-28T02:49:13.044160] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-28T02:49:13.046318] [INFO ] [MAIN ] EAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:13.045755] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:13.048788] [DEBUG] [LOCAL ] EAF: Loaded 44158 existing records from primary storage. [2025-09-28T02:49:13.051089] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. EAI took 0.7s. Estimated remaining: 7m 36s. Rate: 223.0 symbols/min [2025-09-28T02:49:13.050578] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-28T02:49:13.052005] [INFO ] [MAIN ] EAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:13.076583] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAF took 1.1s. Estimated remaining: 7m 35s. Rate: 223.3 symbols/min [2025-09-28T02:49:13.367133] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-28T02:49:13.391956] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-28T02:49:13.431763] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:13.414056] [DEBUG] [LOCAL ] EARN: Loaded 30576 existing records from primary storage. [2025-09-28T02:49:13.477884] [INFO ] [MAIN ] EARN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:13.500314] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:13.500765] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EARN took 0.7s. Estimated remaining: 7m 36s. Rate: 223.1 symbols/min [2025-09-28T02:49:13.565238] [DEBUG] [LOCAL ] EB: Loaded 38017 existing records from primary storage. [2025-09-28T02:49:13.582011] [INFO ] [MAIN ] EB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:13.582190] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EB took 0.4s. Estimated remaining: 7m 35s. Rate: 223.3 symbols/min [2025-09-28T02:49:13.584048] [DEBUG] [LOCAL ] EAT: Loaded 50542 existing records from primary storage. [2025-09-28T02:49:13.584536] [INFO ] [MAIN ] EAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:13.584933] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EAT took 0.5s. Estimated remaining: 7m 34s. Rate: 223.7 symbols/min [2025-09-28T02:49:13.731484] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-28T02:49:13.732526] [INFO ] [REMOTE ] DTF: Full fetch complete (2111 records). [2025-09-28T02:49:13.732661] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-28T02:49:13.924506] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:49:13.924755] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:13.924833] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:13.925012] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-28T02:49:13.925140] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-28T02:49:13.925220] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-28T02:49:13.925359] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-28T02:49:13.925476] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. DTF took 6.0s. Estimated remaining: 7m 34s. Rate: 223.6 symbols/min [2025-09-28T02:49:14.545350] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:14.617712] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:14.670595] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:14.709048] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:14.729076] [DEBUG] [LOCAL ] EBF: Loaded 19635 existing records from primary storage. [2025-09-28T02:49:14.729473] [INFO ] [MAIN ] EBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:14.729575] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 0.8s. Estimated remaining: 7m 35s. Rate: 222.9 symbols/min [2025-09-28T02:49:14.930729] [DEBUG] [LOCAL ] EBR: Loaded 43731 existing records from primary storage. [2025-09-28T02:49:14.995406] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:14.995852] [INFO ] [MAIN ] EBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:15.013913] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EBR took 1.1s. Estimated remaining: 7m 35s. Rate: 222.9 symbols/min [2025-09-28T02:49:15.028770] [DEBUG] [LOCAL ] EBS: Loaded 47455 existing records from primary storage. [2025-09-28T02:49:15.056779] [INFO ] [MAIN ] EBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:15.057089] [DEBUG] [LOCAL ] EC: Loaded 50056 existing records from primary storage. [2025-09-28T02:49:15.063122] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBS took 1.1s. Estimated remaining: 7m 34s. Rate: 223.2 symbols/min [2025-09-28T02:49:15.073847] [INFO ] [MAIN ] EC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:15.087187] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EC took 1.2s. Estimated remaining: 7m 33s. Rate: 223.5 symbols/min [2025-09-28T02:49:15.443282] [DEBUG] [LOCAL ] ECAT: Loaded 30092 existing records from primary storage. [2025-09-28T02:49:15.479098] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:15.530596] [INFO ] [MAIN ] ECAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:15.580466] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:15.608986] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-28T02:49:15.580735] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECAT took 0.9s. Estimated remaining: 7m 33s. Rate: 223.2 symbols/min [2025-09-28T02:49:15.629455] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:15.629666] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-28T02:49:15.635933] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-28T02:49:15.636425] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-28T02:49:15.636575] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-28T02:49:15.636530] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-28T02:49:15.652802] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-28T02:49:15.642571] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-28T02:49:15.696542] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-28T02:49:15.696804] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-28T02:49:15.797554] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-28T02:49:15.847693] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-28T02:49:16.069478] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:16.111506] [DEBUG] [LOCAL ] ECC: Loaded 44025 existing records from primary storage. [2025-09-28T02:49:16.124321] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-28T02:49:16.226159] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-28T02:49:16.255160] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-28T02:49:16.254615] [INFO ] [MAIN ] ECC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:16.264333] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-28T02:49:16.269698] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECC took 1.3s. Estimated remaining: 7m 34s. Rate: 222.7 symbols/min [2025-09-28T02:49:16.299229] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-28T02:49:16.310556] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-28T02:49:16.599470] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:16.663972] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-28T02:49:16.940023] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:16.935584] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:16.960898] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-28T02:49:16.960996] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-28T02:49:16.961278] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-28T02:49:16.999918] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-28T02:49:17.046494] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-28T02:49:17.076255] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-28T02:49:17.090720] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-28T02:49:17.160761] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-28T02:49:17.187860] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-28T02:49:17.322812] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:17.323603] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-28T02:49:17.390287] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-28T02:49:17.451945] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-28T02:49:17.515522] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-28T02:49:17.534706] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-28T02:49:17.604188] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-28T02:49:17.617574] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-28T02:49:17.643771] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:17.644182] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-28T02:49:17.725050] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.19 seconds). [2025-09-28T02:49:17.726121] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-28T02:49:17.797468] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.18 seconds). [2025-09-28T02:49:17.798479] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-28T02:49:17.923875] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-28T02:49:17.925874] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-28T02:49:17.933564] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-09-28T02:49:17.934496] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-28T02:49:17.954338] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.16 seconds). [2025-09-28T02:49:17.955257] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-28T02:49:18.052039] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-28T02:49:18.053146] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-28T02:49:18.086898] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.15 seconds). [2025-09-28T02:49:18.087978] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-28T02:49:18.104744] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.15 seconds). [2025-09-28T02:49:18.105935] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-28T02:49:18.203685] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.15 seconds). [2025-09-28T02:49:18.204706] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-28T02:49:18.228971] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-28T02:49:18.230434] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-28T02:49:18.269725] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.16 seconds). [2025-09-28T02:49:18.271023] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-28T02:49:18.387410] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-28T02:49:18.388876] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-28T02:49:18.458664] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-28T02:49:18.459581] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-28T02:49:18.542830] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-28T02:49:18.546639] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.16 seconds). [2025-09-28T02:49:18.547454] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-28T02:49:18.548555] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-28T02:49:18.576135] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-28T02:49:18.577376] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-28T02:49:18.621677] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.16 seconds). [2025-09-28T02:49:18.622879] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-28T02:49:18.693483] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.14 seconds). [2025-09-28T02:49:18.694481] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-28T02:49:18.792876] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-28T02:49:18.794511] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-28T02:49:18.802295] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-28T02:49:18.803383] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-28T02:49:18.847880] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.15 seconds). [2025-09-28T02:49:18.848994] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-28T02:49:18.926198] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-28T02:49:18.927450] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-28T02:49:19.009735] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.16 seconds). [2025-09-28T02:49:19.010581] [INFO ] [REMOTE ] ECCC: Full fetch complete (1284 records). [2025-09-28T02:49:19.010702] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-28T02:49:19.092757] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-28T02:49:19.115099] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.19 seconds). [2025-09-28T02:49:19.114981] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-28T02:49:19.136805] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-28T02:49:19.226977] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-28T02:49:19.227169] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:19.227255] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:19.227333] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-28T02:49:19.227432] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-28T02:49:19.227506] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-28T02:49:19.227618] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-28T02:49:19.227739] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCC took 4.1s. Estimated remaining: 7m 40s. Rate: 219.5 symbols/min [2025-09-28T02:49:19.316579] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-28T02:49:19.354623] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-28T02:49:19.332608] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-28T02:49:19.357238] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-28T02:49:19.354866] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-28T02:49:19.388058] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-28T02:49:19.443133] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:19.484390] [DEBUG] [LOCAL ] ECG: Loaded 34619 existing records from primary storage. [2025-09-28T02:49:19.484762] [INFO ] [MAIN ] ECG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:19.484867] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECG took 0.3s. Estimated remaining: 7m 40s. Rate: 219.5 symbols/min [2025-09-28T02:49:19.585400] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-28T02:49:19.598195] [INFO ] [REMOTE ] ECCW: Full fetch complete (1420 records). [2025-09-28T02:49:19.614867] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-28T02:49:19.712589] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-28T02:49:19.720800] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:19.733103] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-28T02:49:19.763867] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-28T02:49:19.781294] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-28T02:49:19.895785] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-28T02:49:19.896418] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:19.896544] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:19.896630] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-28T02:49:19.896817] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-28T02:49:19.896976] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-28T02:49:19.897067] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-28T02:49:19.897225] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCW took 4.3s. Estimated remaining: 7m 40s. Rate: 219.4 symbols/min [2025-09-28T02:49:20.101774] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-28T02:49:20.124499] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:20.126435] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-28T02:49:20.129918] [DEBUG] [LOCAL ] ECL: Loaded 47489 existing records from primary storage. [2025-09-28T02:49:20.130697] [INFO ] [MAIN ] ECL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:20.131325] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECL took 0.6s. Estimated remaining: 7m 40s. Rate: 219.4 symbols/min [2025-09-28T02:49:20.204181] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-28T02:49:20.211598] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-28T02:49:20.284352] [DEBUG] [LOCAL ] ECO: Loaded 18768 existing records from primary storage. [2025-09-28T02:49:20.318676] [INFO ] [MAIN ] ECO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:20.337445] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECO took 0.4s. Estimated remaining: 7m 39s. Rate: 219.5 symbols/min [2025-09-28T02:49:20.339151] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:20.458621] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-28T02:49:20.470334] [INFO ] [REMOTE ] ECCX: Full fetch complete (1503 records). [2025-09-28T02:49:20.481015] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-28T02:49:20.605893] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:20.601175] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-28T02:49:20.651541] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-28T02:49:20.708357] [DEBUG] [LOCAL ] ECVT: Loaded 43587 existing records from primary storage. [2025-09-28T02:49:20.749516] [INFO ] [MAIN ] ECVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:20.784162] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECVT took 0.7s. Estimated remaining: 7m 39s. Rate: 219.3 symbols/min [2025-09-28T02:49:20.791160] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-28T02:49:20.797217] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:20.797346] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:20.830330] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-28T02:49:20.869135] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-28T02:49:20.915335] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-28T02:49:20.940065] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-28T02:49:20.967277] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECCX took 4.7s. Estimated remaining: 7m 39s. Rate: 219.4 symbols/min [2025-09-28T02:49:21.033928] [DEBUG] [LOCAL ] ED: Loaded 53539 existing records from primary storage. [2025-09-28T02:49:21.074623] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-28T02:49:21.094842] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:21.095212] [INFO ] [MAIN ] ED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:21.140355] [INFO ] [REMOTE ] ECCU: Full fetch complete (4460 records). [2025-09-28T02:49:21.151498] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-28T02:49:21.156731] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ED took 0.8s. Estimated remaining: 7m 38s. Rate: 219.5 symbols/min [2025-09-28T02:49:21.386454] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:21.648409] [DEBUG] [LOCAL ] EDD: Loaded 27470 existing records from primary storage. [2025-09-28T02:49:21.653313] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:21.683392] [INFO ] [MAIN ] EDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:21.688963] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. EDD took 0.9s. Estimated remaining: 7m 39s. Rate: 219.2 symbols/min [2025-09-28T02:49:21.688243] [DEBUG] [LOCAL ] EDF: Loaded 13627 existing records from primary storage. [2025-09-28T02:49:21.694006] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:49:21.706272] [INFO ] [MAIN ] EDF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:21.740549] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EDF took 0.8s. Estimated remaining: 7m 38s. Rate: 219.4 symbols/min [2025-09-28T02:49:21.719097] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:21.797380] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:21.876054] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-28T02:49:21.893879] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-28T02:49:21.894035] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-28T02:49:21.925070] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-28T02:49:21.948288] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. ECCU took 6.8s. Estimated remaining: 7m 38s. Rate: 219.5 symbols/min [2025-09-28T02:49:21.954731] [DEBUG] [LOCAL ] EDN: Loaded 18501 existing records from primary storage. [2025-09-28T02:49:22.004095] [INFO ] [MAIN ] EDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:22.044199] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:22.115073] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 0.9s. Estimated remaining: 7m 37s. Rate: 219.6 symbols/min [2025-09-28T02:49:22.231895] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:22.390498] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:22.402150] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-09-28T02:49:22.402524] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-09-28T02:49:22.454816] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-28T02:49:22.489173] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:22.496738] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-28T02:49:22.497633] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-28T02:49:22.497736] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-28T02:49:22.608573] [DEBUG] [LOCAL ] EE: Loaded 32973 existing records from primary storage. [2025-09-28T02:49:22.625796] [DEBUG] [LOCAL ] EDU: Loaded 45666 existing records from primary storage. [2025-09-28T02:49:22.627895] [INFO ] [MAIN ] EDU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:22.633625] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EDU took 0.9s. Estimated remaining: 7m 37s. Rate: 219.4 symbols/min [2025-09-28T02:49:22.626494] [INFO ] [MAIN ] EE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:22.693345] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EE took 0.9s. Estimated remaining: 7m 37s. Rate: 219.6 symbols/min [2025-09-28T02:49:22.687179] [DEBUG] [LOCAL ] EEX: Loaded 12042 existing records from primary storage. [2025-09-28T02:49:22.753897] [INFO ] [MAIN ] EEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:22.789953] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EEX took 0.6s. Estimated remaining: 7m 36s. Rate: 219.8 symbols/min [2025-09-28T02:49:23.242177] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:23.426410] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:23.532805] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:23.587305] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-28T02:49:23.586482] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:23.615099] [DEBUG] [LOCAL ] EFT: Loaded 12857 existing records from primary storage. [2025-09-28T02:49:23.615610] [INFO ] [MAIN ] EFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:23.617736] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EFT took 0.8s. Estimated remaining: 7m 37s. Rate: 219.2 symbols/min [2025-09-28T02:49:23.686467] [DEBUG] [LOCAL ] EFC: Loaded 46944 existing records from primary storage. [2025-09-28T02:49:23.707308] [INFO ] [MAIN ] EFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:23.719892] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFC took 1.1s. Estimated remaining: 7m 36s. Rate: 219.4 symbols/min [2025-09-28T02:49:23.726166] [DEBUG] [LOCAL ] EFR: Loaded 14474 existing records from primary storage. [2025-09-28T02:49:23.749731] [INFO ] [MAIN ] EFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:23.793132] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFR took 1.1s. Estimated remaining: 7m 35s. Rate: 219.6 symbols/min [2025-09-28T02:49:23.971368] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-28T02:49:24.059401] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-28T02:49:24.130223] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:24.182878] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:24.259320] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:24.284326] [DEBUG] [LOCAL ] EFXT: Loaded 29755 existing records from primary storage. [2025-09-28T02:49:24.297494] [INFO ] [MAIN ] EFXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:24.297693] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFXT took 0.6s. Estimated remaining: 7m 36s. Rate: 219.3 symbols/min [2025-09-28T02:49:24.449170] [DEBUG] [LOCAL ] EFX: Loaded 45419 existing records from primary storage. [2025-09-28T02:49:24.455162] [DEBUG] [LOCAL ] EG: Loaded 29024 existing records from primary storage. [2025-09-28T02:49:24.532797] [INFO ] [MAIN ] EFX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:24.532381] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:24.526316] [INFO ] [MAIN ] EG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:24.536906] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-28T02:49:24.537192] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EG took 0.7s. Estimated remaining: 7m 35s. Rate: 219.4 symbols/min [2025-09-28T02:49:24.539195] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-28T02:49:24.546490] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFX took 0.9s. Estimated remaining: 7m 34s. Rate: 219.7 symbols/min [2025-09-28T02:49:24.779908] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-28T02:49:24.827744] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-28T02:49:24.950884] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:24.955575] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:24.977575] [DEBUG] [LOCAL ] EGO: Loaded 52295 existing records from primary storage. [2025-09-28T02:49:24.978469] [INFO ] [MAIN ] EGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:24.978638] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EGO took 0.7s. Estimated remaining: 7m 35s. Rate: 219.5 symbols/min [2025-09-28T02:49:25.199617] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:25.213197] [DEBUG] [LOCAL ] EGP: Loaded 31536 existing records from primary storage. [2025-09-28T02:49:25.226934] [INFO ] [MAIN ] EGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:25.227141] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EGP took 0.7s. Estimated remaining: 7m 34s. Rate: 219.5 symbols/min [2025-09-28T02:49:25.240926] [DEBUG] [LOCAL ] EGY: Loaded 42824 existing records from primary storage. [2025-09-28T02:49:25.289616] [INFO ] [MAIN ] EGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:25.331279] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGY took 0.8s. Estimated remaining: 7m 34s. Rate: 219.7 symbols/min [2025-09-28T02:49:25.433818] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-28T02:49:25.489718] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-28T02:49:25.561410] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:25.593947] [DEBUG] [LOCAL ] EHAB: Loaded 30257 existing records from primary storage. [2025-09-28T02:49:25.623710] [INFO ] [MAIN ] EHAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:25.623936] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EHAB took 0.6s. Estimated remaining: 7m 33s. Rate: 219.7 symbols/min [2025-09-28T02:49:25.649914] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:25.849228] [DEBUG] [LOCAL ] EHI: Loaded 10472 existing records from primary storage. [2025-09-28T02:49:25.870024] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:25.870730] [INFO ] [MAIN ] EHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:25.871153] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHI took 0.5s. Estimated remaining: 7m 33s. Rate: 219.7 symbols/min [2025-09-28T02:49:25.953283] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-28T02:49:26.004673] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-28T02:49:26.009013] [DEBUG] [LOCAL ] EHC: Loaded 41849 existing records from primary storage. [2025-09-28T02:49:26.015709] [INFO ] [MAIN ] EHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:26.033056] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHC took 0.8s. Estimated remaining: 7m 32s. Rate: 219.8 symbols/min [2025-09-28T02:49:26.136140] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:26.181836] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-28T02:49:26.191638] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-28T02:49:26.197538] [DEBUG] [LOCAL ] EIC: Loaded 24238 existing records from primary storage. [2025-09-28T02:49:26.222866] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-28T02:49:26.223716] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-28T02:49:26.223879] [INFO ] [MAIN ] EIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:26.264746] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EIC took 0.6s. Estimated remaining: 7m 32s. Rate: 219.9 symbols/min [2025-09-28T02:49:26.304495] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:26.304908] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-28T02:49:26.334810] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-28T02:49:26.351138] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-28T02:49:26.391030] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-28T02:49:26.464063] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-28T02:49:26.479857] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-28T02:49:26.443089] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-28T02:49:26.502896] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-28T02:49:26.513055] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-28T02:49:26.521750] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-28T02:49:26.696932] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:26.918364] [DEBUG] [LOCAL ] EICC: Loaded 6245 existing records from primary storage. [2025-09-28T02:49:26.978851] [INFO ] [MAIN ] EICC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:27.025211] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EICC took 0.7s. Estimated remaining: 7m 33s. Rate: 219.3 symbols/min [2025-09-28T02:49:27.123473] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-28T02:49:27.253707] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-28T02:49:27.225687] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:27.283745] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-28T02:49:27.565033] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:27.595951] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:27.599812] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-28T02:49:27.600220] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-28T02:49:27.601450] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-28T02:49:27.626171] [DEBUG] [LOCAL ] EIG: Loaded 20519 existing records from primary storage. [2025-09-28T02:49:27.626515] [INFO ] [MAIN ] EIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:27.626621] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EIG took 0.6s. Estimated remaining: 7m 33s. Rate: 219.0 symbols/min [2025-09-28T02:49:27.794629] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-28T02:49:27.819796] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:27.820300] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-28T02:49:27.884154] [DEBUG] [LOCAL ] EIX: Loaded 54113 existing records from primary storage. [2025-09-28T02:49:27.884604] [INFO ] [MAIN ] EIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:27.885054] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EIX took 0.3s. Estimated remaining: 7m 33s. Rate: 219.0 symbols/min [2025-09-28T02:49:27.909176] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-28T02:49:27.911044] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-28T02:49:27.915045] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-28T02:49:27.916223] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-28T02:49:28.058940] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-28T02:49:28.060676] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-28T02:49:28.065825] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.15 seconds). [2025-09-28T02:49:28.067098] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-28T02:49:28.218588] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-28T02:49:28.219956] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-28T02:49:28.284378] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-28T02:49:28.285502] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-28T02:49:28.358755] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-28T02:49:28.360291] [INFO ] [REMOTE ] EEA: Full fetch complete (3967 records). [2025-09-28T02:49:28.360425] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-28T02:49:28.489326] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-28T02:49:28.493984] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-28T02:49:28.510122] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-28T02:49:28.544925] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-28T02:49:28.596194] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:49:28.596487] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:28.596567] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:28.596705] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-28T02:49:28.596877] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-28T02:49:28.596968] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-09-28T02:49:28.597080] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-09-28T02:49:28.597222] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EEA took 6.6s. Estimated remaining: 7m 34s. Rate: 218.5 symbols/min [2025-09-28T02:49:28.745327] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-28T02:49:28.746474] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-28T02:49:28.838971] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-28T02:49:28.840296] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-28T02:49:28.971338] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-28T02:49:28.972584] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-28T02:49:29.063163] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-28T02:49:29.064447] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-28T02:49:29.201662] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-28T02:49:29.202765] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-28T02:49:29.349596] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-28T02:49:29.350998] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-28T02:49:29.418976] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-28T02:49:29.420078] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-28T02:49:29.585914] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-28T02:49:29.587197] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-28T02:49:29.651216] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-28T02:49:29.652304] [INFO ] [REMOTE ] EICA: Full fetch complete (1269 records). [2025-09-28T02:49:29.652404] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-28T02:49:29.861085] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:49:29.861283] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:29.861354] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:29.861439] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-28T02:49:29.861538] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-28T02:49:29.861685] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-28T02:49:29.861812] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-28T02:49:29.861915] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EICA took 4.0s. Estimated remaining: 7m 36s. Rate: 217.4 symbols/min [2025-09-28T02:49:29.902969] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-28T02:49:29.904320] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-28T02:49:30.132915] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-28T02:49:30.134368] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-28T02:49:30.611662] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-28T02:49:30.612811] [INFO ] [REMOTE ] EICB: Full fetch complete (2692 records). [2025-09-28T02:49:30.612908] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-28T02:49:30.800138] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:49:30.800368] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:30.800449] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:30.800597] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-28T02:49:30.800835] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-28T02:49:30.800928] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-28T02:49:30.801025] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-28T02:49:30.801136] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EICB took 4.7s. Estimated remaining: 7m 37s. Rate: 216.7 symbols/min [2025-09-28T02:49:31.430380] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:31.508220] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:31.553186] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:31.582978] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:31.588744] [DEBUG] [LOCAL ] ELC: Loaded 3512 existing records from primary storage. [2025-09-28T02:49:31.590373] [INFO ] [MAIN ] ELC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:31.590473] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 0.8s. Estimated remaining: 7m 38s. Rate: 216.1 symbols/min [2025-09-28T02:49:31.852090] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:31.871323] [DEBUG] [LOCAL ] ELF: Loaded 53037 existing records from primary storage. [2025-09-28T02:49:31.872405] [INFO ] [MAIN ] ELF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:31.873211] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELF took 1.1s. Estimated remaining: 7m 38s. Rate: 216.1 symbols/min [2025-09-28T02:49:31.997158] [DEBUG] [LOCAL ] ELAN: Loaded 53985 existing records from primary storage. [2025-09-28T02:49:32.008545] [DEBUG] [LOCAL ] EL: Loaded 54177 existing records from primary storage. [2025-09-28T02:49:32.018082] [INFO ] [MAIN ] ELAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:32.023351] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELAN took 1.2s. Estimated remaining: 7m 37s. Rate: 216.3 symbols/min [2025-09-28T02:49:32.024037] [INFO ] [MAIN ] EL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:32.129555] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. EL took 1.3s. Estimated remaining: 7m 37s. Rate: 216.5 symbols/min [2025-09-28T02:49:32.229598] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:32.404849] [DEBUG] [LOCAL ] ELME: Loaded 39817 existing records from primary storage. [2025-09-28T02:49:32.451673] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:32.482595] [INFO ] [MAIN ] ELME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:32.482411] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-28T02:49:32.514591] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-28T02:49:32.528158] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELME took 0.9s. Estimated remaining: 7m 37s. Rate: 216.3 symbols/min [2025-09-28T02:49:32.531082] [DEBUG] [LOCAL ] ELP: Loaded 26107 existing records from primary storage. [2025-09-28T02:49:32.559032] [INFO ] [MAIN ] ELP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:32.585155] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:32.531323] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-28T02:49:32.599359] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-28T02:49:32.622616] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-28T02:49:32.599194] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELP took 0.7s. Estimated remaining: 7m 36s. Rate: 216.5 symbols/min [2025-09-28T02:49:32.638431] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-28T02:49:33.009336] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:33.119055] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:33.149011] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-28T02:49:33.149102] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-28T02:49:33.149239] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-28T02:49:33.174125] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-28T02:49:33.197084] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-28T02:49:33.197235] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-28T02:49:33.416715] [DEBUG] [LOCAL ] ELS: Loaded 50110 existing records from primary storage. [2025-09-28T02:49:33.479433] [INFO ] [MAIN ] ELS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:33.554978] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. ELS took 1.3s. Estimated remaining: 7m 37s. Rate: 215.8 symbols/min [2025-09-28T02:49:33.638723] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:33.745136] [DEBUG] [LOCAL ] ELV: Loaded 51334 existing records from primary storage. [2025-09-28T02:49:33.680872] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-28T02:49:33.790821] [INFO ] [MAIN ] ELV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:33.832751] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELV took 1.3s. Estimated remaining: 7m 37s. Rate: 215.8 symbols/min [2025-09-28T02:49:34.000955] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:34.143880] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:34.157806] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-28T02:49:34.162634] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-28T02:49:34.175619] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-28T02:49:34.248148] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:34.260689] [DEBUG] [LOCAL ] EMD: Loaded 21338 existing records from primary storage. [2025-09-28T02:49:34.261174] [INFO ] [MAIN ] EMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:34.261328] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. EMD took 0.7s. Estimated remaining: 7m 37s. Rate: 215.7 symbols/min [2025-09-28T02:49:34.367849] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:49:34.372540] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-28T02:49:34.378088] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:49:34.408127] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-09-28T02:49:34.431337] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:49:34.434888] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-28T02:49:34.461033] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:34.461144] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-28T02:49:34.461811] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-28T02:49:34.461918] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-28T02:49:34.462005] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. EMA took 1.8s. Estimated remaining: 7m 36s. Rate: 215.7 symbols/min [2025-09-28T02:49:34.572463] [DEBUG] [LOCAL ] EME: Loaded 32035 existing records from primary storage. [2025-09-28T02:49:34.572885] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-28T02:49:34.598909] [DEBUG] [LOCAL ] EMF: Loaded 3575 existing records from primary storage. [2025-09-28T02:49:34.592852] [INFO ] [MAIN ] EME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:34.600958] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-28T02:49:34.628914] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EME took 0.8s. Estimated remaining: 7m 36s. Rate: 215.9 symbols/min [2025-09-28T02:49:34.617243] [INFO ] [MAIN ] EMF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:34.671686] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EMF took 0.4s. Estimated remaining: 7m 35s. Rate: 216.1 symbols/min [2025-09-28T02:49:34.710489] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:34.931403] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-28T02:49:34.965537] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-28T02:49:35.053136] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:35.089883] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:35.114233] [DEBUG] [LOCAL ] EMP: Loaded 3062 existing records from primary storage. [2025-09-28T02:49:35.114600] [INFO ] [MAIN ] EMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:35.115084] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMP took 0.4s. Estimated remaining: 7m 35s. Rate: 215.9 symbols/min [2025-09-28T02:49:35.239972] [DEBUG] [LOCAL ] EMO: Loaded 12656 existing records from primary storage. [2025-09-28T02:49:35.253947] [DEBUG] [LOCAL ] EMN: Loaded 51117 existing records from primary storage. [2025-09-28T02:49:35.259427] [INFO ] [MAIN ] EMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:35.280802] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMN took 0.8s. Estimated remaining: 7m 35s. Rate: 216.1 symbols/min [2025-09-28T02:49:35.264969] [INFO ] [MAIN ] EMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:35.312949] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-28T02:49:35.346277] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMO took 0.7s. Estimated remaining: 7m 34s. Rate: 216.3 symbols/min [2025-09-28T02:49:35.348469] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-28T02:49:35.386832] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:35.673613] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:35.731230] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:35.738131] [DEBUG] [LOCAL ] ENFY: Loaded 3106 existing records from primary storage. [2025-09-28T02:49:35.754876] [INFO ] [MAIN ] ENFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:35.755044] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. ENFY took 0.4s. Estimated remaining: 7m 34s. Rate: 216.1 symbols/min [2025-09-28T02:49:35.831199] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-28T02:49:35.871085] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-28T02:49:35.903676] [DEBUG] [LOCAL ] EMR: Loaded 54027 existing records from primary storage. [2025-09-28T02:49:35.941412] [INFO ] [MAIN ] EMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:35.992716] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. EMR took 0.9s. Estimated remaining: 7m 34s. Rate: 216.2 symbols/min [2025-09-28T02:49:35.990509] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:36.103150] [DEBUG] [LOCAL ] ENB: Loaded 54295 existing records from primary storage. [2025-09-28T02:49:36.124154] [INFO ] [MAIN ] ENB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:36.128637] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. ENB took 0.8s. Estimated remaining: 7m 33s. Rate: 216.3 symbols/min [2025-09-28T02:49:36.218351] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-28T02:49:36.267982] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:36.290381] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-28T02:49:36.352387] [DEBUG] [LOCAL ] ENIC: Loaded 36910 existing records from primary storage. [2025-09-28T02:49:36.359752] [INFO ] [MAIN ] ENIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:36.396839] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENIC took 0.6s. Estimated remaining: 7m 33s. Rate: 216.3 symbols/min [2025-09-28T02:49:36.436343] [DEBUG] [LOCAL ] ENO: Loaded 1952 existing records from primary storage. [2025-09-28T02:49:36.436955] [INFO ] [MAIN ] ENO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:36.433303] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:36.474286] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENO took 0.5s. Estimated remaining: 7m 32s. Rate: 216.6 symbols/min [2025-09-28T02:49:36.636558] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-28T02:49:36.689074] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-28T02:49:36.740465] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:36.832420] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:36.849063] [DEBUG] [LOCAL ] ENOV: Loaded 45799 existing records from primary storage. [2025-09-28T02:49:36.850892] [INFO ] [MAIN ] ENOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:36.851540] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENOV took 0.7s. Estimated remaining: 7m 32s. Rate: 216.4 symbols/min [2025-09-28T02:49:37.005979] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-28T02:49:37.035870] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-28T02:49:37.037541] [DEBUG] [LOCAL ] ENR: Loaded 43336 existing records from primary storage. [2025-09-28T02:49:37.104523] [INFO ] [MAIN ] ENR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:37.105406] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENR took 0.7s. Estimated remaining: 7m 32s. Rate: 216.5 symbols/min [2025-09-28T02:49:37.113362] [DEBUG] [LOCAL ] ENS: Loaded 29869 existing records from primary storage. [2025-09-28T02:49:37.112302] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:37.141036] [INFO ] [MAIN ] ENS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:37.146930] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENS took 0.7s. Estimated remaining: 7m 31s. Rate: 216.7 symbols/min [2025-09-28T02:49:37.375777] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-28T02:49:37.437786] [DEBUG] [LOCAL ] ENVA: Loaded 25914 existing records from primary storage. [2025-09-28T02:49:37.431992] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-28T02:49:37.479572] [INFO ] [MAIN ] ENVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:37.495211] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENVA took 0.6s. Estimated remaining: 7m 31s. Rate: 216.6 symbols/min [2025-09-28T02:49:37.512545] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:37.540038] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:37.684953] [DEBUG] [LOCAL ] EOD: Loaded 14232 existing records from primary storage. [2025-09-28T02:49:37.717347] [INFO ] [MAIN ] EOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:37.720364] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-28T02:49:37.729065] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:37.730422] [INFO ] [REMOTE ] ELPC: Full fetch complete (1481 records). [2025-09-28T02:49:37.729340] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. EOD took 0.6s. Estimated remaining: 7m 30s. Rate: 216.7 symbols/min [2025-09-28T02:49:37.731302] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-28T02:49:37.913462] [DEBUG] [LOCAL ] EOI: Loaded 10783 existing records from primary storage. [2025-09-28T02:49:38.003386] [DEBUG] [LOCAL ] EOG: Loaded 54121 existing records from primary storage. [2025-09-28T02:49:37.986946] [INFO ] [MAIN ] EOI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:38.014991] [INFO ] [MAIN ] EOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:38.020502] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOI took 0.5s. Estimated remaining: 7m 30s. Rate: 216.7 symbols/min [2025-09-28T02:49:38.071685] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOG took 0.9s. Estimated remaining: 7m 29s. Rate: 216.9 symbols/min [2025-09-28T02:49:38.266360] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:38.264957] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:49:38.325882] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:38.380323] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:38.381967] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-28T02:49:38.424863] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-28T02:49:38.453691] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-28T02:49:38.523817] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-28T02:49:38.523559] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:38.579512] [DEBUG] [LOCAL ] EOS: Loaded 15589 existing records from primary storage. [2025-09-28T02:49:38.578582] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. ELPC took 6.5s. Estimated remaining: 7m 29s. Rate: 216.7 symbols/min [2025-09-28T02:49:38.609107] [INFO ] [MAIN ] EOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:38.608409] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:38.620735] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOS took 0.9s. Estimated remaining: 7m 29s. Rate: 216.9 symbols/min [2025-09-28T02:49:38.824003] [DEBUG] [LOCAL ] EOT: Loaded 6916 existing records from primary storage. [2025-09-28T02:49:38.856739] [INFO ] [MAIN ] EOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:38.944706] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOT took 0.9s. Estimated remaining: 7m 28s. Rate: 216.9 symbols/min [2025-09-28T02:49:38.945602] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:39.142047] [DEBUG] [LOCAL ] EPAC: Loaded 27416 existing records from primary storage. [2025-09-28T02:49:39.167325] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:39.168459] [INFO ] [MAIN ] EPAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:39.197135] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAC took 1.0s. Estimated remaining: 7m 28s. Rate: 216.9 symbols/min [2025-09-28T02:49:39.266380] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:39.459850] [DEBUG] [LOCAL ] EPAM: Loaded 40450 existing records from primary storage. [2025-09-28T02:49:39.491924] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:39.486330] [INFO ] [MAIN ] EPAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:39.507779] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPAM took 0.9s. Estimated remaining: 7m 28s. Rate: 216.9 symbols/min [2025-09-28T02:49:39.539506] [DEBUG] [LOCAL ] EPC: Loaded 40383 existing records from primary storage. [2025-09-28T02:49:39.574211] [INFO ] [MAIN ] EPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:39.601490] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPC took 0.9s. Estimated remaining: 7m 27s. Rate: 217.0 symbols/min [2025-09-28T02:49:39.765745] [DEBUG] [LOCAL ] EPD: Loaded 54389 existing records from primary storage. [2025-09-28T02:49:39.792817] [INFO ] [MAIN ] EPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:39.838675] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 0.9s. Estimated remaining: 7m 27s. Rate: 217.1 symbols/min [2025-09-28T02:49:39.874872] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:40.026565] [DEBUG] [LOCAL ] EPR: Loaded 44722 existing records from primary storage. [2025-09-28T02:49:40.086208] [INFO ] [MAIN ] EPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:40.095382] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPR took 0.9s. Estimated remaining: 7m 27s. Rate: 217.1 symbols/min [2025-09-28T02:49:40.090939] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:40.302954] [DEBUG] [LOCAL ] EQBK: Loaded 11050 existing records from primary storage. [2025-09-28T02:49:40.302492] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:40.315906] [INFO ] [MAIN ] EQBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:40.349400] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EQBK took 0.7s. Estimated remaining: 7m 26s. Rate: 217.1 symbols/min [2025-09-28T02:49:40.432921] [DEBUG] [LOCAL ] EPRT: Loaded 49306 existing records from primary storage. [2025-09-28T02:49:40.421136] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:40.444118] [INFO ] [MAIN ] EPRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:40.470764] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 1.0s. Estimated remaining: 7m 26s. Rate: 217.3 symbols/min [2025-09-28T02:49:40.610108] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:40.631248] [DEBUG] [LOCAL ] EQH: Loaded 53435 existing records from primary storage. [2025-09-28T02:49:40.631953] [INFO ] [MAIN ] EQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:40.632229] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 0.8s. Estimated remaining: 7m 25s. Rate: 217.4 symbols/min [2025-09-28T02:49:40.673829] [DEBUG] [LOCAL ] EQNR: Loaded 53809 existing records from primary storage. [2025-09-28T02:49:40.674351] [INFO ] [MAIN ] EQNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:40.675088] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 0.6s. Estimated remaining: 7m 24s. Rate: 217.7 symbols/min [2025-09-28T02:49:40.722683] [DEBUG] [LOCAL ] EQR: Loaded 52190 existing records from primary storage. [2025-09-28T02:49:40.723105] [INFO ] [MAIN ] EQR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:40.723776] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQR took 0.4s. Estimated remaining: 7m 24s. Rate: 217.9 symbols/min [2025-09-28T02:49:41.422222] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:41.465397] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:41.498818] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-28T02:49:41.546851] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:41.542857] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:41.521467] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-28T02:49:41.548416] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-28T02:49:41.548687] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-28T02:49:41.549053] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-28T02:49:41.549148] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-28T02:49:41.619738] [DEBUG] [LOCAL ] EQV: Loaded 2840 existing records from primary storage. [2025-09-28T02:49:41.637388] [INFO ] [MAIN ] EQV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:41.650906] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQV took 0.9s. Estimated remaining: 7m 25s. Rate: 217.2 symbols/min [2025-09-28T02:49:42.005291] [DEBUG] [LOCAL ] ERJ: Loaded 51477 existing records from primary storage. [2025-09-28T02:49:42.058688] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-09-28T02:49:42.069991] [INFO ] [MAIN ] EQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:42.101878] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQT took 1.4s. Estimated remaining: 7m 25s. Rate: 217.0 symbols/min [2025-09-28T02:49:42.070280] [INFO ] [MAIN ] ERJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:42.127434] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. ERJ took 1.4s. Estimated remaining: 7m 24s. Rate: 217.3 symbols/min [2025-09-28T02:49:42.174878] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:42.463222] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:42.478803] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-28T02:49:42.624901] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:42.687074] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:42.690432] [DEBUG] [LOCAL ] ERO: Loaded 41901 existing records from primary storage. [2025-09-28T02:49:42.690885] [INFO ] [MAIN ] ERO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:42.690998] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. ERO took 1.0s. Estimated remaining: 7m 24s. Rate: 217.0 symbols/min [2025-09-28T02:49:42.902676] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:42.934420] [DEBUG] [LOCAL ] ESAB: Loaded 26683 existing records from primary storage. [2025-09-28T02:49:42.935000] [INFO ] [MAIN ] ESAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:42.935131] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ESAB took 0.8s. Estimated remaining: 7m 24s. Rate: 217.0 symbols/min [2025-09-28T02:49:43.070939] [DEBUG] [LOCAL ] ES: Loaded 53309 existing records from primary storage. [2025-09-28T02:49:43.077951] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-28T02:49:43.096843] [DEBUG] [LOCAL ] ESE: Loaded 16878 existing records from primary storage. [2025-09-28T02:49:43.099134] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-28T02:49:43.099385] [INFO ] [MAIN ] ES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:43.100928] [INFO ] [MAIN ] ESE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:43.100704] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 1.0s. Estimated remaining: 7m 23s. Rate: 217.1 symbols/min [2025-09-28T02:49:43.157530] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESE took 0.4s. Estimated remaining: 7m 23s. Rate: 217.4 symbols/min [2025-09-28T02:49:43.240908] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:43.471782] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-28T02:49:43.516921] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-28T02:49:43.550994] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:43.593233] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:43.666085] [DEBUG] [LOCAL ] ESI: Loaded 51566 existing records from primary storage. [2025-09-28T02:49:43.667262] [INFO ] [MAIN ] ESI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:43.668153] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESI took 0.7s. Estimated remaining: 7m 23s. Rate: 217.1 symbols/min [2025-09-28T02:49:43.814505] [DEBUG] [LOCAL ] ESNT: Loaded 39065 existing records from primary storage. [2025-09-28T02:49:43.829520] [DEBUG] [LOCAL ] ESRT: Loaded 47104 existing records from primary storage. [2025-09-28T02:49:43.841614] [INFO ] [MAIN ] ESNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:43.861627] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESNT took 0.7s. Estimated remaining: 7m 23s. Rate: 217.2 symbols/min [2025-09-28T02:49:43.841316] [INFO ] [MAIN ] ESRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:43.891898] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESRT took 0.7s. Estimated remaining: 7m 22s. Rate: 217.5 symbols/min [2025-09-28T02:49:43.861876] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-28T02:49:43.912446] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-28T02:49:43.986850] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:44.317902] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:44.325538] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:44.325740] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-28T02:49:44.327835] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-28T02:49:44.355768] [DEBUG] [LOCAL ] ESS: Loaded 30441 existing records from primary storage. [2025-09-28T02:49:44.356299] [INFO ] [MAIN ] ESS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:44.356413] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESS took 0.7s. Estimated remaining: 7m 22s. Rate: 217.3 symbols/min [2025-09-28T02:49:44.557685] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:44.574525] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-28T02:49:44.575846] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-28T02:49:44.598584] [DEBUG] [LOCAL ] ESTC: Loaded 50744 existing records from primary storage. [2025-09-28T02:49:44.600907] [INFO ] [MAIN ] ESTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:44.615557] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESTC took 0.8s. Estimated remaining: 7m 22s. Rate: 217.3 symbols/min [2025-09-28T02:49:44.629183] [DEBUG] [LOCAL ] ETB: Loaded 12181 existing records from primary storage. [2025-09-28T02:49:44.642089] [INFO ] [MAIN ] ETB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:44.643418] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-09-28T02:49:44.659497] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ETB took 0.3s. Estimated remaining: 7m 21s. Rate: 217.5 symbols/min [2025-09-28T02:49:44.696181] [INFO ] [MAIN ] ET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:44.756073] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ET took 0.8s. Estimated remaining: 7m 20s. Rate: 217.7 symbols/min [2025-09-28T02:49:44.938628] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-28T02:49:44.981420] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-28T02:49:45.075894] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:45.150058] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:45.231795] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:45.255769] [DEBUG] [LOCAL ] ETG: Loaded 16710 existing records from primary storage. [2025-09-28T02:49:45.256132] [INFO ] [MAIN ] ETG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:45.257534] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ETG took 0.6s. Estimated remaining: 7m 20s. Rate: 217.5 symbols/min [2025-09-28T02:49:45.283513] [DEBUG] [LOCAL ] ETD: Loaded 27661 existing records from primary storage. [2025-09-28T02:49:45.359531] [INFO ] [MAIN ] ETD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:45.381832] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETD took 0.8s. Estimated remaining: 7m 20s. Rate: 217.6 symbols/min [2025-09-28T02:49:45.382708] [DEBUG] [LOCAL ] ETJ: Loaded 16938 existing records from primary storage. [2025-09-28T02:49:45.447058] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-28T02:49:45.464353] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-28T02:49:45.470760] [INFO ] [MAIN ] ETJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:45.538481] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETJ took 0.8s. Estimated remaining: 7m 19s. Rate: 217.8 symbols/min [2025-09-28T02:49:45.543712] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:45.870462] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:45.933674] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-28T02:49:45.955119] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-28T02:49:45.953201] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:45.979358] [DEBUG] [LOCAL ] ETO: Loaded 6600 existing records from primary storage. [2025-09-28T02:49:45.979723] [INFO ] [MAIN ] ETO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:45.979831] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETO took 0.6s. Estimated remaining: 7m 19s. Rate: 217.6 symbols/min [2025-09-28T02:49:46.117796] [DEBUG] [LOCAL ] ETN: Loaded 53593 existing records from primary storage. [2025-09-28T02:49:46.145047] [INFO ] [MAIN ] ETN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:46.195230] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETN took 0.9s. Estimated remaining: 7m 19s. Rate: 217.6 symbols/min [2025-09-28T02:49:46.197032] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:46.366103] [DEBUG] [LOCAL ] ETR: Loaded 54001 existing records from primary storage. [2025-09-28T02:49:46.438618] [INFO ] [MAIN ] ETR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:46.410936] [DEBUG] [LOCAL ] ETV: Loaded 21729 existing records from primary storage. [2025-09-28T02:49:46.439833] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETR took 0.9s. Estimated remaining: 7m 19s. Rate: 217.7 symbols/min [2025-09-28T02:49:46.443247] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-28T02:49:46.452178] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:46.453161] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-28T02:49:46.452362] [INFO ] [MAIN ] ETV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:46.505116] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETV took 0.5s. Estimated remaining: 7m 18s. Rate: 217.9 symbols/min [2025-09-28T02:49:46.749714] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:46.778736] [DEBUG] [LOCAL ] ETW: Loaded 25463 existing records from primary storage. [2025-09-28T02:49:46.830769] [INFO ] [MAIN ] ETW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:46.840950] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETW took 0.6s. Estimated remaining: 7m 18s. Rate: 217.8 symbols/min [2025-09-28T02:49:46.866238] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:46.878186] [DEBUG] [LOCAL ] ETX: Loaded 5028 existing records from primary storage. [2025-09-28T02:49:46.889441] [INFO ] [MAIN ] ETX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:46.913189] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETX took 0.5s. Estimated remaining: 7m 17s. Rate: 218.0 symbols/min [2025-09-28T02:49:46.950508] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-28T02:49:47.036347] [INFO ] [REMOTE ] EQS: Full fetch complete (2522 records). [2025-09-28T02:49:47.080198] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-28T02:49:47.155957] [DEBUG] [LOCAL ] ETY: Loaded 23078 existing records from primary storage. [2025-09-28T02:49:47.206909] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:47.282206] [INFO ] [MAIN ] ETY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:47.344369] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETY took 0.8s. Estimated remaining: 7m 17s. Rate: 217.9 symbols/min [2025-09-28T02:49:47.390624] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:47.599139] [DEBUG] [LOCAL ] EVC: Loaded 19415 existing records from primary storage. [2025-09-28T02:49:47.612780] [INFO ] [MAIN ] EVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:47.620908] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. EVC took 0.8s. Estimated remaining: 7m 17s. Rate: 217.9 symbols/min [2025-09-28T02:49:47.606632] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-28T02:49:47.626395] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:47.626525] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:47.626715] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-28T02:49:47.674879] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-28T02:49:47.754083] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-28T02:49:47.755092] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:47.771819] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-28T02:49:47.820799] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EQS took 7.1s. Estimated remaining: 7m 16s. Rate: 218.0 symbols/min [2025-09-28T02:49:47.828610] [DEBUG] [LOCAL ] EVEX: Loaded 30549 existing records from primary storage. [2025-09-28T02:49:47.881236] [INFO ] [MAIN ] EVEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:47.954140] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:47.949842] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVEX took 1.0s. Estimated remaining: 7m 16s. Rate: 218.1 symbols/min [2025-09-28T02:49:48.009181] [DEBUG] [LOCAL ] EVF: Loaded 9501 existing records from primary storage. [2025-09-28T02:49:48.056073] [INFO ] [MAIN ] EVF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:48.092767] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVF took 0.7s. Estimated remaining: 7m 15s. Rate: 218.2 symbols/min [2025-09-28T02:49:48.223621] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:48.276433] [DEBUG] [LOCAL ] EVG: Loaded 5862 existing records from primary storage. [2025-09-28T02:49:48.348573] [INFO ] [MAIN ] EVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:48.379563] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVG took 0.8s. Estimated remaining: 7m 15s. Rate: 218.2 symbols/min [2025-09-28T02:49:48.438567] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:48.494126] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:48.636089] [DEBUG] [LOCAL ] EVN: Loaded 11217 existing records from primary storage. [2025-09-28T02:49:48.693203] [INFO ] [MAIN ] EVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:48.698694] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:48.708040] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVN took 0.7s. Estimated remaining: 7m 15s. Rate: 218.2 symbols/min [2025-09-28T02:49:48.771379] [DEBUG] [LOCAL ] EVH: Loaded 50111 existing records from primary storage. [2025-09-28T02:49:48.820255] [INFO ] [MAIN ] EVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:48.836173] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVH took 1.0s. Estimated remaining: 7m 14s. Rate: 218.3 symbols/min [2025-09-28T02:49:48.853689] [DEBUG] [LOCAL ] EVR: Loaded 35882 existing records from primary storage. [2025-09-28T02:49:48.907048] [INFO ] [MAIN ] EVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:48.906336] [DEBUG] [LOCAL ] EVT: Loaded 17270 existing records from primary storage. [2025-09-28T02:49:48.927984] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVR took 0.8s. Estimated remaining: 7m 14s. Rate: 218.5 symbols/min [2025-09-28T02:49:48.977927] [INFO ] [MAIN ] EVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:49.021275] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 0.6s. Estimated remaining: 7m 13s. Rate: 218.7 symbols/min [2025-09-28T02:49:49.154323] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:49.417333] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:49.533130] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:49.585507] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:49.588196] [DEBUG] [LOCAL ] EVTC: Loaded 26745 existing records from primary storage. [2025-09-28T02:49:49.589031] [INFO ] [MAIN ] EVTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:49.589129] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTC took 0.9s. Estimated remaining: 7m 13s. Rate: 218.4 symbols/min [2025-09-28T02:49:49.762591] [DEBUG] [LOCAL ] EVTR: Loaded 23675 existing records from primary storage. [2025-09-28T02:49:49.826309] [INFO ] [MAIN ] EVTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:49.830609] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:49.831120] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTR took 0.8s. Estimated remaining: 7m 13s. Rate: 218.4 symbols/min [2025-09-28T02:49:49.863835] [DEBUG] [LOCAL ] EVTL: Loaded 38140 existing records from primary storage. [2025-09-28T02:49:49.921792] [INFO ] [MAIN ] EVTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:49.949354] [DEBUG] [LOCAL ] EW: Loaded 54176 existing records from primary storage. [2025-09-28T02:49:49.949560] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTL took 1.1s. Estimated remaining: 7m 12s. Rate: 218.6 symbols/min [2025-09-28T02:49:49.994743] [INFO ] [MAIN ] EW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:50.018347] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EW took 0.9s. Estimated remaining: 7m 12s. Rate: 218.8 symbols/min [2025-09-28T02:49:50.194549] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:50.229704] [DEBUG] [LOCAL ] EXG: Loaded 34725 existing records from primary storage. [2025-09-28T02:49:50.266446] [INFO ] [MAIN ] EXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:50.288357] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EXG took 0.7s. Estimated remaining: 7m 11s. Rate: 218.8 symbols/min [2025-09-28T02:49:50.288120] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:50.358814] [DEBUG] [LOCAL ] EXP: Loaded 30275 existing records from primary storage. [2025-09-28T02:49:50.360964] [INFO ] [MAIN ] EXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:50.360626] [DEBUG] [LOCAL ] EXK: Loaded 53904 existing records from primary storage. [2025-09-28T02:49:50.361164] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXP took 0.4s. Estimated remaining: 7m 11s. Rate: 219.0 symbols/min [2025-09-28T02:49:50.361741] [INFO ] [MAIN ] EXK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:50.361952] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXK took 0.5s. Estimated remaining: 7m 10s. Rate: 219.3 symbols/min [2025-09-28T02:49:50.965145] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:51.069033] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:51.133700] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:51.157073] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:51.265518] [DEBUG] [LOCAL ] EXR: Loaded 46080 existing records from primary storage. [2025-09-28T02:49:51.281890] [DEBUG] [LOCAL ] FAF: Loaded 42474 existing records from primary storage. [2025-09-28T02:49:51.282568] [INFO ] [MAIN ] EXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:51.283403] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. EXR took 0.9s. Estimated remaining: 7m 11s. Rate: 218.6 symbols/min [2025-09-28T02:49:51.284020] [INFO ] [MAIN ] FAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:51.298805] [DEBUG] [LOCAL ] EXPD: Loaded 48786 existing records from primary storage. [2025-09-28T02:49:51.297546] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. FAF took 0.9s. Estimated remaining: 7m 10s. Rate: 218.9 symbols/min [2025-09-28T02:49:51.320144] [INFO ] [MAIN ] EXPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:51.352893] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXPD took 1.0s. Estimated remaining: 7m 9s. Rate: 219.1 symbols/min [2025-09-28T02:49:51.406586] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-09-28T02:49:51.492043] [INFO ] [MAIN ] F: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:51.545133] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 1.2s. Estimated remaining: 7m 9s. Rate: 219.2 symbols/min [2025-09-28T02:49:51.810873] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:51.975306] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:52.048251] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:52.121439] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:52.147282] [DEBUG] [LOCAL ] FBK: Loaded 26066 existing records from primary storage. [2025-09-28T02:49:52.147682] [INFO ] [MAIN ] FBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:52.148354] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBK took 0.8s. Estimated remaining: 7m 9s. Rate: 218.8 symbols/min [2025-09-28T02:49:52.395719] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:52.398340] [DEBUG] [LOCAL ] FBRT: Loaded 34985 existing records from primary storage. [2025-09-28T02:49:52.399937] [DEBUG] [LOCAL ] FBIN: Loaded 51061 existing records from primary storage. [2025-09-28T02:49:52.401264] [INFO ] [MAIN ] FBRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:52.402073] [INFO ] [MAIN ] FBIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:52.402338] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBRT took 0.7s. Estimated remaining: 7m 9s. Rate: 218.9 symbols/min [2025-09-28T02:49:52.415224] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBIN took 1.1s. Estimated remaining: 7m 8s. Rate: 219.1 symbols/min [2025-09-28T02:49:52.550716] [DEBUG] [LOCAL ] FBP: Loaded 46874 existing records from primary storage. [2025-09-28T02:49:52.623465] [INFO ] [MAIN ] FBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:52.653386] [DEBUG] [LOCAL ] FC: Loaded 15634 existing records from primary storage. [2025-09-28T02:49:52.639514] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBP took 1.2s. Estimated remaining: 7m 8s. Rate: 219.2 symbols/min [2025-09-28T02:49:52.664682] [INFO ] [MAIN ] FC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:52.685839] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 0.5s. Estimated remaining: 7m 7s. Rate: 219.4 symbols/min [2025-09-28T02:49:52.880633] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:52.978373] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:53.118506] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:53.207693] [DEBUG] [LOCAL ] FCN: Loaded 26559 existing records from primary storage. [2025-09-28T02:49:53.209582] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:53.210479] [INFO ] [MAIN ] FCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:53.210986] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCN took 0.8s. Estimated remaining: 7m 7s. Rate: 219.1 symbols/min [2025-09-28T02:49:53.210633] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-28T02:49:53.216627] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-28T02:49:53.260279] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-28T02:49:53.277129] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-28T02:49:53.349571] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-28T02:49:53.365629] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-28T02:49:53.505297] [DEBUG] [LOCAL ] FCF: Loaded 40237 existing records from primary storage. [2025-09-28T02:49:53.477916] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:53.556629] [DEBUG] [LOCAL ] FCPT: Loaded 37955 existing records from primary storage. [2025-09-28T02:49:53.544972] [INFO ] [MAIN ] FCF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:53.580896] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCF took 1.2s. Estimated remaining: 7m 7s. Rate: 219.1 symbols/min [2025-09-28T02:49:53.580210] [INFO ] [MAIN ] FCPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:53.581455] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCPT took 0.9s. Estimated remaining: 7m 6s. Rate: 219.3 symbols/min [2025-09-28T02:49:53.725281] [DEBUG] [LOCAL ] FCT: Loaded 14613 existing records from primary storage. [2025-09-28T02:49:53.918412] [INFO ] [MAIN ] FCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:53.959215] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCT took 0.7s. Estimated remaining: 7m 6s. Rate: 219.2 symbols/min [2025-09-28T02:49:54.262514] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:54.365579] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:54.500236] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:54.546522] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:54.562320] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-28T02:49:54.595857] [DEBUG] [LOCAL ] FDP: Loaded 30760 existing records from primary storage. [2025-09-28T02:49:54.603177] [INFO ] [MAIN ] FDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:54.603389] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FDP took 1.0s. Estimated remaining: 7m 7s. Rate: 218.9 symbols/min [2025-09-28T02:49:54.710563] [DEBUG] [LOCAL ] FDS: Loaded 26759 existing records from primary storage. [2025-09-28T02:49:54.742112] [INFO ] [MAIN ] FDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:54.743739] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-09-28T02:49:54.783746] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDS took 0.8s. Estimated remaining: 7m 6s. Rate: 218.9 symbols/min [2025-09-28T02:49:54.827600] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:54.825580] [INFO ] [MAIN ] FCX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:54.833688] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-28T02:49:54.855624] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FCX took 1.3s. Estimated remaining: 7m 6s. Rate: 219.1 symbols/min [2025-09-28T02:49:54.869520] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-28T02:49:55.229419] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:55.234375] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:55.235357] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-28T02:49:55.235439] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-28T02:49:55.235600] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-28T02:49:55.235779] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-28T02:49:55.235866] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-28T02:49:55.235936] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-28T02:49:55.358259] [DEBUG] [LOCAL ] FDX: Loaded 52362 existing records from primary storage. [2025-09-28T02:49:55.358437] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-28T02:49:55.380308] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-28T02:49:55.381457] [INFO ] [MAIN ] FDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:55.382196] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FDX took 0.8s. Estimated remaining: 7m 6s. Rate: 218.9 symbols/min [2025-09-28T02:49:55.788389] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-28T02:49:55.813406] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:55.815022] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-28T02:49:55.818581] [DEBUG] [LOCAL ] FE: Loaded 54208 existing records from primary storage. [2025-09-28T02:49:55.836446] [INFO ] [MAIN ] FE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:55.864698] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FE took 1.0s. Estimated remaining: 7m 6s. Rate: 218.7 symbols/min [2025-09-28T02:49:55.939822] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:55.963065] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-28T02:49:56.097814] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-28T02:49:56.132064] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-28T02:49:56.130184] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:56.154085] [DEBUG] [LOCAL ] FERG: Loaded 49691 existing records from primary storage. [2025-09-28T02:49:56.155028] [INFO ] [MAIN ] FERG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:56.155699] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FERG took 0.8s. Estimated remaining: 7m 6s. Rate: 218.7 symbols/min [2025-09-28T02:49:56.275518] [DEBUG] [LOCAL ] FET: Loaded 12984 existing records from primary storage. [2025-09-28T02:49:56.281767] [INFO ] [MAIN ] FET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:56.297681] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FET took 0.4s. Estimated remaining: 7m 5s. Rate: 218.8 symbols/min [2025-09-28T02:49:56.372503] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:56.372781] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-28T02:49:56.458844] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-28T02:49:56.485998] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-28T02:49:56.498433] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-28T02:49:56.596166] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:56.596982] [DEBUG] [LOCAL ] FF: Loaded 25768 existing records from primary storage. [2025-09-28T02:49:56.597889] [INFO ] [MAIN ] FF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:56.598026] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FF took 0.4s. Estimated remaining: 7m 5s. Rate: 218.8 symbols/min [2025-09-28T02:49:56.719160] [DEBUG] [LOCAL ] FFA: Loaded 5800 existing records from primary storage. [2025-09-28T02:49:56.754464] [INFO ] [MAIN ] FFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:56.768135] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FFA took 0.4s. Estimated remaining: 7m 5s. Rate: 218.9 symbols/min [2025-09-28T02:49:56.838045] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-28T02:49:56.824493] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:56.827590] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-28T02:49:56.857524] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-28T02:49:56.855963] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-28T02:49:56.994326] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:57.001764] [DEBUG] [LOCAL ] FFC: Loaded 16899 existing records from primary storage. [2025-09-28T02:49:57.002406] [INFO ] [MAIN ] FFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:57.002515] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFC took 0.4s. Estimated remaining: 7m 4s. Rate: 218.9 symbols/min [2025-09-28T02:49:57.211147] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-28T02:49:57.207448] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:57.212745] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-28T02:49:57.230102] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-28T02:49:57.232898] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-28T02:49:57.231326] [DEBUG] [LOCAL ] FFWM: Loaded 36532 existing records from primary storage. [2025-09-28T02:49:57.234397] [INFO ] [MAIN ] FFWM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:57.234555] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FFWM took 0.5s. Estimated remaining: 7m 4s. Rate: 219.0 symbols/min [2025-09-28T02:49:57.359974] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-09-28T02:49:57.376118] [INFO ] [MAIN ] FG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:57.386954] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FG took 0.4s. Estimated remaining: 7m 3s. Rate: 219.1 symbols/min [2025-09-28T02:49:57.484961] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:57.513222] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-28T02:49:57.525337] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-28T02:49:57.579785] [DEBUG] [LOCAL ] FGN: Loaded 3915 existing records from primary storage. [2025-09-28T02:49:57.585041] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-28T02:49:57.617830] [INFO ] [MAIN ] FGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:57.619235] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-28T02:49:57.639427] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGN took 0.4s. Estimated remaining: 7m 3s. Rate: 219.1 symbols/min [2025-09-28T02:49:57.639069] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:57.639781] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-28T02:49:57.646148] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-28T02:49:57.687184] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-28T02:49:57.738257] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-28T02:49:57.749887] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-28T02:49:57.749990] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-28T02:49:57.938160] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:57.988614] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-28T02:49:58.028739] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-28T02:49:58.027440] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-28T02:49:58.049066] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-28T02:49:58.263154] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:49:58.263599] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-28T02:49:58.264682] [DEBUG] [LOCAL ] FHI: Loaded 41203 existing records from primary storage. [2025-09-28T02:49:58.265924] [INFO ] [MAIN ] FHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:58.266038] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FHI took 0.6s. Estimated remaining: 7m 3s. Rate: 218.8 symbols/min [2025-09-28T02:49:58.399068] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-28T02:49:58.430976] [INFO ] [REMOTE ] FCRX: Full fetch complete (1674 records). [2025-09-28T02:49:58.461947] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:58.462134] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-28T02:49:58.465551] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-28T02:49:58.500180] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-28T02:49:58.633273] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:49:58.679702] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-28T02:49:58.697742] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:49:58.704522] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-28T02:49:58.704819] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-09-28T02:49:58.720176] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:49:58.721296] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:49:58.721474] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:49:58.721578] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-28T02:49:58.721770] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-28T02:49:58.721938] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-28T02:49:58.722259] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-28T02:49:58.722117] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-28T02:49:58.722476] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-28T02:49:58.722535] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-28T02:49:58.722895] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FGSN took 1.3s. Estimated remaining: 7m 4s. Rate: 218.6 symbols/min [2025-09-28T02:49:58.728358] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-28T02:49:58.735024] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FCRX took 6.0s. Estimated remaining: 7m 3s. Rate: 218.8 symbols/min [2025-09-28T02:49:58.842910] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-28T02:49:58.934240] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-28T02:49:58.986427] [DEBUG] [LOCAL ] FHN: Loaded 54148 existing records from primary storage. [2025-09-28T02:49:59.045424] [INFO ] [MAIN ] FHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:59.092106] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:59.107076] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FHN took 0.8s. Estimated remaining: 7m 3s. Rate: 218.7 symbols/min [2025-09-28T02:49:59.128767] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:59.230032] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-28T02:49:59.258254] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-28T02:49:59.352943] [DEBUG] [LOCAL ] FICO: Loaded 20674 existing records from primary storage. [2025-09-28T02:49:59.370371] [INFO ] [MAIN ] FICO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:59.390100] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:49:59.406561] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-28T02:49:59.406304] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FICO took 0.6s. Estimated remaining: 7m 2s. Rate: 218.7 symbols/min [2025-09-28T02:49:59.406698] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-28T02:49:59.406934] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-28T02:49:59.412538] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-28T02:49:59.427514] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-28T02:49:59.464519] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-28T02:49:59.516916] [DEBUG] [LOCAL ] FI: Loaded 54281 existing records from primary storage. [2025-09-28T02:49:59.580597] [INFO ] [MAIN ] FI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:49:59.637494] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-28T02:49:59.663615] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FI took 0.9s. Estimated remaining: 7m 2s. Rate: 218.7 symbols/min [2025-09-28T02:49:59.692107] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-28T02:49:59.870273] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:00.128604] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:00.272101] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-28T02:50:00.285869] [INFO ] [REMOTE ] FENG: Full fetch complete (2245 records). [2025-09-28T02:50:00.319240] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-28T02:50:00.309749] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:50:00.348971] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-28T02:50:00.416304] [DEBUG] [LOCAL ] FIGS: Loaded 49651 existing records from primary storage. [2025-09-28T02:50:00.470620] [INFO ] [MAIN ] FIGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:00.483001] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-28T02:50:00.493471] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FIGS took 1.1s. Estimated remaining: 7m 3s. Rate: 218.2 symbols/min [2025-09-28T02:50:00.546877] [INFO ] [MAIN ] FIHL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:00.627708] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FIHL took 0.9s. Estimated remaining: 7m 2s. Rate: 218.3 symbols/min [2025-09-28T02:50:00.622312] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:50:00.652807] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:50:00.665472] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:50:00.679221] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-28T02:50:00.733003] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-28T02:50:00.867074] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-28T02:50:00.913182] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-28T02:50:00.953445] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:00.964038] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FENG took 6.1s. Estimated remaining: 7m 2s. Rate: 218.3 symbols/min [2025-09-28T02:50:01.024439] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:00.998376] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-28T02:50:01.026229] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-28T02:50:01.138435] [DEBUG] [LOCAL ] FINS: Loaded 8309 existing records from primary storage. [2025-09-28T02:50:01.161012] [INFO ] [MAIN ] FINS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:01.231850] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINS took 0.7s. Estimated remaining: 7m 2s. Rate: 218.3 symbols/min [2025-09-28T02:50:01.272190] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:01.415448] [DEBUG] [LOCAL ] FINV: Loaded 45772 existing records from primary storage. [2025-09-28T02:50:01.435303] [INFO ] [MAIN ] FINV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:01.498468] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FINV took 0.9s. Estimated remaining: 7m 2s. Rate: 218.3 symbols/min [2025-09-28T02:50:01.503492] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:01.553456] [DEBUG] [LOCAL ] FIS: Loaded 54144 existing records from primary storage. [2025-09-28T02:50:01.554094] [INFO ] [MAIN ] FIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:01.556584] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIS took 0.5s. Estimated remaining: 7m 1s. Rate: 218.5 symbols/min [2025-09-28T02:50:01.581109] [DEBUG] [LOCAL ] FIX: Loaded 30763 existing records from primary storage. [2025-09-28T02:50:01.583117] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-28T02:50:01.584218] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-28T02:50:01.584446] [INFO ] [MAIN ] FIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:01.585279] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIX took 0.3s. Estimated remaining: 7m 0s. Rate: 218.7 symbols/min [2025-09-28T02:50:01.813159] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-28T02:50:01.814372] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-28T02:50:02.036631] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-28T02:50:02.037624] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-28T02:50:02.285276] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-28T02:50:02.286470] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-28T02:50:02.681467] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-28T02:50:02.682699] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-28T02:50:02.830859] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:50:02.831230] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-28T02:50:02.831321] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:50:02.831441] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-09-28T02:50:02.831520] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:50:02.831596] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-28T02:50:02.831733] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-28T02:50:02.831807] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-28T02:50:02.831913] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-28T02:50:02.832007] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIG took 3.7s. Estimated remaining: 7m 2s. Rate: 217.8 symbols/min [2025-09-28T02:50:03.379460] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:03.616436] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:03.552193] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:03.621826] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:03.622799] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-28T02:50:03.622907] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-28T02:50:03.623490] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-28T02:50:03.623790] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-28T02:50:03.623990] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-28T02:50:03.624071] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-28T02:50:03.727047] [DEBUG] [LOCAL ] FLC: Loaded 5559 existing records from primary storage. [2025-09-28T02:50:03.738098] [INFO ] [MAIN ] FLC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:03.743718] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FLC took 0.9s. Estimated remaining: 7m 3s. Rate: 217.2 symbols/min [2025-09-28T02:50:03.989953] [DEBUG] [LOCAL ] FLNG: Loaded 34431 existing records from primary storage. [2025-09-28T02:50:04.014320] [INFO ] [MAIN ] FLNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:04.070235] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLNG took 1.2s. Estimated remaining: 7m 2s. Rate: 217.2 symbols/min [2025-09-28T02:50:04.071438] [DEBUG] [LOCAL ] FLG: Loaded 54105 existing records from primary storage. [2025-09-28T02:50:04.124588] [INFO ] [MAIN ] FLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:04.209802] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLG took 1.4s. Estimated remaining: 7m 2s. Rate: 217.3 symbols/min [2025-09-28T02:50:04.259878] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:04.629343] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:50:04.684981] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-28T02:50:04.686539] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:04.761520] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:04.762197] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-28T02:50:04.763207] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-28T02:50:04.763364] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-28T02:50:04.763460] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-28T02:50:04.763585] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-28T02:50:04.763883] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-28T02:50:04.989902] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:50:05.019830] [DEBUG] [LOCAL ] FLO: Loaded 52656 existing records from primary storage. [2025-09-28T02:50:05.017594] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-28T02:50:05.067529] [INFO ] [MAIN ] FLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:05.067678] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:50:05.080600] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLO took 1.3s. Estimated remaining: 7m 3s. Rate: 216.7 symbols/min [2025-09-28T02:50:05.089496] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-09-28T02:50:05.102934] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:50:05.176832] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-28T02:50:05.275929] [DEBUG] [LOCAL ] FLR: Loaded 53892 existing records from primary storage. [2025-09-28T02:50:05.247888] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-28T02:50:05.336896] [INFO ] [MAIN ] FLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:05.325583] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-28T02:50:05.397056] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-28T02:50:05.386112] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLR took 1.1s. Estimated remaining: 7m 2s. Rate: 216.7 symbols/min [2025-09-28T02:50:05.437723] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FIXT took 2.6s. Estimated remaining: 7m 2s. Rate: 216.9 symbols/min [2025-09-28T02:50:05.941293] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:05.908172] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:50:05.962245] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-28T02:50:06.141904] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:06.138347] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:06.187268] [DEBUG] [LOCAL ] FLXR: Loaded 20315 existing records from primary storage. [2025-09-28T02:50:06.187721] [INFO ] [MAIN ] FLXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:06.187831] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLXR took 0.7s. Estimated remaining: 7m 2s. Rate: 216.5 symbols/min [2025-09-28T02:50:06.194111] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:50:06.255695] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-28T02:50:06.309468] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:50:06.321025] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-09-28T02:50:06.309280] [DEBUG] [LOCAL ] FLS: Loaded 50934 existing records from primary storage. [2025-09-28T02:50:06.321141] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:50:06.338635] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-28T02:50:06.344348] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-28T02:50:06.357353] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-28T02:50:06.367922] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-28T02:50:06.383819] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLOC took 2.3s. Estimated remaining: 7m 2s. Rate: 216.6 symbols/min [2025-09-28T02:50:06.338864] [INFO ] [MAIN ] FLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:06.441806] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:06.470918] [DEBUG] [LOCAL ] FLUT: Loaded 51580 existing records from primary storage. [2025-09-28T02:50:06.472332] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLS took 1.4s. Estimated remaining: 7m 1s. Rate: 216.7 symbols/min [2025-09-28T02:50:06.513131] [INFO ] [MAIN ] FLUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:06.559462] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLUT took 1.1s. Estimated remaining: 7m 1s. Rate: 216.9 symbols/min [2025-09-28T02:50:06.851674] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:06.990801] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:07.070337] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:07.073534] [DEBUG] [LOCAL ] FMC: Loaded 52560 existing records from primary storage. [2025-09-28T02:50:07.081138] [DEBUG] [LOCAL ] FMN: Loaded 6097 existing records from primary storage. [2025-09-28T02:50:07.081756] [INFO ] [MAIN ] FMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:07.082205] [INFO ] [MAIN ] FMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:07.082499] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMN took 0.7s. Estimated remaining: 7m 1s. Rate: 216.7 symbols/min [2025-09-28T02:50:07.094575] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMC took 0.9s. Estimated remaining: 7m 0s. Rate: 216.9 symbols/min [2025-09-28T02:50:07.454146] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:07.481873] [DEBUG] [LOCAL ] FMS: Loaded 30771 existing records from primary storage. [2025-09-28T02:50:07.492844] [INFO ] [MAIN ] FMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:07.524977] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMS took 1.0s. Estimated remaining: 7m 0s. Rate: 216.8 symbols/min [2025-09-28T02:50:07.525999] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:07.540187] [DEBUG] [LOCAL ] FMX: Loaded 41276 existing records from primary storage. [2025-09-28T02:50:07.566475] [DEBUG] [LOCAL ] FMY: Loaded 1400 existing records from primary storage. [2025-09-28T02:50:07.578333] [INFO ] [MAIN ] FMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:07.594963] [INFO ] [MAIN ] FMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:07.583954] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMX took 1.0s. Estimated remaining: 6m 59s. Rate: 217.0 symbols/min [2025-09-28T02:50:07.652896] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMY took 0.6s. Estimated remaining: 6m 59s. Rate: 217.2 symbols/min [2025-09-28T02:50:07.878001] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:08.039604] [DEBUG] [LOCAL ] FN: Loaded 39795 existing records from primary storage. [2025-09-28T02:50:08.110405] [INFO ] [MAIN ] FN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:08.157972] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:08.163372] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:08.158111] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FN took 1.0s. Estimated remaining: 6m 59s. Rate: 217.0 symbols/min [2025-09-28T02:50:08.349098] [DEBUG] [LOCAL ] FNB: Loaded 53226 existing records from primary storage. [2025-09-28T02:50:08.404945] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:08.430003] [INFO ] [MAIN ] FNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:08.431396] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FNB took 0.9s. Estimated remaining: 6m 59s. Rate: 217.0 symbols/min [2025-09-28T02:50:08.596540] [DEBUG] [LOCAL ] FNF: Loaded 49871 existing records from primary storage. [2025-09-28T02:50:08.604475] [DEBUG] [LOCAL ] FND: Loaded 52871 existing records from primary storage. [2025-09-28T02:50:08.610498] [INFO ] [MAIN ] FNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:08.633000] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNF took 1.0s. Estimated remaining: 6m 58s. Rate: 217.0 symbols/min [2025-09-28T02:50:08.639608] [INFO ] [MAIN ] FND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:08.675013] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FND took 1.0s. Estimated remaining: 6m 58s. Rate: 217.3 symbols/min [2025-09-28T02:50:08.765159] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:08.919490] [DEBUG] [LOCAL ] FNV: Loaded 47028 existing records from primary storage. [2025-09-28T02:50:09.010242] [INFO ] [MAIN ] FNV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:09.021296] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FNV took 0.9s. Estimated remaining: 6m 57s. Rate: 217.2 symbols/min [2025-09-28T02:50:09.056825] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:09.084136] [DEBUG] [LOCAL ] FOA: Loaded 13484 existing records from primary storage. [2025-09-28T02:50:09.138826] [INFO ] [MAIN ] FOA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:09.154118] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOA took 0.7s. Estimated remaining: 6m 57s. Rate: 217.3 symbols/min [2025-09-28T02:50:09.218971] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:09.280313] [DEBUG] [LOCAL ] FOF: Loaded 8510 existing records from primary storage. [2025-09-28T02:50:09.303513] [INFO ] [MAIN ] FOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:09.334197] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOF took 0.7s. Estimated remaining: 6m 56s. Rate: 217.4 symbols/min [2025-09-28T02:50:09.465264] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:09.591962] [DEBUG] [LOCAL ] FOR: Loaded 20362 existing records from primary storage. [2025-09-28T02:50:09.645262] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:09.667751] [INFO ] [MAIN ] FOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:09.678906] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOR took 0.9s. Estimated remaining: 6m 56s. Rate: 217.3 symbols/min [2025-09-28T02:50:09.783348] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:09.887293] [DEBUG] [LOCAL ] FPF: Loaded 17998 existing records from primary storage. [2025-09-28T02:50:09.894776] [INFO ] [MAIN ] FPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:09.895005] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPF took 0.7s. Estimated remaining: 6m 56s. Rate: 217.4 symbols/min [2025-09-28T02:50:10.104009] [DEBUG] [LOCAL ] FPH: Loaded 19890 existing records from primary storage. [2025-09-28T02:50:10.072587] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:10.110972] [DEBUG] [LOCAL ] FOUR: Loaded 50306 existing records from primary storage. [2025-09-28T02:50:10.116039] [INFO ] [MAIN ] FPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:10.116664] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FPH took 0.7s. Estimated remaining: 6m 56s. Rate: 217.5 symbols/min [2025-09-28T02:50:10.117304] [INFO ] [MAIN ] FOUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:10.158767] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FOUR took 1.1s. Estimated remaining: 6m 55s. Rate: 217.7 symbols/min [2025-09-28T02:50:10.374194] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:10.551076] [DEBUG] [LOCAL ] FPI: Loaded 31525 existing records from primary storage. [2025-09-28T02:50:10.615244] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:10.611018] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:10.615706] [INFO ] [MAIN ] FPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:10.616740] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPI took 0.9s. Estimated remaining: 6m 55s. Rate: 217.5 symbols/min [2025-09-28T02:50:10.769538] [DEBUG] [LOCAL ] FRA: Loaded 14717 existing records from primary storage. [2025-09-28T02:50:10.836852] [DEBUG] [LOCAL ] FR: Loaded 47174 existing records from primary storage. [2025-09-28T02:50:10.857802] [DEBUG] [LOCAL ] FRGE: Loaded 18571 existing records from primary storage. [2025-09-28T02:50:10.856742] [INFO ] [MAIN ] FRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:10.859829] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:10.860228] [INFO ] [MAIN ] FR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:10.860769] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FRA took 0.7s. Estimated remaining: 6m 55s. Rate: 217.5 symbols/min [2025-09-28T02:50:10.862162] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FR took 0.9s. Estimated remaining: 6m 54s. Rate: 217.8 symbols/min [2025-09-28T02:50:10.862080] [INFO ] [MAIN ] FRGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:10.923862] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 0.7s. Estimated remaining: 6m 53s. Rate: 218.0 symbols/min [2025-09-28T02:50:11.391184] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:11.386759] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:11.476381] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:11.505278] [DEBUG] [LOCAL ] FRO: Loaded 52603 existing records from primary storage. [2025-09-28T02:50:11.506101] [INFO ] [MAIN ] FRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:11.506326] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRO took 0.9s. Estimated remaining: 6m 53s. Rate: 217.7 symbols/min [2025-09-28T02:50:11.744729] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:11.783967] [DEBUG] [LOCAL ] FRT: Loaded 42808 existing records from primary storage. [2025-09-28T02:50:11.785257] [DEBUG] [LOCAL ] FSCO: Loaded 37725 existing records from primary storage. [2025-09-28T02:50:11.785792] [INFO ] [MAIN ] FRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:11.786382] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRT took 0.9s. Estimated remaining: 6m 53s. Rate: 217.7 symbols/min [2025-09-28T02:50:11.786485] [INFO ] [MAIN ] FSCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:11.832873] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FSCO took 1.0s. Estimated remaining: 6m 52s. Rate: 217.9 symbols/min [2025-09-28T02:50:11.947495] [DEBUG] [LOCAL ] FSK: Loaded 50173 existing records from primary storage. [2025-09-28T02:50:12.027679] [INFO ] [MAIN ] FSK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:12.090879] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 1.2s. Estimated remaining: 6m 52s. Rate: 217.9 symbols/min [2025-09-28T02:50:12.189396] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:12.322309] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:12.357777] [DEBUG] [LOCAL ] FSLY: Loaded 51989 existing records from primary storage. [2025-09-28T02:50:12.380397] [INFO ] [MAIN ] FSLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:12.437823] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:12.415990] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 0.9s. Estimated remaining: 6m 52s. Rate: 217.9 symbols/min [2025-09-28T02:50:12.545367] [DEBUG] [LOCAL ] FT: Loaded 6432 existing records from primary storage. [2025-09-28T02:50:12.588295] [INFO ] [MAIN ] FT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:12.605038] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FT took 0.5s. Estimated remaining: 6m 52s. Rate: 217.9 symbols/min [2025-09-28T02:50:12.789235] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:12.812822] [DEBUG] [LOCAL ] FSM: Loaded 54065 existing records from primary storage. [2025-09-28T02:50:12.830182] [DEBUG] [LOCAL ] FSS: Loaded 34888 existing records from primary storage. [2025-09-28T02:50:12.831269] [INFO ] [MAIN ] FSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:12.831163] [INFO ] [MAIN ] FSS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:12.842812] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSM took 1.1s. Estimated remaining: 6m 51s. Rate: 218.0 symbols/min [2025-09-28T02:50:12.853479] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FSS took 1.0s. Estimated remaining: 6m 51s. Rate: 218.2 symbols/min [2025-09-28T02:50:12.915555] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:12.915939] [DEBUG] [LOCAL ] FTHY: Loaded 11947 existing records from primary storage. [2025-09-28T02:50:12.916204] [INFO ] [MAIN ] FTHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:12.916344] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 0.5s. Estimated remaining: 6m 50s. Rate: 218.4 symbols/min [2025-09-28T02:50:12.973423] [DEBUG] [LOCAL ] FTI: Loaded 54078 existing records from primary storage. [2025-09-28T02:50:12.973844] [INFO ] [MAIN ] FTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:12.974305] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 0.4s. Estimated remaining: 6m 49s. Rate: 218.6 symbols/min [2025-09-28T02:50:13.576882] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:13.736042] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:13.739145] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:13.732097] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:13.748150] [DEBUG] [LOCAL ] FTWO: Loaded 1837 existing records from primary storage. [2025-09-28T02:50:13.748433] [INFO ] [MAIN ] FTWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:13.748743] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 0.8s. Estimated remaining: 6m 50s. Rate: 218.2 symbols/min [2025-09-28T02:50:13.991292] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:13.993770] [DEBUG] [LOCAL ] FTS: Loaded 42695 existing records from primary storage. [2025-09-28T02:50:14.004116] [INFO ] [MAIN ] FTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:14.007054] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTS took 1.0s. Estimated remaining: 6m 49s. Rate: 218.2 symbols/min [2025-09-28T02:50:14.008291] [DEBUG] [LOCAL ] FTK: Loaded 32755 existing records from primary storage. [2025-09-28T02:50:14.053356] [INFO ] [MAIN ] FTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:14.106791] [DEBUG] [LOCAL ] FTV: Loaded 53686 existing records from primary storage. [2025-09-28T02:50:14.118137] [INFO ] [MAIN ] FTV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:14.107400] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTK took 1.1s. Estimated remaining: 6m 49s. Rate: 218.3 symbols/min [2025-09-28T02:50:14.143531] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 1.1s. Estimated remaining: 6m 48s. Rate: 218.5 symbols/min [2025-09-28T02:50:14.338345] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:14.553305] [DEBUG] [LOCAL ] FUBO: Loaded 54476 existing records from primary storage. [2025-09-28T02:50:14.661408] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:14.674712] [INFO ] [MAIN ] FUBO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:14.680506] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUBO took 0.9s. Estimated remaining: 6m 48s. Rate: 218.3 symbols/min [2025-09-28T02:50:14.706494] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:14.784139] [DEBUG] [LOCAL ] FUL: Loaded 33570 existing records from primary storage. [2025-09-28T02:50:14.824822] [INFO ] [MAIN ] FUL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:14.842487] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUL took 0.8s. Estimated remaining: 6m 48s. Rate: 218.4 symbols/min [2025-09-28T02:50:14.964458] [DEBUG] [LOCAL ] FVR: Loaded 22328 existing records from primary storage. [2025-09-28T02:50:15.029397] [INFO ] [MAIN ] FVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:15.066481] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FVR took 0.9s. Estimated remaining: 6m 48s. Rate: 218.5 symbols/min [2025-09-28T02:50:15.164346] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:15.202468] [DEBUG] [LOCAL ] FUN: Loaded 52349 existing records from primary storage. [2025-09-28T02:50:15.313838] [INFO ] [MAIN ] FUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:15.337135] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUN took 1.2s. Estimated remaining: 6m 47s. Rate: 218.5 symbols/min [2025-09-28T02:50:15.354992] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:15.497415] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-09-28T02:50:15.575519] [INFO ] [MAIN ] FXED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:15.594606] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FXED took 0.8s. Estimated remaining: 6m 47s. Rate: 218.5 symbols/min [2025-09-28T02:50:15.579891] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:15.734904] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:15.820321] [DEBUG] [LOCAL ] FVRR: Loaded 40749 existing records from primary storage. [2025-09-28T02:50:15.841631] [INFO ] [MAIN ] FVRR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:15.929090] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:15.916892] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FVRR took 1.2s. Estimated remaining: 6m 47s. Rate: 218.4 symbols/min [2025-09-28T02:50:16.029583] [DEBUG] [LOCAL ] GAB: Loaded 28493 existing records from primary storage. [2025-09-28T02:50:16.052196] [DEBUG] [LOCAL ] GAM: Loaded 4174 existing records from primary storage. [2025-09-28T02:50:16.079691] [INFO ] [MAIN ] GAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:16.093586] [INFO ] [MAIN ] GAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:16.116208] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. GAM took 0.5s. Estimated remaining: 6m 46s. Rate: 218.5 symbols/min [2025-09-28T02:50:16.153018] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAB took 0.8s. Estimated remaining: 6m 46s. Rate: 218.7 symbols/min [2025-09-28T02:50:16.197533] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:16.143881] [DEBUG] [LOCAL ] G: Loaded 50547 existing records from primary storage. [2025-09-28T02:50:16.295884] [INFO ] [MAIN ] G: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:16.327422] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. G took 1.1s. Estimated remaining: 6m 45s. Rate: 218.8 symbols/min [2025-09-28T02:50:16.588892] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:16.765761] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:16.816783] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:16.826140] [DEBUG] [LOCAL ] GATX: Loaded 18437 existing records from primary storage. [2025-09-28T02:50:16.826453] [INFO ] [MAIN ] GATX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:16.826536] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GATX took 0.7s. Estimated remaining: 6m 45s. Rate: 218.6 symbols/min [2025-09-28T02:50:16.963811] [DEBUG] [LOCAL ] GAP: Loaded 54435 existing records from primary storage. [2025-09-28T02:50:16.987286] [DEBUG] [LOCAL ] GBAB: Loaded 13142 existing records from primary storage. [2025-09-28T02:50:16.995152] [INFO ] [MAIN ] GAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:17.028788] [INFO ] [MAIN ] GBAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:17.068943] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:17.066192] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GAP took 1.1s. Estimated remaining: 6m 45s. Rate: 218.6 symbols/min [2025-09-28T02:50:17.069964] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-28T02:50:17.087805] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GBAB took 0.9s. Estimated remaining: 6m 44s. Rate: 218.9 symbols/min [2025-09-28T02:50:17.104632] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-28T02:50:17.224867] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-28T02:50:17.272000] [DEBUG] [LOCAL ] GBCI: Loaded 40720 existing records from primary storage. [2025-09-28T02:50:17.288143] [INFO ] [MAIN ] GBCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:17.277500] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-28T02:50:17.314901] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBCI took 1.0s. Estimated remaining: 6m 44s. Rate: 218.9 symbols/min [2025-09-28T02:50:17.333577] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-28T02:50:17.344269] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-28T02:50:17.496545] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:17.597446] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:17.826879] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:17.989968] [DEBUG] [LOCAL ] GBTG: Loaded 40807 existing records from primary storage. [2025-09-28T02:50:18.034624] [INFO ] [MAIN ] GBTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:18.060228] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBTG took 1.0s. Estimated remaining: 6m 45s. Rate: 218.5 symbols/min [2025-09-28T02:50:18.087266] [DEBUG] [LOCAL ] GBX: Loaded 29497 existing records from primary storage. [2025-09-28T02:50:18.160702] [INFO ] [MAIN ] GBX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:18.173874] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBX took 1.1s. Estimated remaining: 6m 44s. Rate: 218.6 symbols/min [2025-09-28T02:50:18.317113] [DEBUG] [LOCAL ] GCI: Loaded 44828 existing records from primary storage. [2025-09-28T02:50:18.411805] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:50:18.439042] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-28T02:50:18.422578] [INFO ] [MAIN ] GCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:18.501740] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GCI took 1.2s. Estimated remaining: 6m 44s. Rate: 218.6 symbols/min [2025-09-28T02:50:18.556448] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:18.687913] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:18.853821] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-28T02:50:18.855747] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-28T02:50:18.849435] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:18.874036] [DEBUG] [LOCAL ] GCTS: Loaded 20060 existing records from primary storage. [2025-09-28T02:50:18.874701] [INFO ] [MAIN ] GCTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:18.875338] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCTS took 0.7s. Estimated remaining: 6m 44s. Rate: 218.5 symbols/min [2025-09-28T02:50:18.876793] [DEBUG] [LOCAL ] GCO: Loaded 25686 existing records from primary storage. [2025-09-28T02:50:18.934184] [INFO ] [MAIN ] GCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:18.967872] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCO took 0.9s. Estimated remaining: 6m 43s. Rate: 218.6 symbols/min [2025-09-28T02:50:19.004492] [DEBUG] [LOCAL ] GCV: Loaded 7333 existing records from primary storage. [2025-09-28T02:50:19.052670] [INFO ] [MAIN ] GCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:19.151373] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCV took 0.6s. Estimated remaining: 6m 43s. Rate: 218.7 symbols/min [2025-09-28T02:50:19.174458] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-28T02:50:19.196821] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:19.230735] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-28T02:50:19.406089] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:19.491767] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-28T02:50:19.491402] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:19.493331] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-28T02:50:19.516994] [DEBUG] [LOCAL ] GDIV: Loaded 3724 existing records from primary storage. [2025-09-28T02:50:19.517568] [INFO ] [MAIN ] GDIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:19.517754] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GDIV took 0.3s. Estimated remaining: 6m 43s. Rate: 218.6 symbols/min [2025-09-28T02:50:19.670116] [DEBUG] [LOCAL ] GD: Loaded 47940 existing records from primary storage. [2025-09-28T02:50:19.677271] [INFO ] [MAIN ] GD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:19.683007] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GD took 0.8s. Estimated remaining: 6m 42s. Rate: 218.7 symbols/min [2025-09-28T02:50:19.821955] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:19.784893] [DEBUG] [LOCAL ] GDDY: Loaded 50449 existing records from primary storage. [2025-09-28T02:50:19.830474] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-28T02:50:19.841804] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-28T02:50:19.851506] [INFO ] [MAIN ] GDDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:19.864331] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GDDY took 0.9s. Estimated remaining: 6m 42s. Rate: 218.8 symbols/min [2025-09-28T02:50:19.878383] [DEBUG] [LOCAL ] GDL: Loaded 2572 existing records from primary storage. [2025-09-28T02:50:19.906790] [INFO ] [MAIN ] GDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:19.939129] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDL took 0.4s. Estimated remaining: 6m 41s. Rate: 219.0 symbols/min [2025-09-28T02:50:20.258331] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:20.258568] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-28T02:50:20.287885] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:20.290379] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-28T02:50:20.384157] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:20.384815] [DEBUG] [LOCAL ] GDO: Loaded 6076 existing records from primary storage. [2025-09-28T02:50:20.385877] [INFO ] [MAIN ] GDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:20.386221] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDO took 0.7s. Estimated remaining: 6m 41s. Rate: 218.8 symbols/min [2025-09-28T02:50:20.573435] [DEBUG] [LOCAL ] GDV: Loaded 19971 existing records from primary storage. [2025-09-28T02:50:20.623156] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:20.623582] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-28T02:50:20.625896] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-28T02:50:20.627904] [DEBUG] [LOCAL ] GDOT: Loaded 39279 existing records from primary storage. [2025-09-28T02:50:20.629212] [INFO ] [MAIN ] GDOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:20.624300] [INFO ] [MAIN ] GDV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:20.629580] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDOT took 0.8s. Estimated remaining: 6m 41s. Rate: 218.9 symbols/min [2025-09-28T02:50:20.642469] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDV took 0.7s. Estimated remaining: 6m 40s. Rate: 219.1 symbols/min [2025-09-28T02:50:20.864742] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-28T02:50:20.921862] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-28T02:50:20.992112] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:21.064340] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:21.068776] [DEBUG] [LOCAL ] GE: Loaded 54493 existing records from primary storage. [2025-09-28T02:50:21.069376] [INFO ] [MAIN ] GE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:21.069943] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GE took 0.7s. Estimated remaining: 6m 40s. Rate: 219.0 symbols/min [2025-09-28T02:50:21.236235] [DEBUG] [LOCAL ] GEF: Loaded 20965 existing records from primary storage. [2025-09-28T02:50:21.269710] [INFO ] [MAIN ] GEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:21.290301] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GEF took 0.7s. Estimated remaining: 6m 40s. Rate: 219.0 symbols/min [2025-09-28T02:50:21.288885] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-28T02:50:21.302788] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-28T02:50:21.304421] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:21.408940] [DEBUG] [LOCAL ] GEL: Loaded 34252 existing records from primary storage. [2025-09-28T02:50:21.427623] [INFO ] [MAIN ] GEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:21.427789] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GEL took 0.7s. Estimated remaining: 6m 39s. Rate: 219.1 symbols/min [2025-09-28T02:50:21.612710] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:21.752227] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:21.754592] [DEBUG] [LOCAL ] GENI: Loaded 53679 existing records from primary storage. [2025-09-28T02:50:21.752773] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-28T02:50:21.757698] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-28T02:50:21.759121] [INFO ] [MAIN ] GENI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:21.759867] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GENI took 0.7s. Estimated remaining: 6m 39s. Rate: 219.1 symbols/min [2025-09-28T02:50:22.013249] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:22.016409] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-28T02:50:22.017489] [INFO ] [REMOTE ] GBLI: Full fetch complete (1330 records). [2025-09-28T02:50:22.021832] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-28T02:50:22.020575] [DEBUG] [LOCAL ] GEO: Loaded 52812 existing records from primary storage. [2025-09-28T02:50:22.063311] [INFO ] [MAIN ] GEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:22.077282] [DEBUG] [LOCAL ] GES: Loaded 40424 existing records from primary storage. [2025-09-28T02:50:22.105856] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GEO took 0.8s. Estimated remaining: 6m 39s. Rate: 219.0 symbols/min [2025-09-28T02:50:22.121125] [INFO ] [MAIN ] GES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:22.148721] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GES took 0.7s. Estimated remaining: 6m 38s. Rate: 219.2 symbols/min [2025-09-28T02:50:22.454373] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-28T02:50:22.493135] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:50:22.466274] [DEBUG] [LOCAL ] GETY: Loaded 36378 existing records from primary storage. [2025-09-28T02:50:22.493337] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:50:22.541772] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-28T02:50:22.565855] [INFO ] [MAIN ] GETY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:22.587493] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GETY took 0.8s. Estimated remaining: 6m 38s. Rate: 219.1 symbols/min [2025-09-28T02:50:22.597050] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-28T02:50:22.598306] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:22.603799] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-28T02:50:22.684680] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:22.685199] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-28T02:50:22.685903] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GBLI took 5.9s. Estimated remaining: 6m 38s. Rate: 219.2 symbols/min [2025-09-28T02:50:22.693024] [DEBUG] [LOCAL ] GF: Loaded 3220 existing records from primary storage. [2025-09-28T02:50:22.693401] [INFO ] [MAIN ] GF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:22.693691] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GF took 0.5s. Estimated remaining: 6m 37s. Rate: 219.5 symbols/min [2025-09-28T02:50:22.747824] [DEBUG] [LOCAL ] GEV: Loaded 53878 existing records from primary storage. [2025-09-28T02:50:22.748192] [INFO ] [MAIN ] GEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:22.748528] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 0.6s. Estimated remaining: 6m 36s. Rate: 219.7 symbols/min [2025-09-28T02:50:23.449033] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:23.468568] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:23.505133] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:23.509173] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:23.527063] [DEBUG] [LOCAL ] GFR: Loaded 8572 existing records from primary storage. [2025-09-28T02:50:23.527528] [INFO ] [MAIN ] GFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:23.527678] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 0.8s. Estimated remaining: 6m 37s. Rate: 219.2 symbols/min [2025-09-28T02:50:23.738234] [DEBUG] [LOCAL ] GFF: Loaded 31088 existing records from primary storage. [2025-09-28T02:50:23.757553] [INFO ] [MAIN ] GFF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:23.774375] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 1.0s. Estimated remaining: 6m 37s. Rate: 219.2 symbols/min [2025-09-28T02:50:23.787679] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:23.888310] [DEBUG] [LOCAL ] GFL: Loaded 48755 existing records from primary storage. [2025-09-28T02:50:23.899571] [INFO ] [MAIN ] GFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:23.933553] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFL took 1.2s. Estimated remaining: 6m 36s. Rate: 219.3 symbols/min [2025-09-28T02:50:23.955878] [DEBUG] [LOCAL ] GFI: Loaded 53887 existing records from primary storage. [2025-09-28T02:50:24.004191] [INFO ] [MAIN ] GFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:24.043508] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 1.3s. Estimated remaining: 6m 36s. Rate: 219.5 symbols/min [2025-09-28T02:50:24.118043] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:24.329817] [DEBUG] [LOCAL ] GGB: Loaded 51813 existing records from primary storage. [2025-09-28T02:50:24.339952] [INFO ] [MAIN ] GGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:24.373716] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGB took 0.8s. Estimated remaining: 6m 35s. Rate: 219.4 symbols/min [2025-09-28T02:50:24.405682] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:24.488896] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:24.600977] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-09-28T02:50:24.616587] [INFO ] [MAIN ] GGZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:24.653501] [DEBUG] [LOCAL ] GGG: Loaded 41580 existing records from primary storage. [2025-09-28T02:50:24.660711] [DEBUG] [LOCAL ] GGT: Loaded 14309 existing records from primary storage. [2025-09-28T02:50:24.653761] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGZ took 0.5s. Estimated remaining: 6m 35s. Rate: 219.4 symbols/min [2025-09-28T02:50:24.690152] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:24.689199] [INFO ] [MAIN ] GGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:24.695764] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGG took 0.9s. Estimated remaining: 6m 34s. Rate: 219.6 symbols/min [2025-09-28T02:50:24.712272] [INFO ] [MAIN ] GGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:24.757932] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGT took 0.8s. Estimated remaining: 6m 34s. Rate: 219.8 symbols/min [2025-09-28T02:50:24.830249] [DEBUG] [LOCAL ] GHC: Loaded 2664 existing records from primary storage. [2025-09-28T02:50:24.925183] [INFO ] [MAIN ] GHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:24.955529] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHC took 0.5s. Estimated remaining: 6m 34s. Rate: 219.9 symbols/min [2025-09-28T02:50:25.221009] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:25.306480] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:25.358179] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:25.428977] [DEBUG] [LOCAL ] GHG: Loaded 3226 existing records from primary storage. [2025-09-28T02:50:25.410050] [DEBUG] [LOCAL ] GHLD: Loaded 4168 existing records from primary storage. [2025-09-28T02:50:25.460403] [INFO ] [MAIN ] GHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:25.465820] [INFO ] [MAIN ] GHLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:25.467110] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:25.465962] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHG took 0.8s. Estimated remaining: 6m 34s. Rate: 219.7 symbols/min [2025-09-28T02:50:25.467936] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHLD took 0.7s. Estimated remaining: 6m 33s. Rate: 219.9 symbols/min [2025-09-28T02:50:25.483727] [DEBUG] [LOCAL ] GHI: Loaded 6963 existing records from primary storage. [2025-09-28T02:50:25.522699] [INFO ] [MAIN ] GHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:25.559003] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHI took 0.9s. Estimated remaining: 6m 32s. Rate: 220.1 symbols/min [2025-09-28T02:50:25.625405] [DEBUG] [LOCAL ] GHM: Loaded 14350 existing records from primary storage. [2025-09-28T02:50:25.680705] [INFO ] [MAIN ] GHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:25.710705] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHM took 0.7s. Estimated remaining: 6m 32s. Rate: 220.2 symbols/min [2025-09-28T02:50:26.050054] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:26.013247] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:26.242601] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:26.247492] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:26.276092] [DEBUG] [LOCAL ] GHY: Loaded 21190 existing records from primary storage. [2025-09-28T02:50:26.277468] [INFO ] [MAIN ] GHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:26.278613] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHY took 0.8s. Estimated remaining: 6m 32s. Rate: 219.9 symbols/min [2025-09-28T02:50:26.352049] [DEBUG] [LOCAL ] GIB: Loaded 32653 existing records from primary storage. [2025-09-28T02:50:26.393377] [INFO ] [MAIN ] GIB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:26.399555] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIB took 0.9s. Estimated remaining: 6m 32s. Rate: 220.0 symbols/min [2025-09-28T02:50:26.392789] [DEBUG] [LOCAL ] GIC: Loaded 13796 existing records from primary storage. [2025-09-28T02:50:26.428968] [INFO ] [MAIN ] GIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:26.459344] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIC took 0.8s. Estimated remaining: 6m 31s. Rate: 220.2 symbols/min [2025-09-28T02:50:26.649026] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:26.771331] [DEBUG] [LOCAL ] GIL: Loaded 43906 existing records from primary storage. [2025-09-28T02:50:26.777483] [INFO ] [MAIN ] GIL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:26.810206] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GIL took 1.1s. Estimated remaining: 6m 31s. Rate: 220.2 symbols/min [2025-09-28T02:50:26.901877] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:26.956503] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:27.176752] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:27.225879] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-09-28T02:50:27.226544] [INFO ] [MAIN ] GIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:27.226977] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIS took 0.9s. Estimated remaining: 6m 31s. Rate: 220.0 symbols/min [2025-09-28T02:50:27.223989] [DEBUG] [LOCAL ] GKOS: Loaded 43585 existing records from primary storage. [2025-09-28T02:50:27.227417] [INFO ] [MAIN ] GKOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:27.239257] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GKOS took 0.8s. Estimated remaining: 6m 30s. Rate: 220.3 symbols/min [2025-09-28T02:50:27.444996] [DEBUG] [LOCAL ] GL: Loaded 38382 existing records from primary storage. [2025-09-28T02:50:27.482222] [INFO ] [MAIN ] GL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:27.487887] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GL took 1.0s. Estimated remaining: 6m 30s. Rate: 220.3 symbols/min [2025-09-28T02:50:27.636905] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:27.700492] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:27.738064] [DEBUG] [LOCAL ] GLOB: Loaded 48111 existing records from primary storage. [2025-09-28T02:50:27.767939] [INFO ] [MAIN ] GLOB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:27.781528] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLOB took 0.8s. Estimated remaining: 6m 30s. Rate: 220.3 symbols/min [2025-09-28T02:50:27.868288] [DEBUG] [LOCAL ] GLP: Loaded 9585 existing records from primary storage. [2025-09-28T02:50:27.917937] [INFO ] [MAIN ] GLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:27.969087] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLP took 0.7s. Estimated remaining: 6m 29s. Rate: 220.3 symbols/min [2025-09-28T02:50:27.958552] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:28.170383] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:28.253753] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-09-28T02:50:28.290576] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:28.291724] [INFO ] [MAIN ] GLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:28.292345] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLW took 1.0s. Estimated remaining: 6m 29s. Rate: 220.3 symbols/min [2025-09-28T02:50:28.459929] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-09-28T02:50:28.515909] [INFO ] [MAIN ] GM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:28.540136] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:28.541786] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GM took 1.0s. Estimated remaining: 6m 29s. Rate: 220.3 symbols/min [2025-09-28T02:50:28.631740] [DEBUG] [LOCAL ] GME: Loaded 54540 existing records from primary storage. [2025-09-28T02:50:28.712391] [INFO ] [MAIN ] GME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:28.718771] [DEBUG] [LOCAL ] GMED: Loaded 49096 existing records from primary storage. [2025-09-28T02:50:28.724104] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GME took 0.9s. Estimated remaining: 6m 28s. Rate: 220.4 symbols/min [2025-09-28T02:50:28.775036] [INFO ] [MAIN ] GMED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:28.818968] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GMED took 0.8s. Estimated remaining: 6m 28s. Rate: 220.5 symbols/min [2025-09-28T02:50:28.958675] [DEBUG] [LOCAL ] GMRE: Loaded 38133 existing records from primary storage. [2025-09-28T02:50:28.987460] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:29.077212] [INFO ] [MAIN ] GMRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:29.127390] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:29.127548] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GMRE took 0.8s. Estimated remaining: 6m 27s. Rate: 220.5 symbols/min [2025-09-28T02:50:29.279194] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:29.369897] [DEBUG] [LOCAL ] GNE: Loaded 17940 existing records from primary storage. [2025-09-28T02:50:29.375391] [INFO ] [MAIN ] GNE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:29.375994] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNE took 0.8s. Estimated remaining: 6m 27s. Rate: 220.5 symbols/min [2025-09-28T02:50:29.519150] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:29.654268] [DEBUG] [LOCAL ] GNK: Loaded 41039 existing records from primary storage. [2025-09-28T02:50:29.665467] [INFO ] [MAIN ] GNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:29.692904] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNK took 1.0s. Estimated remaining: 6m 27s. Rate: 220.5 symbols/min [2025-09-28T02:50:29.757789] [DEBUG] [LOCAL ] GNL: Loaded 47785 existing records from primary storage. [2025-09-28T02:50:29.775216] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:29.796765] [INFO ] [MAIN ] GNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:29.821164] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNL took 0.9s. Estimated remaining: 6m 26s. Rate: 220.6 symbols/min [2025-09-28T02:50:29.989779] [DEBUG] [LOCAL ] GNT: Loaded 8177 existing records from primary storage. [2025-09-28T02:50:30.040447] [INFO ] [MAIN ] GNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:30.042128] [DEBUG] [LOCAL ] GNRC: Loaded 45886 existing records from primary storage. [2025-09-28T02:50:30.075352] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNT took 0.7s. Estimated remaining: 6m 26s. Rate: 220.6 symbols/min [2025-09-28T02:50:30.103930] [INFO ] [MAIN ] GNRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:30.178026] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:30.185240] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNRC took 1.0s. Estimated remaining: 6m 26s. Rate: 220.8 symbols/min [2025-09-28T02:50:30.274188] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:30.408884] [DEBUG] [LOCAL ] GNTY: Loaded 7353 existing records from primary storage. [2025-09-28T02:50:30.481789] [INFO ] [MAIN ] GNTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:30.560316] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:30.560451] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNTY took 0.8s. Estimated remaining: 6m 26s. Rate: 220.7 symbols/min [2025-09-28T02:50:30.599468] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:30.845853] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:30.857055] [DEBUG] [LOCAL ] GNW: Loaded 52086 existing records from primary storage. [2025-09-28T02:50:30.861019] [DEBUG] [LOCAL ] GOLF: Loaded 32049 existing records from primary storage. [2025-09-28T02:50:30.861876] [INFO ] [MAIN ] GOLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:30.862459] [INFO ] [MAIN ] GNW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:30.862607] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOLF took 0.7s. Estimated remaining: 6m 25s. Rate: 220.6 symbols/min [2025-09-28T02:50:30.888556] [DEBUG] [LOCAL ] GOF: Loaded 43374 existing records from primary storage. [2025-09-28T02:50:30.899951] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GNW took 1.0s. Estimated remaining: 6m 25s. Rate: 220.8 symbols/min [2025-09-28T02:50:30.938921] [INFO ] [MAIN ] GOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:30.995715] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOF took 0.9s. Estimated remaining: 6m 24s. Rate: 221.0 symbols/min [2025-09-28T02:50:31.380620] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:31.433728] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:31.471826] [DEBUG] [LOCAL ] GOOS: Loaded 46008 existing records from primary storage. [2025-09-28T02:50:31.479987] [INFO ] [MAIN ] GOOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:31.480534] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOOS took 0.9s. Estimated remaining: 6m 24s. Rate: 220.8 symbols/min [2025-09-28T02:50:31.504575] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:31.544521] [DEBUG] [LOCAL ] GPI: Loaded 15126 existing records from primary storage. [2025-09-28T02:50:31.544937] [INFO ] [MAIN ] GPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:31.545046] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GPI took 0.5s. Estimated remaining: 6m 24s. Rate: 221.0 symbols/min [2025-09-28T02:50:31.560372] [DEBUG] [LOCAL ] GOTU: Loaded 39533 existing records from primary storage. [2025-09-28T02:50:31.560790] [INFO ] [MAIN ] GOTU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:31.560898] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GOTU took 0.7s. Estimated remaining: 6m 23s. Rate: 221.2 symbols/min [2025-09-28T02:50:31.618872] [DEBUG] [LOCAL ] GPC: Loaded 47289 existing records from primary storage. [2025-09-28T02:50:31.619435] [INFO ] [MAIN ] GPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:31.620023] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 0.7s. Estimated remaining: 6m 22s. Rate: 221.4 symbols/min [2025-09-28T02:50:32.295822] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:32.378751] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:32.396068] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:32.433496] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:32.448023] [DEBUG] [LOCAL ] GPJA: Loaded 4140 existing records from primary storage. [2025-09-28T02:50:32.449093] [INFO ] [MAIN ] GPJA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:32.449328] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPJA took 0.8s. Estimated remaining: 6m 23s. Rate: 220.9 symbols/min [2025-09-28T02:50:32.607179] [DEBUG] [LOCAL ] GPMT: Loaded 26788 existing records from primary storage. [2025-09-28T02:50:32.638923] [INFO ] [MAIN ] GPMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:32.669947] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPMT took 1.0s. Estimated remaining: 6m 23s. Rate: 221.0 symbols/min [2025-09-28T02:50:32.783486] [DEBUG] [LOCAL ] GPK: Loaded 53441 existing records from primary storage. [2025-09-28T02:50:32.771054] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:32.854741] [INFO ] [MAIN ] GPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:32.854481] [DEBUG] [LOCAL ] GPN: Loaded 52822 existing records from primary storage. [2025-09-28T02:50:32.856342] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPK took 1.2s. Estimated remaining: 6m 22s. Rate: 221.0 symbols/min [2025-09-28T02:50:32.865806] [INFO ] [MAIN ] GPN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:32.960776] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 1.3s. Estimated remaining: 6m 22s. Rate: 221.2 symbols/min [2025-09-28T02:50:33.139360] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:33.292085] [DEBUG] [LOCAL ] GPOR: Loaded 23328 existing records from primary storage. [2025-09-28T02:50:33.291113] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:33.298160] [INFO ] [MAIN ] GPOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:33.298698] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 0.8s. Estimated remaining: 6m 22s. Rate: 221.1 symbols/min [2025-09-28T02:50:33.460424] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:33.585378] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:33.612177] [DEBUG] [LOCAL ] GPRK: Loaded 39841 existing records from primary storage. [2025-09-28T02:50:33.606964] [DEBUG] [LOCAL ] GRBK: Loaded 27375 existing records from primary storage. [2025-09-28T02:50:33.612497] [DEBUG] [LOCAL ] GRC: Loaded 9061 existing records from primary storage. [2025-09-28T02:50:33.613160] [INFO ] [MAIN ] GPRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:33.613998] [INFO ] [MAIN ] GRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:33.613252] [INFO ] [MAIN ] GRBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:33.614121] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GPRK took 0.9s. Estimated remaining: 6m 21s. Rate: 221.1 symbols/min [2025-09-28T02:50:33.614714] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRC took 0.6s. Estimated remaining: 6m 21s. Rate: 221.3 symbols/min [2025-09-28T02:50:33.648230] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRBK took 0.7s. Estimated remaining: 6m 20s. Rate: 221.5 symbols/min [2025-09-28T02:50:34.097272] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:34.074710] [DEBUG] [LOCAL ] GRDN: Loaded 20178 existing records from primary storage. [2025-09-28T02:50:34.135829] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:34.156998] [INFO ] [MAIN ] GRDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:34.207345] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRDN took 0.9s. Estimated remaining: 6m 20s. Rate: 221.3 symbols/min [2025-09-28T02:50:34.208325] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:34.444469] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:34.489481] [DEBUG] [LOCAL ] GRND: Loaded 50744 existing records from primary storage. [2025-09-28T02:50:34.487834] [DEBUG] [LOCAL ] GRNT: Loaded 34235 existing records from primary storage. [2025-09-28T02:50:34.490873] [DEBUG] [LOCAL ] GRMN: Loaded 41798 existing records from primary storage. [2025-09-28T02:50:34.491629] [INFO ] [MAIN ] GRNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:34.491747] [INFO ] [MAIN ] GRND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:34.492563] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRNT took 0.8s. Estimated remaining: 6m 20s. Rate: 221.3 symbols/min [2025-09-28T02:50:34.498408] [DEBUG] [LOCAL ] GROV: Loaded 9240 existing records from primary storage. [2025-09-28T02:50:34.503855] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRND took 0.9s. Estimated remaining: 6m 19s. Rate: 221.5 symbols/min [2025-09-28T02:50:34.492794] [INFO ] [MAIN ] GRMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:34.515760] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRMN took 0.9s. Estimated remaining: 6m 19s. Rate: 221.7 symbols/min [2025-09-28T02:50:34.562740] [INFO ] [MAIN ] GROV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:34.626346] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GROV took 0.4s. Estimated remaining: 6m 18s. Rate: 221.8 symbols/min [2025-09-28T02:50:35.131225] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:35.176181] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:35.195716] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:35.279181] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:35.283985] [DEBUG] [LOCAL ] GRX: Loaded 4547 existing records from primary storage. [2025-09-28T02:50:35.284372] [INFO ] [MAIN ] GRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:35.284473] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRX took 0.8s. Estimated remaining: 6m 18s. Rate: 221.5 symbols/min [2025-09-28T02:50:35.512530] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:35.542685] [DEBUG] [LOCAL ] GSBD: Loaded 39756 existing records from primary storage. [2025-09-28T02:50:35.558044] [INFO ] [MAIN ] GSBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:35.558482] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GSBD took 1.0s. Estimated remaining: 6m 18s. Rate: 221.5 symbols/min [2025-09-28T02:50:35.587745] [DEBUG] [LOCAL ] GS: Loaded 52736 existing records from primary storage. [2025-09-28T02:50:35.633942] [INFO ] [MAIN ] GS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:35.672924] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GS took 1.2s. Estimated remaining: 6m 18s. Rate: 221.6 symbols/min [2025-09-28T02:50:35.740084] [DEBUG] [LOCAL ] GSK: Loaded 54272 existing records from primary storage. [2025-09-28T02:50:35.793372] [INFO ] [MAIN ] GSK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:35.821140] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSK took 1.1s. Estimated remaining: 6m 17s. Rate: 221.7 symbols/min [2025-09-28T02:50:35.948675] [DEBUG] [LOCAL ] GSL: Loaded 33824 existing records from primary storage. [2025-09-28T02:50:36.012326] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:35.988887] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:36.028365] [INFO ] [MAIN ] GSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:36.045629] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GSL took 0.8s. Estimated remaining: 6m 17s. Rate: 221.8 symbols/min [2025-09-28T02:50:36.373058] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:36.417589] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:36.432494] [DEBUG] [LOCAL ] GTLS: Loaded 43461 existing records from primary storage. [2025-09-28T02:50:36.432971] [INFO ] [MAIN ] GTLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:36.433510] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTLS took 0.8s. Estimated remaining: 6m 17s. Rate: 221.7 symbols/min [2025-09-28T02:50:36.568101] [DEBUG] [LOCAL ] GTES: Loaded 51399 existing records from primary storage. [2025-09-28T02:50:36.595274] [INFO ] [MAIN ] GTES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:36.601926] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTES took 1.0s. Estimated remaining: 6m 16s. Rate: 221.8 symbols/min [2025-09-28T02:50:36.668268] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:36.759389] [DEBUG] [LOCAL ] GTY: Loaded 30796 existing records from primary storage. [2025-09-28T02:50:36.814821] [INFO ] [MAIN ] GTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:36.821170] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTY took 0.8s. Estimated remaining: 6m 16s. Rate: 221.8 symbols/min [2025-09-28T02:50:36.890081] [DEBUG] [LOCAL ] GUG: Loaded 12138 existing records from primary storage. [2025-09-28T02:50:36.844638] [DEBUG] [LOCAL ] GTN: Loaded 46301 existing records from primary storage. [2025-09-28T02:50:36.914544] [INFO ] [MAIN ] GUG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:36.946938] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:36.957568] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GUG took 0.5s. Estimated remaining: 6m 16s. Rate: 221.9 symbols/min [2025-09-28T02:50:36.916420] [INFO ] [MAIN ] GTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:36.986361] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GTN took 1.1s. Estimated remaining: 6m 15s. Rate: 222.1 symbols/min [2025-09-28T02:50:37.265730] [DEBUG] [LOCAL ] GUT: Loaded 15560 existing records from primary storage. [2025-09-28T02:50:37.341471] [INFO ] [MAIN ] GUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:37.364748] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:37.397877] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUT took 0.8s. Estimated remaining: 6m 15s. Rate: 222.0 symbols/min [2025-09-28T02:50:37.518871] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:37.538194] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:37.699585] [DEBUG] [LOCAL ] GVA: Loaded 34030 existing records from primary storage. [2025-09-28T02:50:37.700863] [INFO ] [MAIN ] GVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:37.712949] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GVA took 0.9s. Estimated remaining: 6m 15s. Rate: 222.0 symbols/min [2025-09-28T02:50:37.764334] [DEBUG] [LOCAL ] GWH: Loaded 15825 existing records from primary storage. [2025-09-28T02:50:37.849981] [INFO ] [MAIN ] GWH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:37.844560] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:37.879792] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWH took 0.9s. Estimated remaining: 6m 14s. Rate: 222.0 symbols/min [2025-09-28T02:50:37.962084] [DEBUG] [LOCAL ] GWRE: Loaded 41564 existing records from primary storage. [2025-09-28T02:50:38.062282] [INFO ] [MAIN ] GWRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:38.144869] [DEBUG] [LOCAL ] GWW: Loaded 20108 existing records from primary storage. [2025-09-28T02:50:38.136061] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:38.136884] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWRE took 1.1s. Estimated remaining: 6m 14s. Rate: 222.1 symbols/min [2025-09-28T02:50:38.178624] [INFO ] [MAIN ] GWW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:38.236416] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GWW took 0.8s. Estimated remaining: 6m 13s. Rate: 222.2 symbols/min [2025-09-28T02:50:38.284531] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:38.384579] [DEBUG] [LOCAL ] GYLD: Loaded 1569 existing records from primary storage. [2025-09-28T02:50:38.396369] [INFO ] [MAIN ] GYLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:38.412226] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GYLD took 0.5s. Estimated remaining: 6m 13s. Rate: 222.3 symbols/min [2025-09-28T02:50:38.589251] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:38.776761] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:38.806181] [DEBUG] [LOCAL ] GXO: Loaded 48260 existing records from primary storage. [2025-09-28T02:50:38.859792] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:38.860549] [INFO ] [MAIN ] GXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:38.861550] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GXO took 1.1s. Estimated remaining: 6m 13s. Rate: 222.1 symbols/min [2025-09-28T02:50:39.092062] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:39.118829] [DEBUG] [LOCAL ] HAE: Loaded 40176 existing records from primary storage. [2025-09-28T02:50:39.122825] [INFO ] [MAIN ] HAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:39.136213] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. HAE took 0.8s. Estimated remaining: 6m 13s. Rate: 222.1 symbols/min [2025-09-28T02:50:39.124483] [DEBUG] [LOCAL ] H: Loaded 45492 existing records from primary storage. [2025-09-28T02:50:39.160016] [DEBUG] [LOCAL ] HAFN: Loaded 44189 existing records from primary storage. [2025-09-28T02:50:39.160199] [INFO ] [MAIN ] H: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:39.206902] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. H took 1.0s. Estimated remaining: 6m 12s. Rate: 222.3 symbols/min [2025-09-28T02:50:39.197131] [INFO ] [MAIN ] HAFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:39.228398] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAFN took 0.7s. Estimated remaining: 6m 12s. Rate: 222.5 symbols/min [2025-09-28T02:50:39.543439] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:39.669011] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:39.693857] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-09-28T02:50:39.752169] [INFO ] [MAIN ] HAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:39.751788] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:39.752926] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAL took 0.9s. Estimated remaining: 6m 12s. Rate: 222.3 symbols/min [2025-09-28T02:50:39.876235] [DEBUG] [LOCAL ] HBB: Loaded 6912 existing records from primary storage. [2025-09-28T02:50:39.902275] [INFO ] [MAIN ] HBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:39.907388] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HBB took 0.7s. Estimated remaining: 6m 11s. Rate: 222.4 symbols/min [2025-09-28T02:50:40.009258] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:40.101512] [DEBUG] [LOCAL ] HASI: Loaded 47868 existing records from primary storage. [2025-09-28T02:50:40.136413] [DEBUG] [LOCAL ] HAYW: Loaded 49444 existing records from primary storage. [2025-09-28T02:50:40.136576] [INFO ] [MAIN ] HASI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:40.159600] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HASI took 1.0s. Estimated remaining: 6m 11s. Rate: 222.4 symbols/min [2025-09-28T02:50:40.159777] [INFO ] [MAIN ] HAYW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:40.197906] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HAYW took 1.0s. Estimated remaining: 6m 10s. Rate: 222.6 symbols/min [2025-09-28T02:50:40.278270] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:40.438922] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:40.456496] [DEBUG] [LOCAL ] HBI: Loaded 53769 existing records from primary storage. [2025-09-28T02:50:40.457141] [INFO ] [MAIN ] HBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:40.457764] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 0.7s. Estimated remaining: 6m 10s. Rate: 222.6 symbols/min [2025-09-28T02:50:40.513887] [DEBUG] [LOCAL ] HBM: Loaded 53683 existing records from primary storage. [2025-09-28T02:50:40.514434] [INFO ] [MAIN ] HBM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:40.514924] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HBM took 0.5s. Estimated remaining: 6m 10s. Rate: 222.8 symbols/min [2025-09-28T02:50:40.533197] [DEBUG] [LOCAL ] HCA: Loaded 47781 existing records from primary storage. [2025-09-28T02:50:40.533574] [INFO ] [MAIN ] HCA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:40.533718] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HCA took 0.4s. Estimated remaining: 6m 9s. Rate: 223.0 symbols/min [2025-09-28T02:50:41.193954] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:41.260802] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:41.271881] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:41.292467] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:41.293414] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-28T02:50:41.293469] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-28T02:50:41.293555] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-28T02:50:41.293698] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-28T02:50:41.293787] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-28T02:50:41.293869] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-28T02:50:41.417286] [DEBUG] [LOCAL ] HCI: Loaded 14126 existing records from primary storage. [2025-09-28T02:50:41.480449] [INFO ] [MAIN ] HCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:41.541916] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCI took 1.0s. Estimated remaining: 6m 10s. Rate: 222.4 symbols/min [2025-09-28T02:50:41.747171] [DEBUG] [LOCAL ] HD: Loaded 54283 existing records from primary storage. [2025-09-28T02:50:41.804330] [DEBUG] [LOCAL ] HCC: Loaded 46057 existing records from primary storage. [2025-09-28T02:50:41.883168] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:50:41.883292] [INFO ] [MAIN ] HCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:41.903054] [INFO ] [MAIN ] HD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:41.953137] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCC took 1.4s. Estimated remaining: 6m 10s. Rate: 222.2 symbols/min [2025-09-28T02:50:41.952519] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:41.925034] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-28T02:50:41.986701] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HD took 1.4s. Estimated remaining: 6m 9s. Rate: 222.4 symbols/min [2025-09-28T02:50:42.288972] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:42.339278] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-28T02:50:42.360509] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-28T02:50:42.358741] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:42.381692] [DEBUG] [LOCAL ] HDB: Loaded 52695 existing records from primary storage. [2025-09-28T02:50:42.382345] [INFO ] [MAIN ] HDB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:42.383100] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HDB took 0.8s. Estimated remaining: 6m 9s. Rate: 222.3 symbols/min [2025-09-28T02:50:42.595346] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:42.614224] [DEBUG] [LOCAL ] HEI: Loaded 32846 existing records from primary storage. [2025-09-28T02:50:42.618811] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-28T02:50:42.624325] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-28T02:50:42.622964] [INFO ] [MAIN ] HEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:42.637146] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HEI took 0.6s. Estimated remaining: 6m 9s. Rate: 222.4 symbols/min [2025-09-28T02:50:42.622708] [DEBUG] [LOCAL ] HEQ: Loaded 6236 existing records from primary storage. [2025-09-28T02:50:42.644936] [INFO ] [MAIN ] HEQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:42.670667] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEQ took 0.3s. Estimated remaining: 6m 8s. Rate: 222.5 symbols/min [2025-09-28T02:50:42.693331] [DEBUG] [LOCAL ] HE: Loaded 49870 existing records from primary storage. [2025-09-28T02:50:42.726830] [INFO ] [MAIN ] HE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:42.734231] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HE took 0.8s. Estimated remaining: 6m 7s. Rate: 222.7 symbols/min [2025-09-28T02:50:43.035562] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-28T02:50:43.079270] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-28T02:50:43.056825] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:43.174052] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:43.198098] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-28T02:50:43.230067] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:43.222899] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-28T02:50:43.230563] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-28T02:50:43.230715] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-28T02:50:43.230954] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-28T02:50:43.231046] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-28T02:50:43.231191] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-28T02:50:43.231451] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-28T02:50:43.232081] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-28T02:50:43.232159] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-28T02:50:43.232451] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-28T02:50:43.232383] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-28T02:50:43.476621] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-28T02:50:43.500338] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-28T02:50:43.703926] [DEBUG] [LOCAL ] HESM: Loaded 48879 existing records from primary storage. [2025-09-28T02:50:43.777157] [INFO ] [MAIN ] HESM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:43.798777] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-28T02:50:43.846338] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-28T02:50:43.877431] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HESM took 1.2s. Estimated remaining: 6m 8s. Rate: 222.0 symbols/min [2025-09-28T02:50:44.097271] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:50:44.127319] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-28T02:50:44.153988] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-28T02:50:44.160631] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:50:44.178221] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-28T02:50:44.222063] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-28T02:50:44.313412] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:44.335044] [DEBUG] [LOCAL ] HFRO: Loaded 17798 existing records from primary storage. [2025-09-28T02:50:44.335357] [INFO ] [MAIN ] HFRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:44.335478] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HFRO took 0.4s. Estimated remaining: 6m 8s. Rate: 221.8 symbols/min [2025-09-28T02:50:44.503349] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-28T02:50:44.536567] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:44.538285] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-28T02:50:44.540749] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-28T02:50:44.543277] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-28T02:50:44.562280] [DEBUG] [LOCAL ] HGER: Loaded 13428 existing records from primary storage. [2025-09-28T02:50:44.562634] [INFO ] [MAIN ] HGER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:44.562778] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HGER took 0.2s. Estimated remaining: 6m 8s. Rate: 221.9 symbols/min [2025-09-28T02:50:44.634325] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-28T02:50:44.658887] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-28T02:50:44.772736] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-28T02:50:44.772986] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-09-28T02:50:44.779121] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-28T02:50:44.777023] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:44.780209] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-28T02:50:44.798236] [DEBUG] [LOCAL ] HGLB: Loaded 9836 existing records from primary storage. [2025-09-28T02:50:44.798506] [INFO ] [MAIN ] HGLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:44.798609] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HGLB took 0.2s. Estimated remaining: 6m 8s. Rate: 221.9 symbols/min [2025-09-28T02:50:44.906253] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-28T02:50:44.910497] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-28T02:50:44.964075] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-09-28T02:50:44.976073] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-28T02:50:44.999719] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:45.019019] [DEBUG] [LOCAL ] HGTY: Loaded 13290 existing records from primary storage. [2025-09-28T02:50:45.019462] [INFO ] [MAIN ] HGTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:45.019758] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGTY took 0.2s. Estimated remaining: 6m 7s. Rate: 221.9 symbols/min [2025-09-28T02:50:45.021620] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-28T02:50:45.028046] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-28T02:50:45.186519] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-28T02:50:45.208593] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:45.209632] [INFO ] [REMOTE ] HCXY: Full fetch complete (592 records). [2025-09-28T02:50:45.209929] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-28T02:50:45.210763] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:50:45.210869] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:50:45.210943] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:50:45.211021] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-28T02:50:45.211122] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-28T02:50:45.211198] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-28T02:50:45.211302] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-28T02:50:45.211408] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HCXY took 4.7s. Estimated remaining: 6m 7s. Rate: 222.0 symbols/min [2025-09-28T02:50:45.289308] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-28T02:50:45.328421] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-28T02:50:45.421387] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:45.424933] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-28T02:50:45.426767] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-28T02:50:45.451284] [DEBUG] [LOCAL ] HGV: Loaded 47426 existing records from primary storage. [2025-09-28T02:50:45.451984] [INFO ] [MAIN ] HGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:45.452167] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGV took 0.4s. Estimated remaining: 6m 7s. Rate: 222.0 symbols/min [2025-09-28T02:50:45.547276] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-28T02:50:45.576972] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-28T02:50:45.674980] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-28T02:50:45.670031] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:45.676111] [DEBUG] [LOCAL ] HHH: Loaded 33042 existing records from primary storage. [2025-09-28T02:50:45.678505] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-28T02:50:45.679154] [INFO ] [MAIN ] HHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:45.680463] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HHH took 0.5s. Estimated remaining: 6m 6s. Rate: 222.1 symbols/min [2025-09-28T02:50:45.798245] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-28T02:50:45.800561] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-28T02:50:45.894178] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:45.906927] [DEBUG] [LOCAL ] HI: Loaded 35713 existing records from primary storage. [2025-09-28T02:50:45.907341] [INFO ] [MAIN ] HI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:45.907514] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HI took 0.5s. Estimated remaining: 6m 6s. Rate: 222.1 symbols/min [2025-09-28T02:50:46.029714] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-28T02:50:46.047366] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-28T02:50:46.128676] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:46.132920] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-28T02:50:46.134529] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-28T02:50:46.159111] [DEBUG] [LOCAL ] HIG: Loaded 51962 existing records from primary storage. [2025-09-28T02:50:46.159724] [INFO ] [MAIN ] HIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:46.160118] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HIG took 0.5s. Estimated remaining: 6m 6s. Rate: 222.1 symbols/min [2025-09-28T02:50:46.288425] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-28T02:50:46.335291] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-28T02:50:46.379438] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:46.380838] [DEBUG] [LOCAL ] HII: Loaded 35728 existing records from primary storage. [2025-09-28T02:50:46.386293] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-28T02:50:46.382204] [INFO ] [MAIN ] HII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:46.386952] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HII took 0.5s. Estimated remaining: 6m 5s. Rate: 222.2 symbols/min [2025-09-28T02:50:46.389015] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-28T02:50:46.594843] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:46.624798] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-09-28T02:50:46.625342] [INFO ] [MAIN ] HIMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:46.626144] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HIMS took 0.5s. Estimated remaining: 6m 5s. Rate: 222.2 symbols/min [2025-09-28T02:50:46.723370] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-28T02:50:46.725041] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-28T02:50:46.758838] [DEBUG] [LOCAL ] HIO: Loaded 24107 existing records from primary storage. [2025-09-28T02:50:46.800022] [INFO ] [MAIN ] HIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:46.814208] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIO took 0.4s. Estimated remaining: 6m 5s. Rate: 222.2 symbols/min [2025-09-28T02:50:46.847481] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:46.897194] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-28T02:50:46.915279] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-09-28T02:50:46.922538] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-28T02:50:46.924100] [INFO ] [REMOTE ] HF: Full fetch complete (505 records). [2025-09-28T02:50:46.955806] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-28T02:50:46.964521] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:50:46.969414] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:50:46.969514] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:50:46.986316] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-28T02:50:46.997044] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-28T02:50:47.093757] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-28T02:50:47.094803] [DEBUG] [LOCAL ] HIPO: Loaded 22774 existing records from primary storage. [2025-09-28T02:50:47.093559] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:47.095446] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-28T02:50:47.095950] [INFO ] [MAIN ] HIPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:47.096244] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIPO took 0.5s. Estimated remaining: 6m 4s. Rate: 222.2 symbols/min [2025-09-28T02:50:47.096579] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HF took 4.4s. Estimated remaining: 6m 4s. Rate: 222.5 symbols/min [2025-09-28T02:50:47.221786] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-28T02:50:47.248184] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-28T02:50:47.497103] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:47.536391] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:47.539714] [DEBUG] [LOCAL ] HIW: Loaded 45329 existing records from primary storage. [2025-09-28T02:50:47.540601] [INFO ] [MAIN ] HIW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:47.540786] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIW took 0.7s. Estimated remaining: 6m 4s. Rate: 222.3 symbols/min [2025-09-28T02:50:47.632464] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-28T02:50:47.683365] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-28T02:50:47.667514] [DEBUG] [LOCAL ] HIX: Loaded 20714 existing records from primary storage. [2025-09-28T02:50:47.712005] [INFO ] [MAIN ] HIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:47.748451] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIX took 0.7s. Estimated remaining: 6m 3s. Rate: 222.4 symbols/min [2025-09-28T02:50:47.768615] [DEBUG] [LOCAL ] HKD: Loaded 18654 existing records from primary storage. [2025-09-28T02:50:47.780690] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:47.791733] [INFO ] [MAIN ] HKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:47.792326] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HKD took 0.7s. Estimated remaining: 6m 3s. Rate: 222.5 symbols/min [2025-09-28T02:50:48.014674] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-28T02:50:48.069086] [INFO ] [REMOTE ] HFND: Full fetch complete (1798 records). [2025-09-28T02:50:48.175107] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:48.155042] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:48.197469] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-28T02:50:48.368306] [DEBUG] [LOCAL ] HL: Loaded 54451 existing records from primary storage. [2025-09-28T02:50:48.400043] [INFO ] [MAIN ] HL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:48.410354] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HL took 0.9s. Estimated remaining: 6m 3s. Rate: 222.3 symbols/min [2025-09-28T02:50:48.467909] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-28T02:50:48.490543] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:50:48.515872] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:50:48.548023] [DEBUG] [LOCAL ] HLI: Loaded 31573 existing records from primary storage. [2025-09-28T02:50:48.564245] [INFO ] [MAIN ] HLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:48.553747] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-28T02:50:48.598069] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-28T02:50:48.603053] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-28T02:50:48.604386] [DEBUG] [LOCAL ] HLF: Loaded 49357 existing records from primary storage. [2025-09-28T02:50:48.602881] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLI took 0.8s. Estimated remaining: 6m 3s. Rate: 222.3 symbols/min [2025-09-28T02:50:48.610396] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-28T02:50:48.647407] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HFND took 5.9s. Estimated remaining: 6m 2s. Rate: 222.5 symbols/min [2025-09-28T02:50:48.641911] [INFO ] [MAIN ] HLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:48.700891] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLF took 0.9s. Estimated remaining: 6m 2s. Rate: 222.7 symbols/min [2025-09-28T02:50:48.915605] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:49.139161] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:49.215946] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:49.302728] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:49.315449] [DEBUG] [LOCAL ] HLIO: Loaded 28490 existing records from primary storage. [2025-09-28T02:50:49.316489] [INFO ] [MAIN ] HLIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:49.316738] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLIO took 0.9s. Estimated remaining: 6m 2s. Rate: 222.4 symbols/min [2025-09-28T02:50:49.447535] [DEBUG] [LOCAL ] HLLY: Loaded 33911 existing records from primary storage. [2025-09-28T02:50:49.492533] [INFO ] [MAIN ] HLLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:49.507177] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLLY took 0.9s. Estimated remaining: 6m 1s. Rate: 222.5 symbols/min [2025-09-28T02:50:49.697026] [DEBUG] [LOCAL ] HLN: Loaded 53861 existing records from primary storage. [2025-09-28T02:50:49.746546] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:49.763000] [INFO ] [MAIN ] HLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:49.816316] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLN took 1.2s. Estimated remaining: 6m 1s. Rate: 222.4 symbols/min [2025-09-28T02:50:49.836832] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:49.851108] [DEBUG] [LOCAL ] HLT: Loaded 51450 existing records from primary storage. [2025-09-28T02:50:49.863426] [INFO ] [MAIN ] HLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:49.879130] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLT took 1.2s. Estimated remaining: 6m 1s. Rate: 222.6 symbols/min [2025-09-28T02:50:50.261313] [DEBUG] [LOCAL ] HLX: Loaded 48650 existing records from primary storage. [2025-09-28T02:50:50.243559] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:50.290534] [INFO ] [MAIN ] HLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:50.290824] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLX took 1.0s. Estimated remaining: 6m 1s. Rate: 222.5 symbols/min [2025-09-28T02:50:50.291898] [DEBUG] [LOCAL ] HMC: Loaded 47500 existing records from primary storage. [2025-09-28T02:50:50.289793] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:50.304564] [INFO ] [MAIN ] HMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:50.316345] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMC took 0.8s. Estimated remaining: 5m 60s. Rate: 222.7 symbols/min [2025-09-28T02:50:50.528629] [DEBUG] [LOCAL ] HMN: Loaded 23671 existing records from primary storage. [2025-09-28T02:50:50.584381] [INFO ] [MAIN ] HMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:50.613678] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:50.642317] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMN took 0.8s. Estimated remaining: 5m 60s. Rate: 222.6 symbols/min [2025-09-28T02:50:50.697192] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-28T02:50:50.746888] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:50.775638] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-28T02:50:50.833724] [DEBUG] [LOCAL ] HMY: Loaded 53914 existing records from primary storage. [2025-09-28T02:50:50.820995] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-28T02:50:50.849992] [INFO ] [MAIN ] HMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:50.864194] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-28T02:50:50.869411] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HMY took 1.0s. Estimated remaining: 5m 59s. Rate: 222.7 symbols/min [2025-09-28T02:50:50.911364] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-28T02:50:50.943554] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-28T02:50:50.956077] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:51.071094] [DEBUG] [LOCAL ] HNI: Loaded 29386 existing records from primary storage. [2025-09-28T02:50:51.091840] [INFO ] [MAIN ] HNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:51.097763] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HNI took 0.7s. Estimated remaining: 5m 59s. Rate: 222.7 symbols/min [2025-09-28T02:50:51.412815] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:50:51.414331] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-28T02:50:51.417673] [DEBUG] [LOCAL ] HOG: Loaded 51958 existing records from primary storage. [2025-09-28T02:50:51.418083] [INFO ] [MAIN ] HOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:51.418610] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HOG took 0.7s. Estimated remaining: 5m 59s. Rate: 222.7 symbols/min [2025-09-28T02:50:51.556463] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:50:51.556833] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-28T02:50:51.556932] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:50:51.556987] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-09-28T02:50:51.557053] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:50:51.557130] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-28T02:50:51.557236] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-28T02:50:51.557313] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-28T02:50:51.557410] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-28T02:50:51.557502] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HNGE took 1.3s. Estimated remaining: 5m 58s. Rate: 222.8 symbols/min [2025-09-28T02:50:52.225846] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:52.295577] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:52.302155] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:52.322404] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:52.350948] [DEBUG] [LOCAL ] HOV: Loaded 13975 existing records from primary storage. [2025-09-28T02:50:52.351355] [INFO ] [MAIN ] HOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:52.361694] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 0.8s. Estimated remaining: 5m 59s. Rate: 222.3 symbols/min [2025-09-28T02:50:52.558497] [DEBUG] [LOCAL ] HOMB: Loaded 44272 existing records from primary storage. [2025-09-28T02:50:52.603772] [INFO ] [MAIN ] HOMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:52.595626] [DEBUG] [LOCAL ] HOUS: Loaded 44903 existing records from primary storage. [2025-09-28T02:50:52.627704] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOMB took 1.1s. Estimated remaining: 5m 59s. Rate: 222.3 symbols/min [2025-09-28T02:50:52.627077] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:52.628385] [INFO ] [MAIN ] HOUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:52.667107] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HOUS took 1.1s. Estimated remaining: 5m 58s. Rate: 222.5 symbols/min [2025-09-28T02:50:52.735027] [DEBUG] [LOCAL ] HP: Loaded 52313 existing records from primary storage. [2025-09-28T02:50:52.809944] [INFO ] [MAIN ] HP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:52.850719] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HP took 1.3s. Estimated remaining: 5m 58s. Rate: 222.6 symbols/min [2025-09-28T02:50:53.101948] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:53.171284] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:53.244583] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-09-28T02:50:53.286474] [DEBUG] [LOCAL ] HPF: Loaded 7388 existing records from primary storage. [2025-09-28T02:50:53.286741] [INFO ] [MAIN ] HPE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:53.297451] [INFO ] [MAIN ] HPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:53.318920] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:53.319888] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPE took 1.0s. Estimated remaining: 5m 58s. Rate: 222.4 symbols/min [2025-09-28T02:50:53.328859] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPF took 0.7s. Estimated remaining: 5m 57s. Rate: 222.6 symbols/min [2025-09-28T02:50:53.388699] [DEBUG] [LOCAL ] HPI: Loaded 10339 existing records from primary storage. [2025-09-28T02:50:53.450705] [INFO ] [MAIN ] HPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:53.503160] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPI took 0.8s. Estimated remaining: 5m 57s. Rate: 222.7 symbols/min [2025-09-28T02:50:53.763844] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:53.887762] [DEBUG] [LOCAL ] HPP: Loaded 51595 existing records from primary storage. [2025-09-28T02:50:53.880859] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:53.929440] [INFO ] [MAIN ] HPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:53.954274] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:53.954817] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPP took 1.1s. Estimated remaining: 5m 57s. Rate: 222.6 symbols/min [2025-09-28T02:50:54.052753] [DEBUG] [LOCAL ] HPS: Loaded 10277 existing records from primary storage. [2025-09-28T02:50:54.129225] [INFO ] [MAIN ] HPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:54.129487] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPS took 0.8s. Estimated remaining: 5m 56s. Rate: 222.6 symbols/min [2025-09-28T02:50:54.219288] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:54.320770] [DEBUG] [LOCAL ] HQH: Loaded 25387 existing records from primary storage. [2025-09-28T02:50:54.313313] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-09-28T02:50:54.331723] [INFO ] [MAIN ] HQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:54.348788] [INFO ] [MAIN ] HPQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:54.359305] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HQH took 0.8s. Estimated remaining: 5m 56s. Rate: 222.7 symbols/min [2025-09-28T02:50:54.440421] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:54.468323] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HPQ took 1.1s. Estimated remaining: 5m 55s. Rate: 222.8 symbols/min [2025-09-28T02:50:54.474746] [DEBUG] [LOCAL ] HQL: Loaded 16206 existing records from primary storage. [2025-09-28T02:50:54.528433] [INFO ] [MAIN ] HQL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:54.608530] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQL took 0.7s. Estimated remaining: 5m 55s. Rate: 222.9 symbols/min [2025-09-28T02:50:54.805725] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:54.958145] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:55.087731] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:55.111069] [DEBUG] [LOCAL ] HR: Loaded 52716 existing records from primary storage. [2025-09-28T02:50:55.112110] [INFO ] [MAIN ] HR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:55.112583] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HR took 1.0s. Estimated remaining: 5m 55s. Rate: 222.7 symbols/min [2025-09-28T02:50:55.268061] [DEBUG] [LOCAL ] HRI: Loaded 33507 existing records from primary storage. [2025-09-28T02:50:55.361193] [DEBUG] [LOCAL ] HRB: Loaded 49275 existing records from primary storage. [2025-09-28T02:50:55.334591] [INFO ] [MAIN ] HRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:55.391198] [INFO ] [MAIN ] HRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:55.393875] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:55.394702] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRI took 0.9s. Estimated remaining: 5m 55s. Rate: 222.7 symbols/min [2025-09-28T02:50:55.467597] [DEBUG] [LOCAL ] HRL: Loaded 53855 existing records from primary storage. [2025-09-28T02:50:55.460936] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRB took 1.0s. Estimated remaining: 5m 54s. Rate: 222.9 symbols/min [2025-09-28T02:50:55.508346] [INFO ] [MAIN ] HRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:55.566044] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRL took 0.9s. Estimated remaining: 5m 54s. Rate: 223.0 symbols/min [2025-09-28T02:50:55.850157] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:55.907735] [DEBUG] [LOCAL ] HRTG: Loaded 33658 existing records from primary storage. [2025-09-28T02:50:55.955416] [INFO ] [MAIN ] HRTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:55.949799] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:55.975490] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRTG took 0.9s. Estimated remaining: 5m 54s. Rate: 222.9 symbols/min [2025-09-28T02:50:56.141848] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:56.176299] [DEBUG] [LOCAL ] HSHP: Loaded 15773 existing records from primary storage. [2025-09-28T02:50:56.213870] [INFO ] [MAIN ] HSHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:56.249687] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSHP took 0.8s. Estimated remaining: 5m 53s. Rate: 222.9 symbols/min [2025-09-28T02:50:56.320984] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:56.364165] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-28T02:50:56.402271] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-28T02:50:56.445382] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-28T02:50:56.472692] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-28T02:50:56.479720] [DEBUG] [LOCAL ] HSBC: Loaded 51868 existing records from primary storage. [2025-09-28T02:50:56.532534] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-28T02:50:56.533623] [INFO ] [MAIN ] HSBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:56.531189] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:56.533934] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-28T02:50:56.534534] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSBC took 1.1s. Estimated remaining: 5m 53s. Rate: 222.9 symbols/min [2025-09-28T02:50:56.650459] [DEBUG] [LOCAL ] HSY: Loaded 51161 existing records from primary storage. [2025-09-28T02:50:56.696843] [INFO ] [MAIN ] HSY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:56.759791] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSY took 1.1s. Estimated remaining: 5m 53s. Rate: 222.9 symbols/min [2025-09-28T02:50:56.833231] [DEBUG] [LOCAL ] HTD: Loaded 13754 existing records from primary storage. [2025-09-28T02:50:56.926462] [INFO ] [MAIN ] HTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:56.992337] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTD took 0.7s. Estimated remaining: 5m 53s. Rate: 222.9 symbols/min [2025-09-28T02:50:57.176490] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:57.290108] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-28T02:50:57.397240] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-28T02:50:57.480970] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-28T02:50:57.493788] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-28T02:50:57.484220] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:50:57.519903] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-28T02:50:57.562436] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-28T02:50:57.567887] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:57.488372] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:57.570157] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-28T02:50:57.756345] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:50:57.807280] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-28T02:50:57.837752] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:50:57.896316] [DEBUG] [LOCAL ] HTH: Loaded 32696 existing records from primary storage. [2025-09-28T02:50:57.896398] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-09-28T02:50:57.933870] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:50:57.934128] [INFO ] [MAIN ] HTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:57.945736] [DEBUG] [LOCAL ] HTGC: Loaded 48222 existing records from primary storage. [2025-09-28T02:50:57.956885] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-28T02:50:57.951241] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTH took 0.8s. Estimated remaining: 5m 53s. Rate: 222.4 symbols/min [2025-09-28T02:50:57.957527] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-28T02:50:57.957192] [INFO ] [MAIN ] HTGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:57.968274] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTGC took 1.1s. Estimated remaining: 5m 53s. Rate: 222.6 symbols/min [2025-09-28T02:50:57.963012] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-28T02:50:58.007055] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-28T02:50:58.072138] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTB took 2.1s. Estimated remaining: 5m 52s. Rate: 222.7 symbols/min [2025-09-28T02:50:58.354217] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:50:58.415383] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-28T02:50:58.574718] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:58.599432] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:58.698069] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:58.762552] [DEBUG] [LOCAL ] HUBB: Loaded 37650 existing records from primary storage. [2025-09-28T02:50:58.761718] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-28T02:50:58.763929] [DEBUG] [LOCAL ] HUBS: Loaded 39953 existing records from primary storage. [2025-09-28T02:50:58.765597] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-28T02:50:58.766247] [INFO ] [MAIN ] HUBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:58.767899] [INFO ] [MAIN ] HUBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:58.767525] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBS took 0.8s. Estimated remaining: 5m 52s. Rate: 222.4 symbols/min [2025-09-28T02:50:58.785626] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUBB took 0.8s. Estimated remaining: 5m 52s. Rate: 222.6 symbols/min [2025-09-28T02:50:59.039695] [DEBUG] [LOCAL ] HUM: Loaded 49568 existing records from primary storage. [2025-09-28T02:50:59.063207] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-28T02:50:59.074105] [INFO ] [MAIN ] HUM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:59.129589] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:59.141977] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-28T02:50:59.161830] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUM took 1.0s. Estimated remaining: 5m 52s. Rate: 222.5 symbols/min [2025-09-28T02:50:59.230805] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:59.437894] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:50:59.457747] [DEBUG] [LOCAL ] HUYA: Loaded 44956 existing records from primary storage. [2025-09-28T02:50:59.458508] [INFO ] [MAIN ] HUYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:59.459213] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUYA took 0.7s. Estimated remaining: 5m 51s. Rate: 222.5 symbols/min [2025-09-28T02:50:59.513841] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-28T02:50:59.537614] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-28T02:50:59.595148] [DEBUG] [LOCAL ] HVT: Loaded 16133 existing records from primary storage. [2025-09-28T02:50:59.635247] [INFO ] [MAIN ] HVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:59.636124] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HVT took 0.4s. Estimated remaining: 5m 51s. Rate: 222.6 symbols/min [2025-09-28T02:50:59.671019] [DEBUG] [LOCAL ] HUN: Loaded 53976 existing records from primary storage. [2025-09-28T02:50:59.708086] [INFO ] [MAIN ] HUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:50:59.807332] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HUN took 1.0s. Estimated remaining: 5m 51s. Rate: 222.6 symbols/min [2025-09-28T02:50:59.814683] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:00.019461] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-28T02:51:00.035313] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-28T02:51:00.055448] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:00.154173] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:00.199740] [DEBUG] [LOCAL ] HY: Loaded 10192 existing records from primary storage. [2025-09-28T02:51:00.201701] [DEBUG] [LOCAL ] HWM: Loaded 53767 existing records from primary storage. [2025-09-28T02:51:00.202229] [INFO ] [MAIN ] HY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:00.202684] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HY took 0.4s. Estimated remaining: 5m 51s. Rate: 222.5 symbols/min [2025-09-28T02:51:00.202861] [INFO ] [MAIN ] HWM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:00.209028] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HWM took 0.7s. Estimated remaining: 5m 50s. Rate: 222.7 symbols/min [2025-09-28T02:51:00.415805] [DEBUG] [LOCAL ] HXL: Loaded 46661 existing records from primary storage. [2025-09-28T02:51:00.450867] [INFO ] [MAIN ] HXL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:00.450567] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-28T02:51:00.467948] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HXL took 0.8s. Estimated remaining: 5m 50s. Rate: 222.7 symbols/min [2025-09-28T02:51:00.500561] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-28T02:51:00.653083] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:00.703598] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-28T02:51:00.653986] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:00.724033] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-28T02:51:00.723886] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-28T02:51:00.724384] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-28T02:51:00.724187] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-28T02:51:00.724624] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-28T02:51:00.725122] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-28T02:51:00.725268] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-28T02:51:00.730688] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-28T02:51:00.730829] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-28T02:51:00.752148] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-28T02:51:00.860103] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:00.802592] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-28T02:51:01.091363] [DEBUG] [LOCAL ] HYI: Loaded 9254 existing records from primary storage. [2025-09-28T02:51:01.186964] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-28T02:51:01.186706] [INFO ] [MAIN ] HYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:01.252039] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-28T02:51:01.292904] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HYI took 0.8s. Estimated remaining: 5m 50s. Rate: 222.3 symbols/min [2025-09-28T02:51:01.654367] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-28T02:51:01.698589] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-28T02:51:01.721177] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:01.756512] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:01.783625] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-28T02:51:01.756921] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-28T02:51:01.872589] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:01.917561] [DEBUG] [LOCAL ] HYT: Loaded 33853 existing records from primary storage. [2025-09-28T02:51:01.917960] [INFO ] [MAIN ] HYT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:01.918066] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYT took 0.5s. Estimated remaining: 5m 50s. Rate: 222.1 symbols/min [2025-09-28T02:51:02.044037] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-28T02:51:02.047966] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-28T02:51:02.130290] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:02.132725] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-28T02:51:02.133885] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-28T02:51:02.140322] [DEBUG] [LOCAL ] HYTR: Loaded 3208 existing records from primary storage. [2025-09-28T02:51:02.140564] [INFO ] [MAIN ] HYTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:02.141016] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYTR took 0.2s. Estimated remaining: 5m 50s. Rate: 222.1 symbols/min [2025-09-28T02:51:02.225680] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-28T02:51:02.253559] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-28T02:51:02.333315] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-28T02:51:02.337789] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:02.339244] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-28T02:51:02.375496] [DEBUG] [LOCAL ] HZO: Loaded 29733 existing records from primary storage. [2025-09-28T02:51:02.378434] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-28T02:51:02.380078] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-28T02:51:02.378926] [INFO ] [MAIN ] HZO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:02.381162] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HZO took 0.2s. Estimated remaining: 5m 50s. Rate: 222.1 symbols/min [2025-09-28T02:51:02.442292] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.19 seconds). [2025-09-28T02:51:02.443342] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-28T02:51:02.496770] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.16 seconds). [2025-09-28T02:51:02.497579] [INFO ] [REMOTE ] HTFC: Full fetch complete (837 records). [2025-09-28T02:51:02.497701] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-28T02:51:02.608314] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.16 seconds). [2025-09-28T02:51:02.643013] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-28T02:51:02.666453] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-28T02:51:02.706343] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-28T02:51:02.707443] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-28T02:51:02.708437] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:51:02.709144] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:51:02.709355] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-28T02:51:02.709465] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-28T02:51:02.709544] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-28T02:51:02.709674] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-28T02:51:02.709801] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HTFC took 6.1s. Estimated remaining: 5m 49s. Rate: 222.1 symbols/min [2025-09-28T02:51:02.925826] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-28T02:51:02.928900] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-28T02:51:02.929027] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-28T02:51:02.931141] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-28T02:51:03.148796] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-28T02:51:03.149857] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-28T02:51:03.161952] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-28T02:51:03.163305] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-28T02:51:03.382059] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-28T02:51:03.383100] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-28T02:51:03.397558] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-28T02:51:03.398556] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-28T02:51:03.619481] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-28T02:51:03.620610] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-28T02:51:03.636832] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-28T02:51:03.637906] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-28T02:51:03.861329] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-28T02:51:03.862417] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-28T02:51:03.932416] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-28T02:51:03.933724] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-28T02:51:04.080477] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-28T02:51:04.081529] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-28T02:51:04.085784] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.15 seconds). [2025-09-28T02:51:04.086693] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-28T02:51:04.248480] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.17 seconds). [2025-09-28T02:51:04.250978] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.16 seconds). [2025-09-28T02:51:04.251809] [INFO ] [REMOTE ] HYBX: Full fetch complete (799 records). [2025-09-28T02:51:04.252854] [INFO ] [REMOTE ] HYAC: Full fetch complete (866 records). [2025-09-28T02:51:04.252971] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-28T02:51:04.258730] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-28T02:51:04.320780] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:51:04.332701] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:51:04.349520] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:51:04.360970] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-28T02:51:04.361200] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-28T02:51:04.366999] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-28T02:51:04.377427] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-28T02:51:04.382803] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYAC took 4.2s. Estimated remaining: 5m 51s. Rate: 221.0 symbols/min [2025-09-28T02:51:04.443494] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-28T02:51:04.443708] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:51:04.443783] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:51:04.443859] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-28T02:51:04.443957] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-28T02:51:04.444030] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-28T02:51:04.444135] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-28T02:51:04.444233] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HYBX took 4.2s. Estimated remaining: 5m 50s. Rate: 221.2 symbols/min [2025-09-28T02:51:05.075374] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:05.236974] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:05.265382] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:05.287976] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:05.310635] [DEBUG] [LOCAL ] IAE: Loaded 6104 existing records from primary storage. [2025-09-28T02:51:05.326035] [INFO ] [MAIN ] IAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:05.326186] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 0.9s. Estimated remaining: 5m 51s. Rate: 220.7 symbols/min [2025-09-28T02:51:05.474932] [DEBUG] [LOCAL ] IBN: Loaded 53654 existing records from primary storage. [2025-09-28T02:51:05.475535] [INFO ] [MAIN ] IBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:05.476183] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBN took 1.0s. Estimated remaining: 5m 50s. Rate: 220.8 symbols/min [2025-09-28T02:51:05.625529] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:05.708115] [DEBUG] [LOCAL ] IBM: Loaded 54416 existing records from primary storage. [2025-09-28T02:51:05.730681] [DEBUG] [LOCAL ] IAG: Loaded 54225 existing records from primary storage. [2025-09-28T02:51:05.735533] [INFO ] [MAIN ] IBM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:05.742269] [INFO ] [MAIN ] IAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:05.763804] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBM took 1.3s. Estimated remaining: 5m 50s. Rate: 220.8 symbols/min [2025-09-28T02:51:05.833879] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:05.833990] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IAG took 1.3s. Estimated remaining: 5m 50s. Rate: 220.9 symbols/min [2025-09-28T02:51:06.070920] [DEBUG] [LOCAL ] IBP: Loaded 29584 existing records from primary storage. [2025-09-28T02:51:06.167986] [INFO ] [MAIN ] IBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:06.201624] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBP took 0.9s. Estimated remaining: 5m 49s. Rate: 220.9 symbols/min [2025-09-28T02:51:06.251750] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:06.304706] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:06.357536] [DEBUG] [LOCAL ] IBTA: Loaded 38445 existing records from primary storage. [2025-09-28T02:51:06.385485] [INFO ] [MAIN ] IBTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:06.400989] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. IBTA took 0.9s. Estimated remaining: 5m 49s. Rate: 220.9 symbols/min [2025-09-28T02:51:06.580064] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:06.737634] [DEBUG] [LOCAL ] ICL: Loaded 39135 existing records from primary storage. [2025-09-28T02:51:06.736198] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:06.754022] [INFO ] [MAIN ] ICL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:06.754173] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. ICL took 0.9s. Estimated remaining: 5m 49s. Rate: 220.9 symbols/min [2025-09-28T02:51:06.760366] [DEBUG] [LOCAL ] ICE: Loaded 53800 existing records from primary storage. [2025-09-28T02:51:06.791835] [INFO ] [MAIN ] ICE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:06.825410] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICE took 1.0s. Estimated remaining: 5m 48s. Rate: 221.0 symbols/min [2025-09-28T02:51:06.964958] [DEBUG] [LOCAL ] IDE: Loaded 8755 existing records from primary storage. [2025-09-28T02:51:07.002688] [INFO ] [MAIN ] IDE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:06.966311] [DEBUG] [LOCAL ] IDA: Loaded 32398 existing records from primary storage. [2025-09-28T02:51:07.087443] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDE took 0.7s. Estimated remaining: 5m 48s. Rate: 221.0 symbols/min [2025-09-28T02:51:07.102185] [INFO ] [MAIN ] IDA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:07.150969] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDA took 0.9s. Estimated remaining: 5m 48s. Rate: 221.2 symbols/min [2025-09-28T02:51:07.124962] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:07.236433] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:07.458905] [DEBUG] [LOCAL ] IDT: Loaded 17885 existing records from primary storage. [2025-09-28T02:51:07.582791] [INFO ] [MAIN ] IDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:07.577896] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:07.589561] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDT took 0.8s. Estimated remaining: 5m 47s. Rate: 221.0 symbols/min [2025-09-28T02:51:07.612891] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:07.728470] [DEBUG] [LOCAL ] IEX: Loaded 38978 existing records from primary storage. [2025-09-28T02:51:07.755678] [INFO ] [MAIN ] IEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:07.756392] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IEX took 0.9s. Estimated remaining: 5m 47s. Rate: 221.1 symbols/min [2025-09-28T02:51:07.756949] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-09-28T02:51:07.773412] [INFO ] [MAIN ] IFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:07.841815] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 0.7s. Estimated remaining: 5m 47s. Rate: 221.3 symbols/min [2025-09-28T02:51:07.906633] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:08.185816] [DEBUG] [LOCAL ] IFS: Loaded 23359 existing records from primary storage. [2025-09-28T02:51:08.213754] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:08.260188] [INFO ] [MAIN ] IFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:08.286972] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:08.289761] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFS took 0.7s. Estimated remaining: 5m 47s. Rate: 221.1 symbols/min [2025-09-28T02:51:08.298015] [DEBUG] [LOCAL ] IFF: Loaded 51727 existing records from primary storage. [2025-09-28T02:51:08.315777] [INFO ] [MAIN ] IFF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:08.345144] [DEBUG] [LOCAL ] IGA: Loaded 9779 existing records from primary storage. [2025-09-28T02:51:08.334231] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFF took 1.2s. Estimated remaining: 5m 46s. Rate: 221.3 symbols/min [2025-09-28T02:51:08.365918] [INFO ] [MAIN ] IGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:08.378238] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGA took 0.6s. Estimated remaining: 5m 45s. Rate: 221.5 symbols/min [2025-09-28T02:51:08.523919] [DEBUG] [LOCAL ] IGD: Loaded 19170 existing records from primary storage. [2025-09-28T02:51:08.578879] [INFO ] [MAIN ] IGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:08.596893] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGD took 0.7s. Estimated remaining: 5m 45s. Rate: 221.5 symbols/min [2025-09-28T02:51:08.793134] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:09.033342] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:09.038039] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:09.056741] [DEBUG] [LOCAL ] IGI: Loaded 3756 existing records from primary storage. [2025-09-28T02:51:09.084675] [INFO ] [MAIN ] IGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:09.090998] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGI took 0.8s. Estimated remaining: 5m 45s. Rate: 221.3 symbols/min [2025-09-28T02:51:09.190951] [DEBUG] [LOCAL ] IH: Loaded 3450 existing records from primary storage. [2025-09-28T02:51:09.251462] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:09.257401] [INFO ] [MAIN ] IH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:09.291950] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IH took 0.9s. Estimated remaining: 5m 45s. Rate: 221.4 symbols/min [2025-09-28T02:51:09.462257] [DEBUG] [LOCAL ] IHD: Loaded 7225 existing records from primary storage. [2025-09-28T02:51:09.463408] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:09.493689] [INFO ] [MAIN ] IHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:09.494045] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IHD took 0.8s. Estimated remaining: 5m 44s. Rate: 221.4 symbols/min [2025-09-28T02:51:09.500936] [DEBUG] [LOCAL ] IGR: Loaded 30882 existing records from primary storage. [2025-09-28T02:51:09.521107] [INFO ] [MAIN ] IGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:09.544513] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IGR took 1.2s. Estimated remaining: 5m 44s. Rate: 221.6 symbols/min [2025-09-28T02:51:09.753972] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:09.865886] [DEBUG] [LOCAL ] IHG: Loaded 24977 existing records from primary storage. [2025-09-28T02:51:09.919724] [INFO ] [MAIN ] IHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:10.001765] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHG took 0.9s. Estimated remaining: 5m 44s. Rate: 221.5 symbols/min [2025-09-28T02:51:10.027818] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:10.051111] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:10.163615] [DEBUG] [LOCAL ] IIF: Loaded 5787 existing records from primary storage. [2025-09-28T02:51:10.198459] [DEBUG] [LOCAL ] IIIN: Loaded 16828 existing records from primary storage. [2025-09-28T02:51:10.185518] [INFO ] [MAIN ] IIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:10.187301] [DEBUG] [LOCAL ] IHS: Loaded 39400 existing records from primary storage. [2025-09-28T02:51:10.199518] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IIF took 0.7s. Estimated remaining: 5m 43s. Rate: 221.5 symbols/min [2025-09-28T02:51:10.205232] [INFO ] [MAIN ] IIIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:10.205387] [INFO ] [MAIN ] IHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:10.281393] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHS took 1.0s. Estimated remaining: 5m 43s. Rate: 221.7 symbols/min [2025-09-28T02:51:10.326962] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:10.337513] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIIN took 0.7s. Estimated remaining: 5m 42s. Rate: 221.8 symbols/min [2025-09-28T02:51:10.708509] [DEBUG] [LOCAL ] IIM: Loaded 16102 existing records from primary storage. [2025-09-28T02:51:10.741028] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:10.763163] [INFO ] [MAIN ] IIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:10.856713] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIM took 0.8s. Estimated remaining: 5m 42s. Rate: 221.6 symbols/min [2025-09-28T02:51:10.886154] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:10.932494] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:11.130871] [DEBUG] [LOCAL ] IIPR: Loaded 30052 existing records from primary storage. [2025-09-28T02:51:11.132197] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:11.133093] [INFO ] [MAIN ] IIPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:11.145006] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIPR took 0.9s. Estimated remaining: 5m 42s. Rate: 221.6 symbols/min [2025-09-28T02:51:11.313762] [DEBUG] [LOCAL ] IMAX: Loaded 43382 existing records from primary storage. [2025-09-28T02:51:11.337936] [INFO ] [MAIN ] IMAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:11.339920] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IMAX took 1.0s. Estimated remaining: 5m 42s. Rate: 221.7 symbols/min [2025-09-28T02:51:11.339705] [DEBUG] [LOCAL ] INFA: Loaded 50602 existing records from primary storage. [2025-09-28T02:51:11.388129] [INFO ] [MAIN ] INFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:11.450863] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFA took 1.1s. Estimated remaining: 5m 41s. Rate: 221.8 symbols/min [2025-09-28T02:51:11.495233] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:11.636036] [DEBUG] [LOCAL ] INFY: Loaded 54378 existing records from primary storage. [2025-09-28T02:51:11.659749] [INFO ] [MAIN ] INFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:11.660383] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFY took 0.8s. Estimated remaining: 5m 41s. Rate: 221.8 symbols/min [2025-09-28T02:51:11.926020] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:12.007182] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:12.104732] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:12.106728] [DEBUG] [LOCAL ] ING: Loaded 51537 existing records from primary storage. [2025-09-28T02:51:12.107738] [INFO ] [MAIN ] ING: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:12.108727] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. ING took 1.0s. Estimated remaining: 5m 41s. Rate: 221.7 symbols/min [2025-09-28T02:51:12.310796] [DEBUG] [LOCAL ] INGM: Loaded 29224 existing records from primary storage. [2025-09-28T02:51:12.311533] [INFO ] [MAIN ] INGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:12.311892] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INGM took 1.0s. Estimated remaining: 5m 41s. Rate: 221.8 symbols/min [2025-09-28T02:51:12.451418] [DEBUG] [LOCAL ] INGR: Loaded 33913 existing records from primary storage. [2025-09-28T02:51:12.490768] [DEBUG] [LOCAL ] INN: Loaded 42433 existing records from primary storage. [2025-09-28T02:51:12.501779] [INFO ] [MAIN ] INGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:12.512962] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INGR took 1.0s. Estimated remaining: 5m 40s. Rate: 221.8 symbols/min [2025-09-28T02:51:12.484360] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:12.507614] [INFO ] [MAIN ] INN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:12.535609] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-28T02:51:12.547633] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INN took 0.8s. Estimated remaining: 5m 40s. Rate: 222.0 symbols/min [2025-09-28T02:51:12.547869] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-28T02:51:12.581622] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-28T02:51:12.624755] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-28T02:51:12.710190] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-28T02:51:12.805018] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:12.820258] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-28T02:51:13.152782] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:13.180802] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:13.363461] [DEBUG] [LOCAL ] INSP: Loaded 37492 existing records from primary storage. [2025-09-28T02:51:13.391340] [INFO ] [MAIN ] INSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:13.420005] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSP took 1.1s. Estimated remaining: 5m 40s. Rate: 221.5 symbols/min [2025-09-28T02:51:13.612192] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:13.639484] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-28T02:51:13.619099] [DEBUG] [LOCAL ] INSW: Loaded 40831 existing records from primary storage. [2025-09-28T02:51:13.673801] [INFO ] [MAIN ] INSW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:13.680244] [DEBUG] [LOCAL ] INVH: Loaded 53918 existing records from primary storage. [2025-09-28T02:51:13.695705] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSW took 1.2s. Estimated remaining: 5m 40s. Rate: 221.5 symbols/min [2025-09-28T02:51:13.754577] [INFO ] [MAIN ] INVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:13.772475] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:13.783731] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INVH took 1.2s. Estimated remaining: 5m 39s. Rate: 221.7 symbols/min [2025-09-28T02:51:13.868071] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:51:13.872631] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-28T02:51:13.907946] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:51:13.908197] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-09-28T02:51:13.926976] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:51:13.927146] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-28T02:51:13.967015] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:13.977370] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-28T02:51:13.978384] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-28T02:51:13.979015] [DEBUG] [LOCAL ] INVX: Loaded 29366 existing records from primary storage. [2025-09-28T02:51:13.979420] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-28T02:51:13.979559] [INFO ] [MAIN ] INVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:13.979873] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INR took 1.9s. Estimated remaining: 5m 39s. Rate: 221.7 symbols/min [2025-09-28T02:51:13.980150] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INVX took 0.5s. Estimated remaining: 5m 38s. Rate: 221.9 symbols/min [2025-09-28T02:51:14.043971] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-09-28T02:51:14.044403] [INFO ] [MAIN ] IONQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:14.044917] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 0.3s. Estimated remaining: 5m 38s. Rate: 222.1 symbols/min [2025-09-28T02:51:14.789157] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:14.823975] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:14.833128] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:14.835465] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:14.873075] [DEBUG] [LOCAL ] IPI: Loaded 21704 existing records from primary storage. [2025-09-28T02:51:14.873732] [INFO ] [MAIN ] IPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:14.874207] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPI took 0.8s. Estimated remaining: 5m 38s. Rate: 221.7 symbols/min [2025-09-28T02:51:15.088211] [DEBUG] [LOCAL ] IOT: Loaded 54249 existing records from primary storage. [2025-09-28T02:51:15.134985] [INFO ] [MAIN ] IOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:15.154200] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IOT took 1.1s. Estimated remaining: 5m 38s. Rate: 221.7 symbols/min [2025-09-28T02:51:15.185764] [DEBUG] [LOCAL ] IPG: Loaded 54110 existing records from primary storage. [2025-09-28T02:51:15.172477] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:15.214452] [INFO ] [MAIN ] IPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:15.278207] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IPG took 1.2s. Estimated remaining: 5m 38s. Rate: 221.8 symbols/min [2025-09-28T02:51:15.308175] [DEBUG] [LOCAL ] IP: Loaded 54093 existing records from primary storage. [2025-09-28T02:51:15.383560] [INFO ] [MAIN ] IP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:15.407325] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IP took 1.4s. Estimated remaining: 5m 37s. Rate: 221.9 symbols/min [2025-09-28T02:51:15.594338] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:15.602273] [DEBUG] [LOCAL ] IQI: Loaded 18161 existing records from primary storage. [2025-09-28T02:51:15.680810] [INFO ] [MAIN ] IQI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:15.741928] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:15.716292] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQI took 0.8s. Estimated remaining: 5m 37s. Rate: 221.8 symbols/min [2025-09-28T02:51:15.824736] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:16.057478] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:16.078883] [DEBUG] [LOCAL ] IQV: Loaded 50895 existing records from primary storage. [2025-09-28T02:51:16.080126] [INFO ] [MAIN ] IQV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:16.080872] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IQV took 0.9s. Estimated remaining: 5m 37s. Rate: 221.8 symbols/min [2025-09-28T02:51:16.171137] [DEBUG] [LOCAL ] IR: Loaded 53470 existing records from primary storage. [2025-09-28T02:51:16.244322] [INFO ] [MAIN ] IR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:16.258221] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IR took 0.9s. Estimated remaining: 5m 36s. Rate: 221.8 symbols/min [2025-09-28T02:51:16.335401] [DEBUG] [LOCAL ] IRM: Loaded 50159 existing records from primary storage. [2025-09-28T02:51:16.382175] [DEBUG] [LOCAL ] IRS: Loaded 22136 existing records from primary storage. [2025-09-28T02:51:16.410608] [INFO ] [MAIN ] IRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:16.430270] [INFO ] [MAIN ] IRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:16.457640] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IRM took 1.0s. Estimated remaining: 5m 36s. Rate: 221.9 symbols/min [2025-09-28T02:51:16.492983] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRS took 0.7s. Estimated remaining: 5m 36s. Rate: 222.1 symbols/min [2025-09-28T02:51:16.545947] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:16.942895] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:17.244398] [DEBUG] [LOCAL ] ISD: Loaded 15803 existing records from primary storage. [2025-09-28T02:51:17.263377] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:17.274975] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:17.277526] [INFO ] [MAIN ] ISD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:17.306263] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. ISD took 1.0s. Estimated remaining: 5m 36s. Rate: 221.7 symbols/min [2025-09-28T02:51:17.308483] [DEBUG] [LOCAL ] IRT: Loaded 51146 existing records from primary storage. [2025-09-28T02:51:17.315262] [INFO ] [MAIN ] IRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:17.367489] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. IRT took 1.3s. Estimated remaining: 5m 35s. Rate: 221.8 symbols/min [2025-09-28T02:51:17.728050] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:17.730472] [DEBUG] [LOCAL ] ITGR: Loaded 31996 existing records from primary storage. [2025-09-28T02:51:17.731938] [DEBUG] [LOCAL ] IT: Loaded 42234 existing records from primary storage. [2025-09-28T02:51:17.742852] [INFO ] [MAIN ] ITGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:17.765359] [INFO ] [MAIN ] IT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:17.816792] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:17.811993] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. ITGR took 1.3s. Estimated remaining: 5m 35s. Rate: 221.7 symbols/min [2025-09-28T02:51:17.833048] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. IT took 1.3s. Estimated remaining: 5m 35s. Rate: 221.9 symbols/min [2025-09-28T02:51:18.130402] [DEBUG] [LOCAL ] ITT: Loaded 33511 existing records from primary storage. [2025-09-28T02:51:18.169126] [INFO ] [MAIN ] ITT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:18.168985] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:18.179945] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 0.9s. Estimated remaining: 5m 35s. Rate: 221.8 symbols/min [2025-09-28T02:51:18.304848] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:18.387403] [DEBUG] [LOCAL ] ITUB: Loaded 54084 existing records from primary storage. [2025-09-28T02:51:18.413733] [INFO ] [MAIN ] ITUB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:18.438153] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITUB took 1.0s. Estimated remaining: 5m 34s. Rate: 221.8 symbols/min [2025-09-28T02:51:18.560596] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:18.635561] [DEBUG] [LOCAL ] ITW: Loaded 46782 existing records from primary storage. [2025-09-28T02:51:18.683480] [INFO ] [MAIN ] ITW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:18.703743] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. ITW took 0.9s. Estimated remaining: 5m 34s. Rate: 221.8 symbols/min [2025-09-28T02:51:18.726233] [DEBUG] [LOCAL ] IVR: Loaded 48557 existing records from primary storage. [2025-09-28T02:51:18.805427] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:18.815791] [INFO ] [MAIN ] IVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:18.854194] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVR took 1.0s. Estimated remaining: 5m 34s. Rate: 221.9 symbols/min [2025-09-28T02:51:18.994459] [DEBUG] [LOCAL ] IVT: Loaded 31325 existing records from primary storage. [2025-09-28T02:51:19.069092] [INFO ] [MAIN ] IVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:19.103141] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IVT took 0.9s. Estimated remaining: 5m 33s. Rate: 221.9 symbols/min [2025-09-28T02:51:19.130010] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:19.339218] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:19.423215] [DEBUG] [LOCAL ] IVZ: Loaded 53908 existing records from primary storage. [2025-09-28T02:51:19.455112] [INFO ] [MAIN ] IVZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:19.470483] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IVZ took 1.0s. Estimated remaining: 5m 33s. Rate: 221.9 symbols/min [2025-09-28T02:51:19.493772] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:19.543080] [DEBUG] [LOCAL ] IX: Loaded 22926 existing records from primary storage. [2025-09-28T02:51:19.584948] [INFO ] [MAIN ] IX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:19.631405] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. IX took 0.9s. Estimated remaining: 5m 33s. Rate: 221.9 symbols/min [2025-09-28T02:51:19.764117] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:19.824146] [DEBUG] [LOCAL ] J: Loaded 40873 existing records from primary storage. [2025-09-28T02:51:19.849242] [INFO ] [MAIN ] J: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:19.860077] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. J took 1.0s. Estimated remaining: 5m 32s. Rate: 222.0 symbols/min [2025-09-28T02:51:20.025193] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:20.028153] [DEBUG] [LOCAL ] JBGS: Loaded 43089 existing records from primary storage. [2025-09-28T02:51:20.097240] [INFO ] [MAIN ] JBGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:20.103270] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBGS took 0.9s. Estimated remaining: 5m 32s. Rate: 222.0 symbols/min [2025-09-28T02:51:20.268392] [DEBUG] [LOCAL ] JBI: Loaded 44362 existing records from primary storage. [2025-09-28T02:51:20.241355] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:20.280206] [INFO ] [MAIN ] JBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:20.302004] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBI took 0.8s. Estimated remaining: 5m 32s. Rate: 222.0 symbols/min [2025-09-28T02:51:20.560638] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:20.575161] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-28T02:51:20.594974] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-28T02:51:20.596914] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-28T02:51:20.589432] [DEBUG] [LOCAL ] JBL: Loaded 49145 existing records from primary storage. [2025-09-28T02:51:20.596518] [DEBUG] [LOCAL ] JBND: Loaded 26051 existing records from primary storage. [2025-09-28T02:51:20.612913] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-28T02:51:20.687842] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:20.624074] [INFO ] [MAIN ] JBND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:20.688301] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBND took 0.8s. Estimated remaining: 5m 32s. Rate: 222.0 symbols/min [2025-09-28T02:51:20.699344] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-28T02:51:20.624348] [INFO ] [MAIN ] JBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:20.729758] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-28T02:51:20.729581] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBL took 1.1s. Estimated remaining: 5m 31s. Rate: 222.1 symbols/min [2025-09-28T02:51:20.723272] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-28T02:51:20.786122] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-28T02:51:20.842920] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-28T02:51:20.937128] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-28T02:51:21.080442] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-28T02:51:21.140170] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-28T02:51:21.120363] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:21.445148] [DEBUG] [LOCAL ] JCE: Loaded 6591 existing records from primary storage. [2025-09-28T02:51:21.458867] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:21.503065] [INFO ] [MAIN ] JCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:21.519118] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JCE took 0.8s. Estimated remaining: 5m 31s. Rate: 221.8 symbols/min [2025-09-28T02:51:21.734201] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:21.760972] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-28T02:51:21.943385] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:22.079924] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:51:22.144975] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-28T02:51:22.144823] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:22.145387] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:51:22.145761] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-28T02:51:22.146901] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-09-28T02:51:22.147066] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:51:22.147146] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-28T02:51:22.147279] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-28T02:51:22.147381] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-28T02:51:22.148980] [DEBUG] [LOCAL ] JCI: Loaded 54327 existing records from primary storage. [2025-09-28T02:51:22.149375] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-28T02:51:22.149923] [INFO ] [MAIN ] JCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:22.149721] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBS took 2.0s. Estimated remaining: 5m 32s. Rate: 221.5 symbols/min [2025-09-28T02:51:22.155785] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCI took 1.4s. Estimated remaining: 5m 31s. Rate: 221.7 symbols/min [2025-09-28T02:51:22.332451] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:51:22.360359] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-28T02:51:22.399984] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:51:22.454937] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-09-28T02:51:22.502861] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:51:22.454759] [DEBUG] [LOCAL ] JEF: Loaded 50763 existing records from primary storage. [2025-09-28T02:51:22.527422] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-28T02:51:22.570681] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-28T02:51:22.587460] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:22.592228] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-28T02:51:22.591918] [INFO ] [MAIN ] JEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:22.593386] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JEF took 1.1s. Estimated remaining: 5m 31s. Rate: 221.6 symbols/min [2025-09-28T02:51:22.591481] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:22.593792] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-28T02:51:22.628804] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JBTM took 2.3s. Estimated remaining: 5m 30s. Rate: 221.7 symbols/min [2025-09-28T02:51:22.743688] [DEBUG] [LOCAL ] JEQ: Loaded 9336 existing records from primary storage. [2025-09-28T02:51:22.770196] [INFO ] [MAIN ] JEQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:22.838309] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JEQ took 0.7s. Estimated remaining: 5m 30s. Rate: 221.8 symbols/min [2025-09-28T02:51:23.039712] [DEBUG] [LOCAL ] JELD: Loaded 46791 existing records from primary storage. [2025-09-28T02:51:23.088084] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:23.153228] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:23.117023] [INFO ] [MAIN ] JELD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:23.164372] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JELD took 1.0s. Estimated remaining: 5m 30s. Rate: 221.7 symbols/min [2025-09-28T02:51:23.303769] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:23.356830] [DEBUG] [LOCAL ] JGH: Loaded 11064 existing records from primary storage. [2025-09-28T02:51:23.373763] [INFO ] [MAIN ] JGH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:23.385791] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JGH took 0.8s. Estimated remaining: 5m 30s. Rate: 221.8 symbols/min [2025-09-28T02:51:23.533948] [DEBUG] [LOCAL ] JFR: Loaded 30975 existing records from primary storage. [2025-09-28T02:51:23.578321] [INFO ] [MAIN ] JFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:23.578055] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:23.596187] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JFR took 1.0s. Estimated remaining: 5m 29s. Rate: 221.8 symbols/min [2025-09-28T02:51:23.790183] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:23.736361] [DEBUG] [LOCAL ] JHI: Loaded 3641 existing records from primary storage. [2025-09-28T02:51:23.826885] [DEBUG] [LOCAL ] JHG: Loaded 48497 existing records from primary storage. [2025-09-28T02:51:23.851090] [INFO ] [MAIN ] JHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:23.845704] [INFO ] [MAIN ] JHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:23.857854] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHG took 1.0s. Estimated remaining: 5m 29s. Rate: 221.8 symbols/min [2025-09-28T02:51:23.880526] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHI took 0.7s. Estimated remaining: 5m 28s. Rate: 222.0 symbols/min [2025-09-28T02:51:24.011442] [DEBUG] [LOCAL ] JHS: Loaded 2878 existing records from primary storage. [2025-09-28T02:51:24.110207] [INFO ] [MAIN ] JHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:24.161570] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JHS took 0.8s. Estimated remaining: 5m 28s. Rate: 222.0 symbols/min [2025-09-28T02:51:24.197784] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:24.316990] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:24.354158] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:24.407142] [DEBUG] [LOCAL ] JILL: Loaded 16931 existing records from primary storage. [2025-09-28T02:51:24.407461] [INFO ] [MAIN ] JILL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:24.417107] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JILL took 0.5s. Estimated remaining: 5m 28s. Rate: 222.0 symbols/min [2025-09-28T02:51:24.419253] [DEBUG] [LOCAL ] JHX: Loaded 51216 existing records from primary storage. [2025-09-28T02:51:24.419711] [INFO ] [MAIN ] JHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:24.420258] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHX took 0.8s. Estimated remaining: 5m 27s. Rate: 222.2 symbols/min [2025-09-28T02:51:24.437016] [DEBUG] [LOCAL ] JKS: Loaded 40672 existing records from primary storage. [2025-09-28T02:51:24.437398] [INFO ] [MAIN ] JKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:24.437504] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 0.6s. Estimated remaining: 5m 27s. Rate: 222.4 symbols/min [2025-09-28T02:51:25.157359] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:25.114484] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:25.177582] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:25.215212] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:25.215935] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-28T02:51:25.216012] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-28T02:51:25.216147] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-28T02:51:25.216222] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-28T02:51:25.216307] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-28T02:51:25.216379] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-28T02:51:25.277591] [DEBUG] [LOCAL ] JLS: Loaded 4142 existing records from primary storage. [2025-09-28T02:51:25.298366] [INFO ] [MAIN ] JLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:25.319209] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JLS took 0.9s. Estimated remaining: 5m 27s. Rate: 221.9 symbols/min [2025-09-28T02:51:25.689307] [DEBUG] [LOCAL ] JLL: Loaded 32458 existing records from primary storage. [2025-09-28T02:51:25.730469] [INFO ] [MAIN ] JLL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:25.704761] [DEBUG] [LOCAL ] JMIA: Loaded 51279 existing records from primary storage. [2025-09-28T02:51:25.749900] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JLL took 1.3s. Estimated remaining: 5m 27s. Rate: 221.8 symbols/min [2025-09-28T02:51:25.784543] [INFO ] [MAIN ] JMIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:25.785466] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:25.823359] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JMIA took 1.4s. Estimated remaining: 5m 27s. Rate: 222.0 symbols/min [2025-09-28T02:51:25.974552] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:26.066935] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-28T02:51:26.214665] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:26.264471] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:26.293876] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-09-28T02:51:26.294498] [INFO ] [MAIN ] JNJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:26.295135] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JNJ took 1.0s. Estimated remaining: 5m 26s. Rate: 221.8 symbols/min [2025-09-28T02:51:26.374723] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-28T02:51:26.435335] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-28T02:51:26.449831] [DEBUG] [LOCAL ] JOE: Loaded 24860 existing records from primary storage. [2025-09-28T02:51:26.487796] [INFO ] [MAIN ] JOE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:26.512701] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOE took 0.6s. Estimated remaining: 5m 26s. Rate: 221.9 symbols/min [2025-09-28T02:51:26.532322] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:26.568842] [DEBUG] [LOCAL ] JOBY: Loaded 54579 existing records from primary storage. [2025-09-28T02:51:26.598212] [INFO ] [MAIN ] JOBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:26.635576] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOBY took 0.8s. Estimated remaining: 5m 26s. Rate: 222.0 symbols/min [2025-09-28T02:51:26.635971] [DEBUG] [LOCAL ] JOF: Loaded 7177 existing records from primary storage. [2025-09-28T02:51:26.680274] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-28T02:51:26.729126] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-28T02:51:26.755813] [INFO ] [MAIN ] JOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:26.809948] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOF took 0.5s. Estimated remaining: 5m 25s. Rate: 222.0 symbols/min [2025-09-28T02:51:26.809662] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:27.052307] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:27.137609] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-28T02:51:27.137494] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:27.148801] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-28T02:51:27.167276] [DEBUG] [LOCAL ] JPC: Loaded 37620 existing records from primary storage. [2025-09-28T02:51:27.167810] [INFO ] [MAIN ] JPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:27.168053] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JPC took 0.6s. Estimated remaining: 5m 25s. Rate: 222.0 symbols/min [2025-09-28T02:51:27.416876] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-28T02:51:27.419698] [DEBUG] [LOCAL ] JQC: Loaded 34194 existing records from primary storage. [2025-09-28T02:51:27.398013] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:27.421081] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-28T02:51:27.424755] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-09-28T02:51:27.421518] [INFO ] [MAIN ] JQC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:27.425416] [INFO ] [MAIN ] JPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:27.425313] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JQC took 0.6s. Estimated remaining: 5m 25s. Rate: 222.0 symbols/min [2025-09-28T02:51:27.431896] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JPM took 0.8s. Estimated remaining: 5m 24s. Rate: 222.2 symbols/min [2025-09-28T02:51:27.632016] [DEBUG] [LOCAL ] JRI: Loaded 15068 existing records from primary storage. [2025-09-28T02:51:27.667895] [INFO ] [MAIN ] JRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:27.714072] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRI took 0.5s. Estimated remaining: 5m 24s. Rate: 222.2 symbols/min [2025-09-28T02:51:27.735242] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-28T02:51:27.749873] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-28T02:51:27.852189] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:28.024978] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:28.059379] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:28.070728] [DEBUG] [LOCAL ] JRS: Loaded 11250 existing records from primary storage. [2025-09-28T02:51:28.071027] [INFO ] [MAIN ] JRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:28.071188] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRS took 0.6s. Estimated remaining: 5m 24s. Rate: 222.1 symbols/min [2025-09-28T02:51:28.283677] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-28T02:51:28.302336] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:28.304490] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-28T02:51:28.324845] [DEBUG] [LOCAL ] JXN: Loaded 46558 existing records from primary storage. [2025-09-28T02:51:28.327192] [INFO ] [MAIN ] JXN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:28.345443] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JXN took 0.9s. Estimated remaining: 5m 24s. Rate: 222.1 symbols/min [2025-09-28T02:51:28.387752] [DEBUG] [LOCAL ] K: Loaded 50637 existing records from primary storage. [2025-09-28T02:51:28.423216] [INFO ] [MAIN ] K: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:28.430928] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. K took 0.7s. Estimated remaining: 5m 23s. Rate: 222.2 symbols/min [2025-09-28T02:51:28.524081] [DEBUG] [LOCAL ] KAI: Loaded 13729 existing records from primary storage. [2025-09-28T02:51:28.582915] [INFO ] [MAIN ] KAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:28.583079] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. KAI took 0.5s. Estimated remaining: 5m 23s. Rate: 222.3 symbols/min [2025-09-28T02:51:28.691279] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:28.722302] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-28T02:51:28.793194] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-28T02:51:28.838069] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:28.941249] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:28.988801] [DEBUG] [LOCAL ] KB: Loaded 24453 existing records from primary storage. [2025-09-28T02:51:28.991132] [INFO ] [MAIN ] KB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:28.991527] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KB took 0.5s. Estimated remaining: 5m 23s. Rate: 222.2 symbols/min [2025-09-28T02:51:28.993027] [DEBUG] [LOCAL ] KAR: Loaded 40411 existing records from primary storage. [2025-09-28T02:51:29.089779] [DEBUG] [LOCAL ] KBDC: Loaded 21252 existing records from primary storage. [2025-09-28T02:51:29.075921] [INFO ] [MAIN ] KAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:29.101748] [INFO ] [MAIN ] KBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:29.101898] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KAR took 0.8s. Estimated remaining: 5m 22s. Rate: 222.3 symbols/min [2025-09-28T02:51:29.120248] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 0.5s. Estimated remaining: 5m 22s. Rate: 222.5 symbols/min [2025-09-28T02:51:29.249108] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-28T02:51:29.337506] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:29.354874] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-28T02:51:29.572809] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:29.629098] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:29.687048] [DEBUG] [LOCAL ] KBH: Loaded 49678 existing records from primary storage. [2025-09-28T02:51:29.688029] [INFO ] [MAIN ] KBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:29.688485] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBH took 0.7s. Estimated remaining: 5m 22s. Rate: 222.3 symbols/min [2025-09-28T02:51:29.842544] [DEBUG] [LOCAL ] KBR: Loaded 48899 existing records from primary storage. [2025-09-28T02:51:29.842849] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-28T02:51:29.868945] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-28T02:51:29.861564] [INFO ] [MAIN ] KBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:29.888627] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBR took 0.8s. Estimated remaining: 5m 21s. Rate: 222.3 symbols/min [2025-09-28T02:51:29.886930] [DEBUG] [LOCAL ] KD: Loaded 53068 existing records from primary storage. [2025-09-28T02:51:29.960898] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:29.948347] [INFO ] [MAIN ] KD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:29.997383] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KD took 0.9s. Estimated remaining: 5m 21s. Rate: 222.4 symbols/min [2025-09-28T02:51:30.107745] [DEBUG] [LOCAL ] KEN: Loaded 4784 existing records from primary storage. [2025-09-28T02:51:30.211701] [INFO ] [MAIN ] KEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:30.260559] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:30.267908] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KEN took 0.6s. Estimated remaining: 5m 21s. Rate: 222.4 symbols/min [2025-09-28T02:51:30.331036] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-28T02:51:30.392272] [INFO ] [REMOTE ] JMM: Full fetch complete (2292 records). [2025-09-28T02:51:30.438575] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:30.449490] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-28T02:51:30.705833] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:30.808694] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-28T02:51:30.810176] [DEBUG] [LOCAL ] KEP: Loaded 31169 existing records from primary storage. [2025-09-28T02:51:30.810560] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:51:30.812621] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:51:30.813022] [INFO ] [MAIN ] KEP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:30.812739] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-28T02:51:30.813758] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-28T02:51:30.813154] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-28T02:51:30.813546] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEP took 0.9s. Estimated remaining: 5m 21s. Rate: 222.2 symbols/min [2025-09-28T02:51:30.814097] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-28T02:51:30.814211] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-28T02:51:30.903191] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-28T02:51:30.883224] [DEBUG] [LOCAL ] KEX: Loaded 38712 existing records from primary storage. [2025-09-28T02:51:30.872287] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-28T02:51:30.904054] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-28T02:51:30.903862] [INFO ] [MAIN ] KEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:30.915006] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEX took 0.9s. Estimated remaining: 5m 20s. Rate: 222.4 symbols/min [2025-09-28T02:51:30.930804] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-28T02:51:30.909411] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-28T02:51:30.956228] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. JMM took 6.5s. Estimated remaining: 5m 20s. Rate: 222.5 symbols/min [2025-09-28T02:51:31.420276] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:31.510708] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:31.658272] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:31.684398] [DEBUG] [LOCAL ] KF: Loaded 2486 existing records from primary storage. [2025-09-28T02:51:31.725807] [INFO ] [MAIN ] KF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:31.731743] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KF took 0.8s. Estimated remaining: 5m 20s. Rate: 222.2 symbols/min [2025-09-28T02:51:31.974584] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:32.007473] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-28T02:51:32.010411] [DEBUG] [LOCAL ] KEYS: Loaded 43955 existing records from primary storage. [2025-09-28T02:51:32.035505] [DEBUG] [LOCAL ] KFRC: Loaded 19766 existing records from primary storage. [2025-09-28T02:51:32.046701] [INFO ] [MAIN ] KFRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:32.070760] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:32.044041] [INFO ] [MAIN ] KEYS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:32.071116] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KFRC took 1.0s. Estimated remaining: 5m 20s. Rate: 222.1 symbols/min [2025-09-28T02:51:32.072559] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KEYS took 1.3s. Estimated remaining: 5m 19s. Rate: 222.3 symbols/min [2025-09-28T02:51:32.304118] [DEBUG] [LOCAL ] KFS: Loaded 8471 existing records from primary storage. [2025-09-28T02:51:32.321772] [INFO ] [MAIN ] KFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:32.331459] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 0.6s. Estimated remaining: 5m 19s. Rate: 222.3 symbols/min [2025-09-28T02:51:32.461026] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:32.538405] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:32.703720] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:32.720299] [DEBUG] [LOCAL ] KFY: Loaded 31057 existing records from primary storage. [2025-09-28T02:51:32.720819] [INFO ] [MAIN ] KFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:32.720926] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFY took 0.6s. Estimated remaining: 5m 19s. Rate: 222.2 symbols/min [2025-09-28T02:51:32.953168] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:32.968899] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-09-28T02:51:32.970183] [DEBUG] [LOCAL ] KGS: Loaded 46487 existing records from primary storage. [2025-09-28T02:51:32.972205] [INFO ] [MAIN ] KGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:32.970928] [INFO ] [MAIN ] KGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:32.972830] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KGS took 0.6s. Estimated remaining: 5m 19s. Rate: 222.3 symbols/min [2025-09-28T02:51:32.994977] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGC took 0.9s. Estimated remaining: 5m 18s. Rate: 222.4 symbols/min [2025-09-28T02:51:33.300326] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:33.404536] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:33.407182] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-28T02:51:33.442872] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-28T02:51:33.447435] [DEBUG] [LOCAL ] KIM: Loaded 53831 existing records from primary storage. [2025-09-28T02:51:33.448403] [INFO ] [MAIN ] KIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:33.448627] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIM took 0.7s. Estimated remaining: 5m 18s. Rate: 222.3 symbols/min [2025-09-28T02:51:33.554191] [DEBUG] [LOCAL ] KIO: Loaded 21625 existing records from primary storage. [2025-09-28T02:51:33.577632] [INFO ] [MAIN ] KIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:33.590365] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KIO took 0.6s. Estimated remaining: 5m 18s. Rate: 222.4 symbols/min [2025-09-28T02:51:33.745325] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:33.833729] [DEBUG] [LOCAL ] KKR: Loaded 54281 existing records from primary storage. [2025-09-28T02:51:33.857132] [INFO ] [MAIN ] KKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:33.948011] [DEBUG] [LOCAL ] KKRS: Loaded 5801 existing records from primary storage. [2025-09-28T02:51:33.907499] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKR took 0.9s. Estimated remaining: 5m 17s. Rate: 222.4 symbols/min [2025-09-28T02:51:33.951746] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:33.952676] [INFO ] [MAIN ] KKRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:33.958288] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-28T02:51:33.958371] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KKRS took 0.5s. Estimated remaining: 5m 17s. Rate: 222.5 symbols/min [2025-09-28T02:51:33.995985] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-28T02:51:34.001818] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-28T02:51:34.050736] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-28T02:51:34.130454] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-28T02:51:34.166858] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-28T02:51:34.407156] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:34.457929] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:34.469861] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-28T02:51:34.482371] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-28T02:51:34.519888] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-28T02:51:34.541159] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-28T02:51:34.597805] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-28T02:51:34.635335] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-28T02:51:34.755992] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-28T02:51:34.837533] [DEBUG] [LOCAL ] KLC: Loaded 37107 existing records from primary storage. [2025-09-28T02:51:34.897433] [INFO ] [MAIN ] KLC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:34.932488] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-28T02:51:34.944697] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KLC took 0.9s. Estimated remaining: 5m 17s. Rate: 222.0 symbols/min [2025-09-28T02:51:34.950159] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:34.966264] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-28T02:51:35.191197] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:51:35.201599] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-28T02:51:35.231989] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:35.232111] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:51:35.232682] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-09-28T02:51:35.232786] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:51:35.232892] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-28T02:51:35.232582] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-28T02:51:35.233044] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-28T02:51:35.234073] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-28T02:51:35.234196] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-28T02:51:35.234298] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKRT took 1.6s. Estimated remaining: 5m 17s. Rate: 222.0 symbols/min [2025-09-28T02:51:35.382714] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:51:35.383133] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-28T02:51:35.383230] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:51:35.383308] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-09-28T02:51:35.383376] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:51:35.383450] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-28T02:51:35.383550] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-28T02:51:35.383680] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-28T02:51:35.383784] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-28T02:51:35.383893] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KLAR took 1.4s. Estimated remaining: 5m 17s. Rate: 222.1 symbols/min [2025-09-28T02:51:35.746820] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-28T02:51:35.757395] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-28T02:51:36.573680] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-28T02:51:36.585671] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-28T02:51:37.448639] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-28T02:51:37.462124] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-28T02:51:38.291700] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-28T02:51:38.303898] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-28T02:51:39.143143] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-28T02:51:39.154791] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-28T02:51:40.045975] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-28T02:51:40.059444] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-28T02:51:42.617632] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-28T02:51:42.632093] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-28T02:51:43.489017] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-28T02:51:43.500574] [INFO ] [REMOTE ] KEY: Full fetch complete (77256 records). [2025-09-28T02:51:43.500852] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-28T02:51:43.714705] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:51:43.716010] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:51:43.716104] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:51:43.716193] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-28T02:51:43.716344] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-28T02:51:43.716430] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-28T02:51:43.716533] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-28T02:51:43.716714] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KEY took 13.4s. Estimated remaining: 5m 24s. Rate: 216.7 symbols/min [2025-09-28T02:51:44.442781] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:44.465902] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:44.526913] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:44.531573] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:44.536440] [DEBUG] [LOCAL ] KMPB: Loaded 3646 existing records from primary storage. [2025-09-28T02:51:44.537818] [INFO ] [MAIN ] KMPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:44.538269] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 0.8s. Estimated remaining: 5m 24s. Rate: 216.3 symbols/min [2025-09-28T02:51:44.800024] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:44.817197] [DEBUG] [LOCAL ] KMT: Loaded 43687 existing records from primary storage. [2025-09-28T02:51:44.818519] [DEBUG] [LOCAL ] KMPR: Loaded 39117 existing records from primary storage. [2025-09-28T02:51:44.819484] [INFO ] [MAIN ] KMPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:44.819614] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMPR took 1.1s. Estimated remaining: 5m 24s. Rate: 216.3 symbols/min [2025-09-28T02:51:44.819322] [INFO ] [MAIN ] KMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:44.843144] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 1.1s. Estimated remaining: 5m 24s. Rate: 216.5 symbols/min [2025-09-28T02:51:45.038677] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-09-28T02:51:45.117201] [INFO ] [MAIN ] KMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:45.184630] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:45.167792] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMI took 1.5s. Estimated remaining: 5m 23s. Rate: 216.5 symbols/min [2025-09-28T02:51:45.261431] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:45.322288] [DEBUG] [LOCAL ] KMX: Loaded 53897 existing records from primary storage. [2025-09-28T02:51:45.381636] [INFO ] [MAIN ] KMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:45.410548] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 0.9s. Estimated remaining: 5m 23s. Rate: 216.5 symbols/min [2025-09-28T02:51:45.557804] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:45.580936] [DEBUG] [LOCAL ] KN: Loaded 39393 existing records from primary storage. [2025-09-28T02:51:45.592800] [INFO ] [MAIN ] KN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:45.641504] [DEBUG] [LOCAL ] KNF: Loaded 36435 existing records from primary storage. [2025-09-28T02:51:45.621471] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KN took 0.8s. Estimated remaining: 5m 23s. Rate: 216.5 symbols/min [2025-09-28T02:51:45.645115] [INFO ] [MAIN ] KNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:45.661186] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNF took 0.8s. Estimated remaining: 5m 22s. Rate: 216.7 symbols/min [2025-09-28T02:51:45.770707] [DEBUG] [LOCAL ] KNOP: Loaded 10274 existing records from primary storage. [2025-09-28T02:51:45.802112] [INFO ] [MAIN ] KNOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:45.829528] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:45.834910] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNOP took 0.6s. Estimated remaining: 5m 22s. Rate: 216.8 symbols/min [2025-09-28T02:51:46.203630] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:46.256750] [DEBUG] [LOCAL ] KNSL: Loaded 18372 existing records from primary storage. [2025-09-28T02:51:46.274074] [INFO ] [MAIN ] KNSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:46.267610] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:46.295287] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNSL took 0.9s. Estimated remaining: 5m 22s. Rate: 216.6 symbols/min [2025-09-28T02:51:46.371343] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:46.421450] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-28T02:51:46.428020] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-28T02:51:46.444102] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-28T02:51:46.444251] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-28T02:51:46.460270] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-28T02:51:46.460902] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-28T02:51:46.659405] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:46.723429] [DEBUG] [LOCAL ] KNTK: Loaded 46794 existing records from primary storage. [2025-09-28T02:51:46.724209] [INFO ] [MAIN ] KNTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:46.742762] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNTK took 1.1s. Estimated remaining: 5m 22s. Rate: 216.5 symbols/min [2025-09-28T02:51:46.816278] [DEBUG] [LOCAL ] KNX: Loaded 53363 existing records from primary storage. [2025-09-28T02:51:46.951571] [INFO ] [MAIN ] KNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:46.988315] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 1.3s. Estimated remaining: 5m 21s. Rate: 216.5 symbols/min [2025-09-28T02:51:47.177810] [DEBUG] [LOCAL ] KODK: Loaded 44025 existing records from primary storage. [2025-09-28T02:51:47.305287] [INFO ] [MAIN ] KODK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:47.356202] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:47.352195] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:47.361709] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 1.1s. Estimated remaining: 5m 21s. Rate: 216.5 symbols/min [2025-09-28T02:51:47.370191] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-28T02:51:47.542966] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:47.666350] [DEBUG] [LOCAL ] KOF: Loaded 26219 existing records from primary storage. [2025-09-28T02:51:47.671359] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:47.671815] [INFO ] [MAIN ] KOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:47.672018] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KOF took 0.9s. Estimated remaining: 5m 21s. Rate: 216.5 symbols/min [2025-09-28T02:51:47.730243] [DEBUG] [LOCAL ] KOP: Loaded 18066 existing records from primary storage. [2025-09-28T02:51:47.770815] [INFO ] [MAIN ] KOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:47.801712] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOP took 0.8s. Estimated remaining: 5m 21s. Rate: 216.6 symbols/min [2025-09-28T02:51:47.771913] [DEBUG] [LOCAL ] KORE: Loaded 2010 existing records from primary storage. [2025-09-28T02:51:47.807092] [INFO ] [MAIN ] KORE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:47.819189] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KORE took 0.4s. Estimated remaining: 5m 20s. Rate: 216.7 symbols/min [2025-09-28T02:51:48.073280] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:48.267801] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:48.291429] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:48.386853] [DEBUG] [LOCAL ] KOS: Loaded 53828 existing records from primary storage. [2025-09-28T02:51:48.387863] [INFO ] [MAIN ] KOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:48.388042] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KOS took 0.7s. Estimated remaining: 5m 20s. Rate: 216.5 symbols/min [2025-09-28T02:51:48.512184] [DEBUG] [LOCAL ] KRC: Loaded 49114 existing records from primary storage. [2025-09-28T02:51:48.523956] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-09-28T02:51:48.552116] [INFO ] [MAIN ] KRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:48.552569] [INFO ] [MAIN ] KR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:48.552949] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KRC took 0.7s. Estimated remaining: 5m 20s. Rate: 216.6 symbols/min [2025-09-28T02:51:48.553574] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KR took 0.7s. Estimated remaining: 5m 19s. Rate: 216.8 symbols/min [2025-09-28T02:51:48.752169] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:48.974177] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:49.033442] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:49.034224] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-28T02:51:49.038290] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-28T02:51:49.038927] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-28T02:51:49.069190] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-28T02:51:49.071108] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-28T02:51:49.089329] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-28T02:51:49.093900] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-28T02:51:49.100291] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-28T02:51:49.223363] [DEBUG] [LOCAL ] KREF: Loaded 37767 existing records from primary storage. [2025-09-28T02:51:49.234561] [INFO ] [MAIN ] KREF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:49.246278] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KREF took 0.9s. Estimated remaining: 5m 19s. Rate: 216.5 symbols/min [2025-09-28T02:51:49.646221] [DEBUG] [LOCAL ] KRG: Loaded 49859 existing records from primary storage. [2025-09-28T02:51:49.644135] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:49.652574] [INFO ] [MAIN ] KRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:49.658606] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRG took 1.1s. Estimated remaining: 5m 19s. Rate: 216.4 symbols/min [2025-09-28T02:51:49.771483] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:49.800256] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-28T02:51:49.934250] [DEBUG] [LOCAL ] KRO: Loaded 26448 existing records from primary storage. [2025-09-28T02:51:49.952182] [INFO ] [MAIN ] KRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:49.956940] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRO took 0.7s. Estimated remaining: 5m 19s. Rate: 216.4 symbols/min [2025-09-28T02:51:49.956628] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:50.013471] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:51:50.027296] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-28T02:51:50.088908] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:51:50.119076] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-09-28T02:51:50.127234] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:51:50.147989] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-28T02:51:50.153776] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-28T02:51:50.154046] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-28T02:51:50.153313] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:50.154542] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-28T02:51:50.154715] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRMN took 1.6s. Estimated remaining: 5m 18s. Rate: 216.5 symbols/min [2025-09-28T02:51:50.409356] [DEBUG] [LOCAL ] KRP: Loaded 37947 existing records from primary storage. [2025-09-28T02:51:50.403304] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-28T02:51:50.407763] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:50.420193] [INFO ] [MAIN ] KRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:50.422671] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-28T02:51:50.437551] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 0.7s. Estimated remaining: 5m 18s. Rate: 216.5 symbols/min [2025-09-28T02:51:50.576560] [DEBUG] [LOCAL ] KSS: Loaded 54385 existing records from primary storage. [2025-09-28T02:51:50.618283] [INFO ] [MAIN ] KSS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:50.660990] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KSS took 0.7s. Estimated remaining: 5m 18s. Rate: 216.5 symbols/min [2025-09-28T02:51:50.678279] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:50.804460] [DEBUG] [LOCAL ] KT: Loaded 46336 existing records from primary storage. [2025-09-28T02:51:50.831699] [INFO ] [MAIN ] KT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:50.879888] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KT took 0.7s. Estimated remaining: 5m 18s. Rate: 216.5 symbols/min [2025-09-28T02:51:50.884543] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:51.037566] [DEBUG] [LOCAL ] KTF: Loaded 13065 existing records from primary storage. [2025-09-28T02:51:51.066143] [INFO ] [MAIN ] KTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:51.065880] [DEBUG] [LOCAL ] KTB: Loaded 41738 existing records from primary storage. [2025-09-28T02:51:51.097707] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KTF took 0.4s. Estimated remaining: 5m 17s. Rate: 216.6 symbols/min [2025-09-28T02:51:51.103582] [INFO ] [MAIN ] KTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:51.129299] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:51.129422] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KTB took 0.7s. Estimated remaining: 5m 17s. Rate: 216.7 symbols/min [2025-09-28T02:51:51.165626] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-28T02:51:51.186915] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-28T02:51:51.231897] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-28T02:51:51.287063] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-28T02:51:51.315075] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-28T02:51:51.331058] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-28T02:51:51.510283] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:51.577941] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:51.797093] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-28T02:51:51.873304] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-28T02:51:51.976991] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:51.991999] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-28T02:51:51.997973] [DEBUG] [LOCAL ] KVYO: Loaded 50696 existing records from primary storage. [2025-09-28T02:51:52.013761] [INFO ] [MAIN ] KVYO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:52.013978] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KVYO took 0.8s. Estimated remaining: 5m 17s. Rate: 216.3 symbols/min [2025-09-28T02:51:52.014882] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-09-28T02:51:52.048994] [INFO ] [MAIN ] KVUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:52.093615] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KVUE took 1.0s. Estimated remaining: 5m 17s. Rate: 216.5 symbols/min [2025-09-28T02:51:52.302318] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:52.397834] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:52.410983] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-28T02:51:52.413082] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-28T02:51:52.440177] [DEBUG] [LOCAL ] KWR: Loaded 16931 existing records from primary storage. [2025-09-28T02:51:52.440498] [INFO ] [MAIN ] KWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:52.440847] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KWR took 0.3s. Estimated remaining: 5m 16s. Rate: 216.4 symbols/min [2025-09-28T02:51:52.576976] [DEBUG] [LOCAL ] KW: Loaded 41236 existing records from primary storage. [2025-09-28T02:51:52.595927] [INFO ] [MAIN ] KW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:52.607556] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KW took 0.6s. Estimated remaining: 5m 16s. Rate: 216.5 symbols/min [2025-09-28T02:51:52.743504] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:52.872989] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:52.876205] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-28T02:51:52.882831] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-28T02:51:52.929058] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-28T02:51:52.954783] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-28T02:51:52.955578] [DEBUG] [LOCAL ] KYN: Loaded 30432 existing records from primary storage. [2025-09-28T02:51:52.956995] [INFO ] [MAIN ] KYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:52.957873] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KYN took 0.5s. Estimated remaining: 5m 16s. Rate: 216.4 symbols/min [2025-09-28T02:51:53.133101] [DEBUG] [LOCAL ] L: Loaded 41562 existing records from primary storage. [2025-09-28T02:51:53.142712] [INFO ] [MAIN ] L: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:53.147965] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. L took 0.5s. Estimated remaining: 5m 15s. Rate: 216.5 symbols/min [2025-09-28T02:51:53.200416] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:53.356822] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:53.364628] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-28T02:51:53.367615] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-28T02:51:53.404768] [DEBUG] [LOCAL ] LAD: Loaded 24089 existing records from primary storage. [2025-09-28T02:51:53.405104] [INFO ] [MAIN ] LAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:53.405210] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. LAD took 0.3s. Estimated remaining: 5m 15s. Rate: 216.5 symbols/min [2025-09-28T02:51:53.533448] [DEBUG] [LOCAL ] LAC: Loaded 53091 existing records from primary storage. [2025-09-28T02:51:53.538975] [INFO ] [MAIN ] LAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:53.539157] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. LAC took 0.6s. Estimated remaining: 5m 15s. Rate: 216.6 symbols/min [2025-09-28T02:51:53.637275] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:53.817311] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:53.822921] [DEBUG] [LOCAL ] LANV: Loaded 2851 existing records from primary storage. [2025-09-28T02:51:53.823187] [INFO ] [MAIN ] LANV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:53.823693] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LANV took 0.3s. Estimated remaining: 5m 14s. Rate: 216.6 symbols/min [2025-09-28T02:51:53.964739] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-28T02:51:53.965207] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-28T02:51:54.005244] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-28T02:51:54.047479] [DEBUG] [LOCAL ] LADR: Loaded 39204 existing records from primary storage. [2025-09-28T02:51:54.074258] [INFO ] [MAIN ] LADR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:54.063540] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-28T02:51:54.075208] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LADR took 0.7s. Estimated remaining: 5m 14s. Rate: 216.6 symbols/min [2025-09-28T02:51:54.102570] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:54.102780] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-28T02:51:54.102864] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-28T02:51:54.102980] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-28T02:51:54.103051] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-28T02:51:54.103139] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-28T02:51:54.103211] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-28T02:51:54.482086] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:51:54.482867] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-28T02:51:54.488095] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-28T02:51:54.491510] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-28T02:51:54.603712] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-28T02:51:54.615927] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-28T02:51:54.627589] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:51:54.628067] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-28T02:51:54.628161] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:51:54.628240] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-09-28T02:51:54.628312] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:51:54.628392] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-28T02:51:54.628501] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-28T02:51:54.628929] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-28T02:51:54.629184] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-28T02:51:54.629279] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAR took 0.8s. Estimated remaining: 5m 14s. Rate: 216.4 symbols/min [2025-09-28T02:51:54.642826] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.15 seconds). [2025-09-28T02:51:54.644323] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-28T02:51:54.943951] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-28T02:51:54.945186] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-28T02:51:55.090373] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.15 seconds). [2025-09-28T02:51:55.091702] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-28T02:51:55.360224] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-28T02:51:55.371608] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-28T02:51:55.650281] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-28T02:51:55.652058] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-28T02:51:56.131842] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-28T02:51:56.133884] [INFO ] [REMOTE ] KUKE: Full fetch complete (8120 records). [2025-09-28T02:51:56.134004] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-28T02:51:56.331255] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:51:56.331897] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:51:56.331991] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:51:56.332197] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-28T02:51:56.332407] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-28T02:51:56.332514] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-28T02:51:56.332785] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-28T02:51:56.332961] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. KUKE took 5.4s. Estimated remaining: 5m 15s. Rate: 215.5 symbols/min [2025-09-28T02:51:56.481274] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-28T02:51:56.493918] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-28T02:51:57.326080] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-28T02:51:57.338182] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-28T02:51:58.061126] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-28T02:51:58.070881] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-09-28T02:51:58.071046] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-28T02:51:58.306210] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:51:58.307137] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:51:58.307223] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:51:58.307314] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-28T02:51:58.307444] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-28T02:51:58.307523] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-28T02:51:58.307621] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-28T02:51:58.309403] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. KO took 12.5s. Estimated remaining: 5m 16s. Rate: 214.5 symbols/min [2025-09-28T02:51:58.982479] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:58.984129] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:59.067026] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:59.086328] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:59.103755] [DEBUG] [LOCAL ] LAW: Loaded 14171 existing records from primary storage. [2025-09-28T02:51:59.104382] [INFO ] [MAIN ] LAW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:59.104487] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 0.8s. Estimated remaining: 5m 17s. Rate: 214.2 symbols/min [2025-09-28T02:51:59.322372] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:59.350349] [DEBUG] [LOCAL ] LB: Loaded 38116 existing records from primary storage. [2025-09-28T02:51:59.364828] [INFO ] [MAIN ] LB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:59.370461] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LB took 1.1s. Estimated remaining: 5m 16s. Rate: 214.2 symbols/min [2025-09-28T02:51:59.376844] [DEBUG] [LOCAL ] LBRT: Loaded 53695 existing records from primary storage. [2025-09-28T02:51:59.416738] [INFO ] [MAIN ] LBRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:59.480900] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LBRT took 1.2s. Estimated remaining: 5m 16s. Rate: 214.3 symbols/min [2025-09-28T02:51:59.506002] [DEBUG] [LOCAL ] LAZ: Loaded 45784 existing records from primary storage. [2025-09-28T02:51:59.529541] [INFO ] [MAIN ] LAZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:59.587942] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LAZ took 1.3s. Estimated remaining: 5m 15s. Rate: 214.4 symbols/min [2025-09-28T02:51:59.711271] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:59.827080] [DEBUG] [LOCAL ] LC: Loaded 48605 existing records from primary storage. [2025-09-28T02:51:59.878976] [INFO ] [MAIN ] LC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:51:59.911013] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:51:59.925715] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 0.8s. Estimated remaining: 5m 15s. Rate: 214.4 symbols/min [2025-09-28T02:52:00.093562] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:00.125523] [DEBUG] [LOCAL ] LCII: Loaded 28900 existing records from primary storage. [2025-09-28T02:52:00.142080] [INFO ] [MAIN ] LCII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:00.142433] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LCII took 0.8s. Estimated remaining: 5m 15s. Rate: 214.4 symbols/min [2025-09-28T02:52:00.328918] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:00.450190] [DEBUG] [LOCAL ] LDI: Loaded 44776 existing records from primary storage. [2025-09-28T02:52:00.436178] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:00.451405] [INFO ] [MAIN ] LDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:00.451935] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDI took 1.0s. Estimated remaining: 5m 15s. Rate: 214.4 symbols/min [2025-09-28T02:52:00.531052] [DEBUG] [LOCAL ] LDP: Loaded 13128 existing records from primary storage. [2025-09-28T02:52:00.565929] [INFO ] [MAIN ] LDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:00.570948] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDP took 0.6s. Estimated remaining: 5m 14s. Rate: 214.5 symbols/min [2025-09-28T02:52:00.643908] [DEBUG] [LOCAL ] LDOS: Loaded 46407 existing records from primary storage. [2025-09-28T02:52:00.671850] [INFO ] [MAIN ] LDOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:00.712196] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDOS took 1.1s. Estimated remaining: 5m 14s. Rate: 214.6 symbols/min [2025-09-28T02:52:00.789043] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:00.920096] [DEBUG] [LOCAL ] LEA: Loaded 42464 existing records from primary storage. [2025-09-28T02:52:00.969685] [INFO ] [MAIN ] LEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:00.997025] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 0.9s. Estimated remaining: 5m 13s. Rate: 214.6 symbols/min [2025-09-28T02:52:01.063668] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:01.222822] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:01.320204] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:01.322539] [DEBUG] [LOCAL ] LEG: Loaded 51130 existing records from primary storage. [2025-09-28T02:52:01.323452] [INFO ] [MAIN ] LEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:01.324022] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEG took 0.9s. Estimated remaining: 5m 13s. Rate: 214.5 symbols/min [2025-09-28T02:52:01.420486] [DEBUG] [LOCAL ] LEO: Loaded 17785 existing records from primary storage. [2025-09-28T02:52:01.435226] [INFO ] [MAIN ] LEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:01.449696] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEO took 0.7s. Estimated remaining: 5m 13s. Rate: 214.6 symbols/min [2025-09-28T02:52:01.666635] [DEBUG] [LOCAL ] LEN: Loaded 53967 existing records from primary storage. [2025-09-28T02:52:01.693937] [INFO ] [MAIN ] LEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:01.693607] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:01.705889] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEN took 1.1s. Estimated remaining: 5m 13s. Rate: 214.6 symbols/min [2025-09-28T02:52:01.875674] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:01.885628] [DEBUG] [LOCAL ] LEVI: Loaded 52306 existing records from primary storage. [2025-09-28T02:52:01.950391] [INFO ] [MAIN ] LEVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:01.961892] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LEVI took 0.9s. Estimated remaining: 5m 12s. Rate: 214.7 symbols/min [2025-09-28T02:52:02.031728] [DEBUG] [LOCAL ] LFT: Loaded 18286 existing records from primary storage. [2025-09-28T02:52:02.075738] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:02.101367] [INFO ] [MAIN ] LFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:02.107384] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LFT took 0.8s. Estimated remaining: 5m 12s. Rate: 214.7 symbols/min [2025-09-28T02:52:02.118617] [DEBUG] [LOCAL ] LGI: Loaded 10137 existing records from primary storage. [2025-09-28T02:52:02.174923] [INFO ] [MAIN ] LGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:02.248225] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LGI took 0.8s. Estimated remaining: 5m 11s. Rate: 214.8 symbols/min [2025-09-28T02:52:02.564129] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:02.707347] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:02.713750] [DEBUG] [LOCAL ] LH: Loaded 38660 existing records from primary storage. [2025-09-28T02:52:02.711806] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:02.714666] [INFO ] [MAIN ] LH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:02.715361] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 1.0s. Estimated remaining: 5m 11s. Rate: 214.7 symbols/min [2025-09-28T02:52:02.984196] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:02.994436] [DEBUG] [LOCAL ] LHX: Loaded 49413 existing records from primary storage. [2025-09-28T02:52:02.996349] [DEBUG] [LOCAL ] LII: Loaded 28648 existing records from primary storage. [2025-09-28T02:52:03.009763] [INFO ] [MAIN ] LHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:03.010145] [INFO ] [MAIN ] LII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:03.010701] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LHX took 1.0s. Estimated remaining: 5m 11s. Rate: 214.7 symbols/min [2025-09-28T02:52:03.017266] [DEBUG] [LOCAL ] LION: Loaded 43950 existing records from primary storage. [2025-09-28T02:52:03.017683] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LII took 0.9s. Estimated remaining: 5m 11s. Rate: 214.9 symbols/min [2025-09-28T02:52:03.043573] [INFO ] [MAIN ] LION: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:03.101267] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LION took 0.8s. Estimated remaining: 5m 10s. Rate: 215.0 symbols/min [2025-09-28T02:52:03.209136] [DEBUG] [LOCAL ] LITB: Loaded 4436 existing records from primary storage. [2025-09-28T02:52:03.315736] [INFO ] [MAIN ] LITB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:03.376190] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LITB took 0.7s. Estimated remaining: 5m 10s. Rate: 215.0 symbols/min [2025-09-28T02:52:03.518362] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:03.573377] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:03.660012] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:03.795264] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:03.870479] [DEBUG] [LOCAL ] LMND: Loaded 52647 existing records from primary storage. [2025-09-28T02:52:03.885332] [INFO ] [MAIN ] LMND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:03.900096] [DEBUG] [LOCAL ] LMT: Loaded 50608 existing records from primary storage. [2025-09-28T02:52:03.902228] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMND took 0.9s. Estimated remaining: 5m 10s. Rate: 214.8 symbols/min [2025-09-28T02:52:03.902578] [INFO ] [MAIN ] LMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:03.909346] [DEBUG] [LOCAL ] LLY: Loaded 54064 existing records from primary storage. [2025-09-28T02:52:03.926497] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LMT took 0.8s. Estimated remaining: 5m 9s. Rate: 215.0 symbols/min [2025-09-28T02:52:03.946476] [INFO ] [MAIN ] LLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:03.957596] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LLY took 0.9s. Estimated remaining: 5m 9s. Rate: 215.1 symbols/min [2025-09-28T02:52:04.341094] [DEBUG] [LOCAL ] LNC: Loaded 52369 existing records from primary storage. [2025-09-28T02:52:04.414406] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:04.468620] [INFO ] [MAIN ] LNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:04.517176] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:04.522063] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:04.522611] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNC took 1.1s. Estimated remaining: 5m 9s. Rate: 215.0 symbols/min [2025-09-28T02:52:04.541394] [DEBUG] [LOCAL ] LND: Loaded 5013 existing records from primary storage. [2025-09-28T02:52:04.558122] [INFO ] [MAIN ] LND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:04.581283] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 0.7s. Estimated remaining: 5m 8s. Rate: 215.1 symbols/min [2025-09-28T02:52:04.639192] [DEBUG] [LOCAL ] LNN: Loaded 11404 existing records from primary storage. [2025-09-28T02:52:04.727494] [INFO ] [MAIN ] LNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:04.763452] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNN took 0.8s. Estimated remaining: 5m 8s. Rate: 215.2 symbols/min [2025-09-28T02:52:04.927100] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:05.063221] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:05.114330] [DEBUG] [LOCAL ] LNG: Loaded 52224 existing records from primary storage. [2025-09-28T02:52:05.153932] [INFO ] [MAIN ] LNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:05.173707] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:05.174369] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LNG took 1.2s. Estimated remaining: 5m 8s. Rate: 215.1 symbols/min [2025-09-28T02:52:05.250273] [DEBUG] [LOCAL ] LOCL: Loaded 3644 existing records from primary storage. [2025-09-28T02:52:05.272613] [INFO ] [MAIN ] LOCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:05.321471] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LOCL took 0.5s. Estimated remaining: 5m 7s. Rate: 215.2 symbols/min [2025-09-28T02:52:05.329473] [DEBUG] [LOCAL ] LOAR: Loaded 42150 existing records from primary storage. [2025-09-28T02:52:05.390606] [INFO ] [MAIN ] LOAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:05.427064] [DEBUG] [LOCAL ] LOB: Loaded 27886 existing records from primary storage. [2025-09-28T02:52:05.488960] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOAR took 1.0s. Estimated remaining: 5m 7s. Rate: 215.2 symbols/min [2025-09-28T02:52:05.489779] [INFO ] [MAIN ] LOB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:05.501764] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOB took 0.9s. Estimated remaining: 5m 6s. Rate: 215.4 symbols/min [2025-09-28T02:52:05.556454] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:05.866255] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:06.023838] [DEBUG] [LOCAL ] LOMA: Loaded 32576 existing records from primary storage. [2025-09-28T02:52:06.065305] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:06.070348] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:06.071003] [INFO ] [MAIN ] LOMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:06.072635] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LOMA took 0.9s. Estimated remaining: 5m 6s. Rate: 215.2 symbols/min [2025-09-28T02:52:06.232419] [DEBUG] [LOCAL ] LPL: Loaded 26305 existing records from primary storage. [2025-09-28T02:52:06.319751] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:06.320483] [INFO ] [MAIN ] LPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:06.321037] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LPL took 0.7s. Estimated remaining: 5m 6s. Rate: 215.2 symbols/min [2025-09-28T02:52:06.475527] [DEBUG] [LOCAL ] LPG: Loaded 40536 existing records from primary storage. [2025-09-28T02:52:06.477839] [DEBUG] [LOCAL ] LOW: Loaded 53721 existing records from primary storage. [2025-09-28T02:52:06.478751] [INFO ] [MAIN ] LPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:06.479361] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LPG took 1.0s. Estimated remaining: 5m 6s. Rate: 215.3 symbols/min [2025-09-28T02:52:06.479824] [INFO ] [MAIN ] LOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:06.496161] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LOW took 1.2s. Estimated remaining: 5m 5s. Rate: 215.5 symbols/min [2025-09-28T02:52:06.862357] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:06.897164] [DEBUG] [LOCAL ] LPX: Loaded 40311 existing records from primary storage. [2025-09-28T02:52:06.944360] [INFO ] [MAIN ] LPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:06.980542] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:06.996435] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LPX took 0.9s. Estimated remaining: 5m 5s. Rate: 215.3 symbols/min [2025-09-28T02:52:07.052736] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:07.277614] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:07.296670] [DEBUG] [LOCAL ] LRN: Loaded 40503 existing records from primary storage. [2025-09-28T02:52:07.297494] [DEBUG] [LOCAL ] LTC: Loaded 30478 existing records from primary storage. [2025-09-28T02:52:07.309604] [INFO ] [MAIN ] LRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:07.311858] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LRN took 1.0s. Estimated remaining: 5m 5s. Rate: 215.3 symbols/min [2025-09-28T02:52:07.311493] [INFO ] [MAIN ] LTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:07.313448] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LTC took 0.8s. Estimated remaining: 5m 4s. Rate: 215.5 symbols/min [2025-09-28T02:52:07.314489] [DEBUG] [LOCAL ] LSPD: Loaded 43782 existing records from primary storage. [2025-09-28T02:52:07.315473] [INFO ] [MAIN ] LSPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:07.315820] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LSPD took 0.8s. Estimated remaining: 5m 4s. Rate: 215.6 symbols/min [2025-09-28T02:52:07.367683] [DEBUG] [LOCAL ] LTH: Loaded 52563 existing records from primary storage. [2025-09-28T02:52:07.368142] [INFO ] [MAIN ] LTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:07.368253] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 0.3s. Estimated remaining: 5m 3s. Rate: 215.8 symbols/min [2025-09-28T02:52:07.987619] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:08.063559] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:08.183383] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:08.188523] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:08.188921] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-28T02:52:08.190156] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-28T02:52:08.191166] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-28T02:52:08.191321] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-28T02:52:08.191529] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-28T02:52:08.195193] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-28T02:52:08.467868] [DEBUG] [LOCAL ] LTM: Loaded 37076 existing records from primary storage. [2025-09-28T02:52:08.537742] [INFO ] [MAIN ] LTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:08.580989] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LTM took 1.2s. Estimated remaining: 5m 4s. Rate: 215.2 symbols/min [2025-09-28T02:52:08.634514] [DEBUG] [LOCAL ] LU: Loaded 49679 existing records from primary storage. [2025-09-28T02:52:08.675246] [INFO ] [MAIN ] LU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:08.653172] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-09-28T02:52:08.741939] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LU took 1.4s. Estimated remaining: 5m 4s. Rate: 215.3 symbols/min [2025-09-28T02:52:08.742435] [INFO ] [MAIN ] LUMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:08.809898] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LUMN took 1.4s. Estimated remaining: 5m 3s. Rate: 215.4 symbols/min [2025-09-28T02:52:09.050157] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:09.111169] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:09.120028] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-28T02:52:09.313091] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:09.356236] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:09.356628] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-28T02:52:09.356816] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-28T02:52:09.357267] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-28T02:52:09.357370] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-28T02:52:09.357484] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-28T02:52:09.357670] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-28T02:52:09.719664] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-09-28T02:52:09.739363] [INFO ] [MAIN ] LUV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:09.796850] [DEBUG] [LOCAL ] LVS: Loaded 54342 existing records from primary storage. [2025-09-28T02:52:09.802910] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUV took 1.2s. Estimated remaining: 5m 3s. Rate: 215.0 symbols/min [2025-09-28T02:52:09.830458] [INFO ] [MAIN ] LVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:09.831098] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LVS took 1.0s. Estimated remaining: 5m 3s. Rate: 215.1 symbols/min [2025-09-28T02:52:10.268188] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:10.306465] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-28T02:52:10.393158] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-28T02:52:10.485863] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:10.519390] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-28T02:52:10.571024] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:10.571927] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:52:10.573070] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-28T02:52:10.574715] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:52:10.574789] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-09-28T02:52:10.574830] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:52:10.574871] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-28T02:52:10.574938] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-28T02:52:10.574980] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-28T02:52:10.575277] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-28T02:52:10.575419] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LUXE took 1.8s. Estimated remaining: 5m 3s. Rate: 214.9 symbols/min [2025-09-28T02:52:10.680132] [DEBUG] [LOCAL ] LVWR: Loaded 17668 existing records from primary storage. [2025-09-28T02:52:10.714616] [INFO ] [MAIN ] LVWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:10.737637] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LVWR took 0.9s. Estimated remaining: 5m 3s. Rate: 214.9 symbols/min [2025-09-28T02:52:10.846745] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:10.949494] [DEBUG] [LOCAL ] LW: Loaded 51915 existing records from primary storage. [2025-09-28T02:52:10.972273] [INFO ] [MAIN ] LW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:11.005537] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LW took 1.2s. Estimated remaining: 5m 2s. Rate: 214.9 symbols/min [2025-09-28T02:52:11.031047] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:11.098995] [DEBUG] [LOCAL ] LXFR: Loaded 17259 existing records from primary storage. [2025-09-28T02:52:11.114366] [INFO ] [MAIN ] LXFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:11.141709] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LXFR took 0.6s. Estimated remaining: 5m 2s. Rate: 215.0 symbols/min [2025-09-28T02:52:11.348839] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:11.454674] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:11.473251] [DEBUG] [LOCAL ] LXP: Loaded 51361 existing records from primary storage. [2025-09-28T02:52:11.493954] [INFO ] [MAIN ] LXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:11.495462] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-28T02:52:11.495866] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXP took 0.7s. Estimated remaining: 5m 2s. Rate: 215.0 symbols/min [2025-09-28T02:52:11.505075] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-28T02:52:11.640177] [DEBUG] [LOCAL ] LXU: Loaded 32354 existing records from primary storage. [2025-09-28T02:52:11.703495] [INFO ] [MAIN ] LXU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:11.745309] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:11.746121] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXU took 0.7s. Estimated remaining: 5m 1s. Rate: 215.0 symbols/min [2025-09-28T02:52:11.842308] [DEBUG] [LOCAL ] LYB: Loaded 54379 existing records from primary storage. [2025-09-28T02:52:11.865742] [INFO ] [MAIN ] LYB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:11.889396] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LYB took 0.7s. Estimated remaining: 5m 1s. Rate: 215.1 symbols/min [2025-09-28T02:52:12.003567] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:12.209411] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:12.207619] [DEBUG] [LOCAL ] LYG: Loaded 53606 existing records from primary storage. [2025-09-28T02:52:12.210801] [INFO ] [MAIN ] LYG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:12.211394] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 0.7s. Estimated remaining: 5m 1s. Rate: 215.0 symbols/min [2025-09-28T02:52:12.377304] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-28T02:52:12.451671] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:12.475896] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-28T02:52:12.478793] [DEBUG] [LOCAL ] LYV: Loaded 51906 existing records from primary storage. [2025-09-28T02:52:12.480541] [INFO ] [MAIN ] LYV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:12.480815] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYV took 0.7s. Estimated remaining: 5m 0s. Rate: 215.0 symbols/min [2025-09-28T02:52:12.542502] [DEBUG] [LOCAL ] LZB: Loaded 36113 existing records from primary storage. [2025-09-28T02:52:12.583278] [INFO ] [MAIN ] LZB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:12.613995] [DEBUG] [LOCAL ] LZM: Loaded 13905 existing records from primary storage. [2025-09-28T02:52:12.613564] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LZB took 0.7s. Estimated remaining: 5m 0s. Rate: 215.1 symbols/min [2025-09-28T02:52:12.614696] [INFO ] [MAIN ] LZM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:12.630414] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZM took 0.4s. Estimated remaining: 4m 60s. Rate: 215.3 symbols/min [2025-09-28T02:52:12.824007] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:13.031685] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:13.106261] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:13.153674] [DEBUG] [LOCAL ] M: Loaded 54315 existing records from primary storage. [2025-09-28T02:52:13.154603] [INFO ] [MAIN ] M: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:13.155255] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. M took 0.7s. Estimated remaining: 4m 60s. Rate: 215.1 symbols/min [2025-09-28T02:52:13.308715] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-28T02:52:13.357714] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-28T02:52:13.414967] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:13.431503] [DEBUG] [LOCAL ] MAA: Loaded 43354 existing records from primary storage. [2025-09-28T02:52:13.434824] [INFO ] [MAIN ] MAA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:13.435150] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MAA took 0.8s. Estimated remaining: 4m 59s. Rate: 215.1 symbols/min [2025-09-28T02:52:13.457979] [DEBUG] [LOCAL ] MA: Loaded 53329 existing records from primary storage. [2025-09-28T02:52:13.485519] [INFO ] [MAIN ] MA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:13.526834] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. MA took 0.9s. Estimated remaining: 4m 59s. Rate: 215.3 symbols/min [2025-09-28T02:52:13.750456] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:13.901415] [DEBUG] [LOCAL ] MAC: Loaded 50469 existing records from primary storage. [2025-09-28T02:52:13.922782] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:13.924786] [INFO ] [MAIN ] MAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:13.925351] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAC took 0.8s. Estimated remaining: 4m 59s. Rate: 215.2 symbols/min [2025-09-28T02:52:14.137682] [DEBUG] [LOCAL ] MAGN: Loaded 35466 existing records from primary storage. [2025-09-28T02:52:14.136241] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:14.148915] [INFO ] [MAIN ] MAGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:14.150966] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAGN took 0.7s. Estimated remaining: 4m 58s. Rate: 215.2 symbols/min [2025-09-28T02:52:14.193565] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-28T02:52:14.266369] [DEBUG] [LOCAL ] MAIN: Loaded 41929 existing records from primary storage. [2025-09-28T02:52:14.299977] [INFO ] [MAIN ] MAIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:14.273564] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-28T02:52:14.313573] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAIN took 0.7s. Estimated remaining: 4m 58s. Rate: 215.3 symbols/min [2025-09-28T02:52:14.494739] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:14.564240] [DEBUG] [LOCAL ] MAN: Loaded 44216 existing records from primary storage. [2025-09-28T02:52:14.597116] [INFO ] [MAIN ] MAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:14.617939] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:14.618680] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MAN took 0.7s. Estimated remaining: 4m 58s. Rate: 215.3 symbols/min [2025-09-28T02:52:14.774633] [DEBUG] [LOCAL ] MANU: Loaded 27544 existing records from primary storage. [2025-09-28T02:52:14.816855] [INFO ] [MAIN ] MANU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:14.838371] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:14.838525] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MANU took 0.7s. Estimated remaining: 4m 57s. Rate: 215.3 symbols/min [2025-09-28T02:52:15.040548] [DEBUG] [LOCAL ] MAS: Loaded 53102 existing records from primary storage. [2025-09-28T02:52:15.096610] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:15.096819] [INFO ] [MAIN ] MAS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:15.098202] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MAS took 0.8s. Estimated remaining: 4m 57s. Rate: 215.3 symbols/min [2025-09-28T02:52:15.180099] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-28T02:52:15.222188] [DEBUG] [LOCAL ] MATV: Loaded 37964 existing records from primary storage. [2025-09-28T02:52:15.243135] [INFO ] [MAIN ] MATV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:15.258177] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MATV took 0.6s. Estimated remaining: 4m 57s. Rate: 215.4 symbols/min [2025-09-28T02:52:15.268826] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-28T02:52:15.426289] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:15.505181] [DEBUG] [LOCAL ] MATX: Loaded 31851 existing records from primary storage. [2025-09-28T02:52:15.532866] [INFO ] [MAIN ] MATX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:15.564328] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATX took 0.7s. Estimated remaining: 4m 56s. Rate: 215.4 symbols/min [2025-09-28T02:52:15.636543] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:15.751925] [DEBUG] [LOCAL ] MAX: Loaded 31209 existing records from primary storage. [2025-09-28T02:52:15.774502] [INFO ] [MAIN ] MAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:15.847083] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MAX took 0.7s. Estimated remaining: 4m 56s. Rate: 215.4 symbols/min [2025-09-28T02:52:15.853910] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:15.992425] [DEBUG] [LOCAL ] MBC: Loaded 43803 existing records from primary storage. [2025-09-28T02:52:16.046172] [INFO ] [MAIN ] MBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:16.071156] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:16.071356] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MBC took 0.8s. Estimated remaining: 4m 56s. Rate: 215.4 symbols/min [2025-09-28T02:52:16.147126] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-28T02:52:16.157785] [DEBUG] [LOCAL ] MBI: Loaded 24930 existing records from primary storage. [2025-09-28T02:52:16.215771] [INFO ] [MAIN ] MBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:16.220771] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-28T02:52:16.221318] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBI took 0.7s. Estimated remaining: 4m 55s. Rate: 215.5 symbols/min [2025-09-28T02:52:16.393768] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:16.518124] [DEBUG] [LOCAL ] MC: Loaded 44878 existing records from primary storage. [2025-09-28T02:52:16.541415] [INFO ] [MAIN ] MC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:16.552595] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MC took 0.7s. Estimated remaining: 4m 55s. Rate: 215.4 symbols/min [2025-09-28T02:52:16.552083] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:16.559261] [DEBUG] [LOCAL ] MCB: Loaded 11834 existing records from primary storage. [2025-09-28T02:52:16.558799] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-28T02:52:16.560019] [INFO ] [MAIN ] MCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:16.560161] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MCB took 0.5s. Estimated remaining: 4m 55s. Rate: 215.6 symbols/min [2025-09-28T02:52:16.559812] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-28T02:52:16.582631] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-28T02:52:16.595053] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-28T02:52:16.651403] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-28T02:52:16.704540] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-28T02:52:17.061048] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:17.057241] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:17.066606] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-28T02:52:17.161548] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-28T02:52:17.275914] [DEBUG] [LOCAL ] MCI: Loaded 6477 existing records from primary storage. [2025-09-28T02:52:17.292206] [INFO ] [MAIN ] MCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:17.320850] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MCI took 0.8s. Estimated remaining: 4m 55s. Rate: 215.3 symbols/min [2025-09-28T02:52:17.376822] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:17.429631] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-28T02:52:17.527093] [DEBUG] [LOCAL ] MCK: Loaded 39985 existing records from primary storage. [2025-09-28T02:52:17.578633] [INFO ] [MAIN ] MCK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:17.587370] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCK took 1.0s. Estimated remaining: 4m 55s. Rate: 215.3 symbols/min [2025-09-28T02:52:17.608079] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:17.727373] [DEBUG] [LOCAL ] MCN: Loaded 8231 existing records from primary storage. [2025-09-28T02:52:17.776981] [INFO ] [MAIN ] MCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:17.800357] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCN took 0.4s. Estimated remaining: 4m 54s. Rate: 215.4 symbols/min [2025-09-28T02:52:17.807331] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:17.906297] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-28T02:52:17.949102] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-28T02:52:18.036080] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:18.069948] [DEBUG] [LOCAL ] MCO: Loaded 40102 existing records from primary storage. [2025-09-28T02:52:18.070425] [INFO ] [MAIN ] MCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:18.070535] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCO took 0.5s. Estimated remaining: 4m 54s. Rate: 215.4 symbols/min [2025-09-28T02:52:18.160390] [DEBUG] [LOCAL ] MCR: Loaded 8858 existing records from primary storage. [2025-09-28T02:52:18.166257] [INFO ] [MAIN ] MCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:18.179398] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCR took 0.4s. Estimated remaining: 4m 54s. Rate: 215.5 symbols/min [2025-09-28T02:52:18.268418] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:18.294787] [DEBUG] [LOCAL ] MCS: Loaded 21454 existing records from primary storage. [2025-09-28T02:52:18.295112] [INFO ] [MAIN ] MCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:18.295216] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCS took 0.2s. Estimated remaining: 4m 53s. Rate: 215.6 symbols/min [2025-09-28T02:52:18.355273] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-28T02:52:18.366935] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-28T02:52:18.573274] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-28T02:52:18.578373] [INFO ] [REMOTE ] LUCK: Full fetch complete (40658 records). [2025-09-28T02:52:18.578527] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-28T02:52:18.782888] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:52:18.783709] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:52:18.783791] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:52:18.783902] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-28T02:52:18.784007] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-28T02:52:18.784094] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-28T02:52:18.784182] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-28T02:52:18.784297] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. LUCK took 11.4s. Estimated remaining: 4m 53s. Rate: 215.4 symbols/min [2025-09-28T02:52:19.128114] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-28T02:52:19.139173] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-28T02:52:19.955095] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-28T02:52:19.966302] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-28T02:52:20.861464] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-28T02:52:20.873438] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-28T02:52:21.286901] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-28T02:52:21.298716] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-28T02:52:22.147594] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-28T02:52:22.159232] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-28T02:52:23.137006] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-28T02:52:23.148417] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-28T02:52:24.035139] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-28T02:52:24.047308] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-28T02:52:24.888735] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-28T02:52:24.900857] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-28T02:52:25.712876] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-28T02:52:25.722894] [INFO ] [REMOTE ] MCD: Full fetch complete (77031 records). [2025-09-28T02:52:25.723058] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-28T02:52:25.928540] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:52:25.929589] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:52:25.929697] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:52:25.929780] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-28T02:52:25.929889] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-28T02:52:25.929979] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-28T02:52:25.930083] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-28T02:52:25.930339] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCD took 9.7s. Estimated remaining: 4m 58s. Rate: 211.5 symbols/min [2025-09-28T02:52:26.550619] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:26.604581] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:26.672406] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:26.734040] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:26.742065] [DEBUG] [LOCAL ] MDST: Loaded 5688 existing records from primary storage. [2025-09-28T02:52:26.743366] [INFO ] [MAIN ] MDST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:26.743687] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 0.8s. Estimated remaining: 4m 58s. Rate: 211.2 symbols/min [2025-09-28T02:52:26.880013] [DEBUG] [LOCAL ] MCY: Loaded 25345 existing records from primary storage. [2025-09-28T02:52:26.926883] [INFO ] [MAIN ] MCY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:26.936111] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MCY took 1.0s. Estimated remaining: 4m 58s. Rate: 211.2 symbols/min [2025-09-28T02:52:27.053908] [DEBUG] [LOCAL ] MD: Loaded 39064 existing records from primary storage. [2025-09-28T02:52:27.052937] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:27.078191] [INFO ] [MAIN ] MD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:27.092813] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MD took 1.2s. Estimated remaining: 4m 58s. Rate: 211.3 symbols/min [2025-09-28T02:52:27.077707] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-09-28T02:52:27.146575] [INFO ] [MAIN ] MDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:27.217901] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 1.3s. Estimated remaining: 4m 57s. Rate: 211.4 symbols/min [2025-09-28T02:52:27.509361] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:27.531931] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:27.633479] [DEBUG] [LOCAL ] MDU: Loaded 48643 existing records from primary storage. [2025-09-28T02:52:27.637944] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:27.647630] [DEBUG] [LOCAL ] MDV: Loaded 8733 existing records from primary storage. [2025-09-28T02:52:27.648055] [INFO ] [MAIN ] MDU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:27.648921] [INFO ] [MAIN ] MDV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:27.649269] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDU took 0.9s. Estimated remaining: 4m 57s. Rate: 211.3 symbols/min [2025-09-28T02:52:27.649714] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MDV took 0.7s. Estimated remaining: 4m 56s. Rate: 211.5 symbols/min [2025-09-28T02:52:27.757162] [DEBUG] [LOCAL ] MEC: Loaded 16695 existing records from primary storage. [2025-09-28T02:52:27.817412] [INFO ] [MAIN ] MEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:27.827714] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MEC took 0.7s. Estimated remaining: 4m 56s. Rate: 211.5 symbols/min [2025-09-28T02:52:27.917767] [DEBUG] [LOCAL ] MED: Loaded 22043 existing records from primary storage. [2025-09-28T02:52:27.975154] [INFO ] [MAIN ] MED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:28.069322] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MED took 0.8s. Estimated remaining: 4m 56s. Rate: 211.6 symbols/min [2025-09-28T02:52:28.239285] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:28.245757] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:28.364298] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:28.480365] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:28.512623] [DEBUG] [LOCAL ] MEGI: Loaded 20630 existing records from primary storage. [2025-09-28T02:52:28.513923] [DEBUG] [LOCAL ] MEG: Loaded 32426 existing records from primary storage. [2025-09-28T02:52:28.514514] [INFO ] [MAIN ] MEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:28.514753] [INFO ] [MAIN ] MEGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:28.515254] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEG took 0.9s. Estimated remaining: 4m 56s. Rate: 211.5 symbols/min [2025-09-28T02:52:28.515572] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEGI took 0.9s. Estimated remaining: 4m 55s. Rate: 211.6 symbols/min [2025-09-28T02:52:28.612557] [DEBUG] [LOCAL ] MEI: Loaded 32933 existing records from primary storage. [2025-09-28T02:52:28.706486] [INFO ] [MAIN ] MEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:28.734943] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MEI took 0.9s. Estimated remaining: 4m 55s. Rate: 211.7 symbols/min [2025-09-28T02:52:28.916234] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:29.058534] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:29.060904] [DEBUG] [LOCAL ] MET: Loaded 54089 existing records from primary storage. [2025-09-28T02:52:29.066886] [INFO ] [MAIN ] MET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:29.067126] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MET took 1.0s. Estimated remaining: 4m 55s. Rate: 211.6 symbols/min [2025-09-28T02:52:29.180556] [DEBUG] [LOCAL ] MFAN: Loaded 4331 existing records from primary storage. [2025-09-28T02:52:29.210779] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:29.216767] [INFO ] [MAIN ] MFAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:29.237756] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MFAN took 0.7s. Estimated remaining: 4m 54s. Rate: 211.7 symbols/min [2025-09-28T02:52:29.416296] [DEBUG] [LOCAL ] MFAO: Loaded 3853 existing records from primary storage. [2025-09-28T02:52:29.415921] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:29.452809] [INFO ] [MAIN ] MFAO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:29.465992] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAO took 0.7s. Estimated remaining: 4m 54s. Rate: 211.7 symbols/min [2025-09-28T02:52:29.524295] [DEBUG] [LOCAL ] MFA: Loaded 46019 existing records from primary storage. [2025-09-28T02:52:29.556738] [INFO ] [MAIN ] MFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:29.615178] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFA took 1.1s. Estimated remaining: 4m 53s. Rate: 211.8 symbols/min [2025-09-28T02:52:29.700222] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:29.898327] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:30.005958] [DEBUG] [LOCAL ] MFC: Loaded 52000 existing records from primary storage. [2025-09-28T02:52:30.038900] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:30.036218] [INFO ] [MAIN ] MFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:30.041594] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFC took 1.0s. Estimated remaining: 4m 53s. Rate: 211.7 symbols/min [2025-09-28T02:52:30.041942] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-28T02:52:30.067266] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-28T02:52:30.077902] [DEBUG] [LOCAL ] MFG: Loaded 49748 existing records from primary storage. [2025-09-28T02:52:30.099284] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-28T02:52:30.099634] [INFO ] [MAIN ] MFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:30.111061] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-28T02:52:30.141454] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFG took 0.9s. Estimated remaining: 4m 53s. Rate: 211.8 symbols/min [2025-09-28T02:52:30.151996] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-28T02:52:30.183697] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-28T02:52:30.191205] [DEBUG] [LOCAL ] MFM: Loaded 14390 existing records from primary storage. [2025-09-28T02:52:30.243318] [INFO ] [MAIN ] MFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:30.264285] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFM took 0.8s. Estimated remaining: 4m 52s. Rate: 211.9 symbols/min [2025-09-28T02:52:30.584023] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:30.743047] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:30.883837] [DEBUG] [LOCAL ] MFSG: Loaded 5267 existing records from primary storage. [2025-09-28T02:52:30.888797] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:30.916177] [INFO ] [MAIN ] MFSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:30.940872] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFSG took 0.9s. Estimated remaining: 4m 52s. Rate: 211.7 symbols/min [2025-09-28T02:52:30.995072] [DEBUG] [LOCAL ] MFSV: Loaded 2514 existing records from primary storage. [2025-09-28T02:52:31.045872] [DEBUG] [LOCAL ] MFSI: Loaded 11358 existing records from primary storage. [2025-09-28T02:52:31.029824] [INFO ] [MAIN ] MFSV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:31.081626] [INFO ] [MAIN ] MFSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:31.093123] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSV took 0.8s. Estimated remaining: 4m 52s. Rate: 211.8 symbols/min [2025-09-28T02:52:31.182152] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSI took 1.0s. Estimated remaining: 4m 52s. Rate: 211.9 symbols/min [2025-09-28T02:52:31.308452] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:31.458408] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-28T02:52:31.459754] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:31.612438] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:31.670138] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:31.673534] [DEBUG] [LOCAL ] MG: Loaded 16832 existing records from primary storage. [2025-09-28T02:52:31.678524] [INFO ] [MAIN ] MG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:31.678769] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MG took 0.7s. Estimated remaining: 4m 52s. Rate: 211.8 symbols/min [2025-09-28T02:52:31.751584] [DEBUG] [LOCAL ] MGF: Loaded 4186 existing records from primary storage. [2025-09-28T02:52:31.801287] [INFO ] [MAIN ] MGF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:31.809226] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-28T02:52:31.801542] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MGF took 0.5s. Estimated remaining: 4m 51s. Rate: 211.9 symbols/min [2025-09-28T02:52:31.811739] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-28T02:52:32.002178] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:32.044866] [DEBUG] [LOCAL ] MGA: Loaded 51414 existing records from primary storage. [2025-09-28T02:52:32.087782] [INFO ] [MAIN ] MGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:32.109162] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:32.109965] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGA took 1.0s. Estimated remaining: 4m 51s. Rate: 211.8 symbols/min [2025-09-28T02:52:32.202900] [DEBUG] [LOCAL ] MGR: Loaded 5675 existing records from primary storage. [2025-09-28T02:52:32.218755] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-28T02:52:32.233890] [INFO ] [MAIN ] MGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:32.245330] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-28T02:52:32.268723] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGR took 0.5s. Estimated remaining: 4m 51s. Rate: 211.9 symbols/min [2025-09-28T02:52:32.385274] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:32.455620] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-28T02:52:32.459508] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-28T02:52:32.458479] [DEBUG] [LOCAL ] MGM: Loaded 54388 existing records from primary storage. [2025-09-28T02:52:32.462398] [INFO ] [MAIN ] MGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:32.482956] [DEBUG] [LOCAL ] MGRB: Loaded 4102 existing records from primary storage. [2025-09-28T02:52:32.488920] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGM took 0.8s. Estimated remaining: 4m 50s. Rate: 211.9 symbols/min [2025-09-28T02:52:32.526048] [INFO ] [MAIN ] MGRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:32.539798] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGRB took 0.4s. Estimated remaining: 4m 50s. Rate: 212.1 symbols/min [2025-09-28T02:52:32.570254] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:32.737458] [DEBUG] [LOCAL ] MGRD: Loaded 2231 existing records from primary storage. [2025-09-28T02:52:32.742737] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-28T02:52:32.753457] [INFO ] [MAIN ] MGRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:32.782736] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MGRD took 0.5s. Estimated remaining: 4m 49s. Rate: 212.1 symbols/min [2025-09-28T02:52:32.803456] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-28T02:52:32.870788] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:33.043688] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:33.063194] [DEBUG] [LOCAL ] MGRE: Loaded 6684 existing records from primary storage. [2025-09-28T02:52:33.074035] [INFO ] [MAIN ] MGRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:33.112092] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MGRE took 0.6s. Estimated remaining: 4m 49s. Rate: 212.1 symbols/min [2025-09-28T02:52:33.131989] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:33.176548] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-28T02:52:33.190868] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-28T02:52:33.214818] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-28T02:52:33.230838] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-28T02:52:33.246922] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-28T02:52:33.237186] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-28T02:52:33.248742] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-28T02:52:33.248906] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-28T02:52:33.429992] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:33.500278] [DEBUG] [LOCAL ] MGY: Loaded 53195 existing records from primary storage. [2025-09-28T02:52:33.525790] [INFO ] [MAIN ] MGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:33.568673] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGY took 1.0s. Estimated remaining: 4m 49s. Rate: 212.0 symbols/min [2025-09-28T02:52:33.565145] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-28T02:52:33.583631] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-28T02:52:33.693586] [DEBUG] [LOCAL ] MHD: Loaded 12297 existing records from primary storage. [2025-09-28T02:52:33.761166] [INFO ] [MAIN ] MHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:33.807876] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MHD took 0.7s. Estimated remaining: 4m 49s. Rate: 212.0 symbols/min [2025-09-28T02:52:34.086801] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-28T02:52:34.045949] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:34.096175] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:34.111041] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-28T02:52:34.112159] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-28T02:52:34.221289] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:34.217173] [DEBUG] [LOCAL ] MHF: Loaded 8713 existing records from primary storage. [2025-09-28T02:52:34.221920] [INFO ] [MAIN ] MHF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:34.222025] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MHF took 0.6s. Estimated remaining: 4m 48s. Rate: 211.9 symbols/min [2025-09-28T02:52:34.289754] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:52:34.313733] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-28T02:52:34.332731] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:52:34.332899] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-09-28T02:52:34.332979] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:52:34.333086] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-28T02:52:34.333204] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-28T02:52:34.333850] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-28T02:52:34.349892] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-28T02:52:34.381191] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MH took 1.6s. Estimated remaining: 4m 48s. Rate: 212.0 symbols/min [2025-09-28T02:52:34.409668] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:34.432345] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-28T02:52:34.452545] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-28T02:52:34.459629] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-28T02:52:34.466500] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-28T02:52:34.491002] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-28T02:52:34.501393] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-28T02:52:34.556714] [DEBUG] [LOCAL ] MHK: Loaded 43076 existing records from primary storage. [2025-09-28T02:52:34.560936] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-28T02:52:34.562184] [INFO ] [MAIN ] MHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:34.567583] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-28T02:52:34.567694] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MHK took 0.7s. Estimated remaining: 4m 48s. Rate: 212.0 symbols/min [2025-09-28T02:52:34.777902] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:34.912629] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-28T02:52:34.976416] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-28T02:52:35.100219] [DEBUG] [LOCAL ] MHN: Loaded 7867 existing records from primary storage. [2025-09-28T02:52:35.099764] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:35.129119] [INFO ] [MAIN ] MHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:35.150852] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MHN took 0.7s. Estimated remaining: 4m 48s. Rate: 211.9 symbols/min [2025-09-28T02:52:35.380778] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:35.404855] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-28T02:52:35.411698] [DEBUG] [LOCAL ] MHO: Loaded 24650 existing records from primary storage. [2025-09-28T02:52:35.488112] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:35.492238] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-28T02:52:35.488412] [INFO ] [MAIN ] MHO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:35.492503] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-28T02:52:35.492708] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MHO took 0.9s. Estimated remaining: 4m 47s. Rate: 211.8 symbols/min [2025-09-28T02:52:35.494483] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-28T02:52:35.494250] [INFO ] [REMOTE ] MFSB: Full fetch complete (1610 records). [2025-09-28T02:52:35.500827] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-28T02:52:35.501007] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-28T02:52:35.546391] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-28T02:52:35.556999] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-28T02:52:35.649057] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-28T02:52:35.755080] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-28T02:52:35.794282] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-28T02:52:35.900371] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:35.980092] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-28T02:52:35.986373] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:52:36.007381] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:52:36.007558] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-28T02:52:36.013346] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-28T02:52:36.052725] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-28T02:52:36.052969] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-28T02:52:36.053131] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MFSB took 6.4s. Estimated remaining: 4m 47s. Rate: 211.7 symbols/min [2025-09-28T02:52:36.080688] [DEBUG] [LOCAL ] MIN: Loaded 13224 existing records from primary storage. [2025-09-28T02:52:36.111734] [INFO ] [MAIN ] MIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:36.173011] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MIN took 0.7s. Estimated remaining: 4m 47s. Rate: 211.8 symbols/min [2025-09-28T02:52:36.198381] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-28T02:52:36.211157] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-28T02:52:36.293854] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:36.294212] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-28T02:52:36.473127] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-28T02:52:36.473300] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:52:36.474515] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-28T02:52:36.474799] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-28T02:52:36.475590] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:52:36.475689] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-09-28T02:52:36.475757] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:52:36.475843] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-28T02:52:36.475949] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-28T02:52:36.476028] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-28T02:52:36.476121] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-28T02:52:36.476216] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MIAX took 1.3s. Estimated remaining: 4m 47s. Rate: 211.8 symbols/min [2025-09-28T02:52:36.892867] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-28T02:52:36.893985] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-28T02:52:37.189409] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-28T02:52:37.190531] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-28T02:52:37.572397] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-28T02:52:37.574251] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-28T02:52:37.790514] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-28T02:52:37.791589] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-28T02:52:37.934930] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.14 seconds). [2025-09-28T02:52:37.935992] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-28T02:52:38.081314] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.15 seconds). [2025-09-28T02:52:38.082356] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-28T02:52:38.464779] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-28T02:52:38.465635] [INFO ] [REMOTE ] MHLA: Full fetch complete (1547 records). [2025-09-28T02:52:38.465755] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-28T02:52:38.651554] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-28T02:52:38.651773] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:52:38.651849] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:52:38.651926] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-28T02:52:38.652070] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-28T02:52:38.652147] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-28T02:52:38.652234] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-28T02:52:38.652339] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MHLA took 4.4s. Estimated remaining: 4m 48s. Rate: 210.7 symbols/min [2025-09-28T02:52:39.260125] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:39.311221] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:39.362711] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:39.415332] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:39.416025] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-28T02:52:39.417241] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-28T02:52:39.417877] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-28T02:52:39.426161] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-28T02:52:39.427746] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-28T02:52:39.428081] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-28T02:52:39.462905] [DEBUG] [LOCAL ] MITP: Loaded 2467 existing records from primary storage. [2025-09-28T02:52:39.505340] [INFO ] [MAIN ] MITP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:39.515871] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITP took 0.9s. Estimated remaining: 4m 48s. Rate: 210.4 symbols/min [2025-09-28T02:52:39.636600] [DEBUG] [LOCAL ] MITT: Loaded 23379 existing records from primary storage. [2025-09-28T02:52:39.740817] [INFO ] [MAIN ] MITT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:39.814242] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MITT took 1.1s. Estimated remaining: 4m 48s. Rate: 210.4 symbols/min [2025-09-28T02:52:40.011613] [DEBUG] [LOCAL ] MIR: Loaded 51622 existing records from primary storage. [2025-09-28T02:52:40.035509] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:40.051489] [INFO ] [MAIN ] MIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:40.062529] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MIR took 1.4s. Estimated remaining: 4m 47s. Rate: 210.4 symbols/min [2025-09-28T02:52:40.308494] [DEBUG] [LOCAL ] MIY: Loaded 6084 existing records from primary storage. [2025-09-28T02:52:40.326033] [INFO ] [MAIN ] MIY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:40.352204] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:40.325738] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:40.361203] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-28T02:52:40.360795] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MIY took 0.8s. Estimated remaining: 4m 47s. Rate: 210.4 symbols/min [2025-09-28T02:52:40.570699] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:40.629156] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:40.687393] [DEBUG] [LOCAL ] MKC: Loaded 53204 existing records from primary storage. [2025-09-28T02:52:40.688047] [INFO ] [MAIN ] MKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:40.688176] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MKC took 0.8s. Estimated remaining: 4m 47s. Rate: 210.4 symbols/min [2025-09-28T02:52:40.804162] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-28T02:52:40.816355] [DEBUG] [LOCAL ] MKL: Loaded 34588 existing records from primary storage. [2025-09-28T02:52:40.825362] [INFO ] [MAIN ] MKL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:40.826593] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-28T02:52:40.827330] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKL took 0.7s. Estimated remaining: 4m 46s. Rate: 210.5 symbols/min [2025-09-28T02:52:41.002525] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:41.031449] [DEBUG] [LOCAL ] MLI: Loaded 44447 existing records from primary storage. [2025-09-28T02:52:41.054212] [INFO ] [MAIN ] MLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:41.089525] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLI took 0.7s. Estimated remaining: 4m 46s. Rate: 210.5 symbols/min [2025-09-28T02:52:41.110549] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:41.235023] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-28T02:52:41.240450] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-28T02:52:41.328579] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:41.338010] [DEBUG] [LOCAL ] MLM: Loaded 31068 existing records from primary storage. [2025-09-28T02:52:41.338590] [INFO ] [MAIN ] MLM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:41.339516] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLM took 0.7s. Estimated remaining: 4m 46s. Rate: 210.5 symbols/min [2025-09-28T02:52:41.461234] [DEBUG] [LOCAL ] MLP: Loaded 3120 existing records from primary storage. [2025-09-28T02:52:41.466250] [DEBUG] [LOCAL ] MLNK: Loaded 25921 existing records from primary storage. [2025-09-28T02:52:41.466578] [INFO ] [MAIN ] MLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:41.467980] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MLP took 0.4s. Estimated remaining: 4m 45s. Rate: 210.6 symbols/min [2025-09-28T02:52:41.467337] [INFO ] [MAIN ] MLNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:41.473476] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLNK took 0.6s. Estimated remaining: 4m 45s. Rate: 210.8 symbols/min [2025-09-28T02:52:41.674462] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:41.733668] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-28T02:52:41.776425] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-28T02:52:41.877762] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:41.947782] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:41.948679] [DEBUG] [LOCAL ] MLR: Loaded 12982 existing records from primary storage. [2025-09-28T02:52:41.950925] [INFO ] [MAIN ] MLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:41.951036] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLR took 0.6s. Estimated remaining: 4m 45s. Rate: 210.6 symbols/min [2025-09-28T02:52:42.078747] [DEBUG] [LOCAL ] MMD: Loaded 11435 existing records from primary storage. [2025-09-28T02:52:42.090561] [INFO ] [MAIN ] MMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:42.107035] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MMD took 0.6s. Estimated remaining: 4m 44s. Rate: 210.7 symbols/min [2025-09-28T02:52:42.165273] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:42.299525] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-28T02:52:42.347213] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-28T02:52:42.377893] [DEBUG] [LOCAL ] MMC: Loaded 52551 existing records from primary storage. [2025-09-28T02:52:42.408889] [INFO ] [MAIN ] MMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:42.403176] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:42.409812] [DEBUG] [LOCAL ] MMI: Loaded 15452 existing records from primary storage. [2025-09-28T02:52:42.410523] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMC took 0.9s. Estimated remaining: 4m 44s. Rate: 210.7 symbols/min [2025-09-28T02:52:42.410718] [INFO ] [MAIN ] MMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:42.410845] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-09-28T02:52:42.411061] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-09-28T02:52:42.416510] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMI took 0.5s. Estimated remaining: 4m 44s. Rate: 210.9 symbols/min [2025-09-28T02:52:42.456486] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-09-28T02:52:42.569547] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-28T02:52:42.599371] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-28T02:52:42.622440] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-09-28T02:52:42.794078] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:42.849667] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-28T02:52:42.890963] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:42.891247] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-28T02:52:42.892547] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-28T02:52:42.849910] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-28T02:52:42.900777] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-28T02:52:42.900180] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-28T02:52:42.943393] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-28T02:52:42.958196] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-28T02:52:43.185174] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-28T02:52:43.218690] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-28T02:52:43.425895] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:43.474835] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-28T02:52:43.525915] [DEBUG] [LOCAL ] MMM: Loaded 53995 existing records from primary storage. [2025-09-28T02:52:43.553136] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-28T02:52:43.558700] [INFO ] [MAIN ] MMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:43.586387] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMM took 1.1s. Estimated remaining: 4m 44s. Rate: 210.4 symbols/min [2025-09-28T02:52:43.592553] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-28T02:52:43.628362] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:43.676326] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-28T02:52:43.695112] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:52:43.737359] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-28T02:52:43.737683] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:52:43.743640] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-09-28T02:52:43.759526] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:52:43.786226] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-28T02:52:43.793103] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-28T02:52:43.793894] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-09-28T02:52:43.795328] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-09-28T02:52:43.813850] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:43.814052] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMID took 1.7s. Estimated remaining: 4m 44s. Rate: 210.4 symbols/min [2025-09-28T02:52:43.921172] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-28T02:52:43.934199] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-28T02:52:44.031157] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:44.046045] [DEBUG] [LOCAL ] MMS: Loaded 34398 existing records from primary storage. [2025-09-28T02:52:44.046396] [INFO ] [MAIN ] MMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:44.047255] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMS took 0.5s. Estimated remaining: 4m 43s. Rate: 210.4 symbols/min [2025-09-28T02:52:44.080344] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-28T02:52:44.096005] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-28T02:52:44.138077] [DEBUG] [LOCAL ] MMT: Loaded 10987 existing records from primary storage. [2025-09-28T02:52:44.175272] [INFO ] [MAIN ] MMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:44.183933] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-28T02:52:44.189119] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMT took 0.4s. Estimated remaining: 4m 43s. Rate: 210.5 symbols/min [2025-09-28T02:52:44.214585] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-28T02:52:44.354372] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:44.474213] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:44.478524] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-28T02:52:44.480477] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-28T02:52:44.488661] [DEBUG] [LOCAL ] MMU: Loaded 17156 existing records from primary storage. [2025-09-28T02:52:44.489539] [INFO ] [MAIN ] MMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:44.489732] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMU took 0.4s. Estimated remaining: 4m 43s. Rate: 210.5 symbols/min [2025-09-28T02:52:44.682353] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:44.682505] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-28T02:52:44.699243] [DEBUG] [LOCAL ] MNR: Loaded 24918 existing records from primary storage. [2025-09-28T02:52:44.697713] [INFO ] [REMOTE ] MITN: Full fetch complete (2309 records). [2025-09-28T02:52:44.699842] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-28T02:52:44.700031] [INFO ] [MAIN ] MNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:44.713153] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MNR took 0.5s. Estimated remaining: 4m 42s. Rate: 210.5 symbols/min [2025-09-28T02:52:44.817804] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-28T02:52:44.828953] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-28T02:52:45.086307] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:45.129668] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-28T02:52:45.136919] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:52:45.137078] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-28T02:52:45.138751] [DEBUG] [LOCAL ] MNSO: Loaded 45049 existing records from primary storage. [2025-09-28T02:52:45.139174] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-28T02:52:45.139559] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-28T02:52:45.139346] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:52:45.139714] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-28T02:52:45.139881] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:52:45.140091] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-28T02:52:45.140268] [INFO ] [MAIN ] MNSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:45.140327] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-28T02:52:45.168745] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MNSO took 0.7s. Estimated remaining: 4m 42s. Rate: 210.5 symbols/min [2025-09-28T02:52:45.180821] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-28T02:52:45.181102] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-28T02:52:45.258459] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-28T02:52:45.247442] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-28T02:52:45.296368] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MITN took 6.6s. Estimated remaining: 4m 42s. Rate: 210.5 symbols/min [2025-09-28T02:52:45.355576] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-28T02:52:45.624356] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:45.715323] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-28T02:52:45.772566] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-28T02:52:45.817400] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:45.789253] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-28T02:52:45.808620] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-28T02:52:45.818957] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-28T02:52:45.824452] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-28T02:52:45.838460] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-28T02:52:45.838723] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-28T02:52:46.012798] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:46.037633] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-28T02:52:46.223249] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:52:46.217286] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-28T02:52:46.263490] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-28T02:52:46.263859] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-28T02:52:46.272540] [DEBUG] [LOCAL ] MOD: Loaded 46169 existing records from primary storage. [2025-09-28T02:52:46.264076] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:52:46.288695] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-09-28T02:52:46.288955] [INFO ] [MAIN ] MOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:46.314945] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MOD took 1.0s. Estimated remaining: 4m 42s. Rate: 210.1 symbols/min [2025-09-28T02:52:46.294307] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:52:46.403833] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-28T02:52:46.421704] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-28T02:52:46.398558] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:46.421882] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-28T02:52:46.435865] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-28T02:52:46.422364] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-28T02:52:46.436068] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MNTN took 1.7s. Estimated remaining: 4m 42s. Rate: 210.2 symbols/min [2025-09-28T02:52:46.564123] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-28T02:52:46.617952] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-28T02:52:46.717451] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:46.792606] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:46.858627] [DEBUG] [LOCAL ] MODG: Loaded 52353 existing records from primary storage. [2025-09-28T02:52:46.859200] [INFO ] [MAIN ] MODG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:46.859310] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MODG took 0.5s. Estimated remaining: 4m 42s. Rate: 210.2 symbols/min [2025-09-28T02:52:46.977530] [DEBUG] [LOCAL ] MOH: Loaded 42444 existing records from primary storage. [2025-09-28T02:52:46.998832] [INFO ] [MAIN ] MOH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:47.004744] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MOH took 0.5s. Estimated remaining: 4m 41s. Rate: 210.2 symbols/min [2025-09-28T02:52:47.133434] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:47.264404] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:47.309031] [DEBUG] [LOCAL ] MOV: Loaded 22417 existing records from primary storage. [2025-09-28T02:52:47.309836] [INFO ] [MAIN ] MOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:47.310166] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MOV took 0.3s. Estimated remaining: 4m 41s. Rate: 210.2 symbols/min [2025-09-28T02:52:47.391357] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-28T02:52:47.404110] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-28T02:52:47.458837] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-28T02:52:47.479313] [DEBUG] [LOCAL ] MOS: Loaded 54284 existing records from primary storage. [2025-09-28T02:52:47.519019] [INFO ] [MAIN ] MOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:47.508273] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-28T02:52:47.534828] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOS took 0.7s. Estimated remaining: 4m 41s. Rate: 210.3 symbols/min [2025-09-28T02:52:47.578222] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:47.762508] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:47.773464] [DEBUG] [LOCAL ] MPA: Loaded 5268 existing records from primary storage. [2025-09-28T02:52:47.773816] [INFO ] [MAIN ] MPA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:47.773947] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MPA took 0.2s. Estimated remaining: 4m 40s. Rate: 210.3 symbols/min [2025-09-28T02:52:47.908206] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-28T02:52:47.921964] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-28T02:52:47.983941] [DEBUG] [LOCAL ] MP: Loaded 54444 existing records from primary storage. [2025-09-28T02:52:48.013669] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:48.014449] [INFO ] [MAIN ] MP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:48.015728] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MP took 0.7s. Estimated remaining: 4m 40s. Rate: 210.3 symbols/min [2025-09-28T02:52:48.199808] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:48.249326] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-28T02:52:48.250443] [INFO ] [REMOTE ] MMKT: Full fetch complete (2099 records). [2025-09-28T02:52:48.252484] [DEBUG] [LOCAL ] MPC: Loaded 52889 existing records from primary storage. [2025-09-28T02:52:48.252905] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-28T02:52:48.265588] [INFO ] [MAIN ] MPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:48.299277] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MPC took 0.5s. Estimated remaining: 4m 40s. Rate: 210.3 symbols/min [2025-09-28T02:52:48.532424] [DEBUG] [LOCAL ] MPLX: Loaded 51491 existing records from primary storage. [2025-09-28T02:52:48.593390] [INFO ] [MAIN ] MPLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:48.644252] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-28T02:52:48.672253] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:52:48.668206] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MPLX took 0.7s. Estimated remaining: 4m 39s. Rate: 210.3 symbols/min [2025-09-28T02:52:48.719897] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:52:48.721730] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:48.727940] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-28T02:52:48.727417] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:52:48.745457] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-28T02:52:48.754908] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-28T02:52:48.772330] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-28T02:52:48.781831] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-28T02:52:48.782053] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MMKT took 6.4s. Estimated remaining: 4m 39s. Rate: 210.3 symbols/min [2025-09-28T02:52:48.839012] [DEBUG] [LOCAL ] MPV: Loaded 5098 existing records from primary storage. [2025-09-28T02:52:48.902308] [INFO ] [MAIN ] MPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:48.939830] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MPV took 0.6s. Estimated remaining: 4m 39s. Rate: 210.4 symbols/min [2025-09-28T02:52:49.130334] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:49.245341] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:49.324667] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:49.329818] [DEBUG] [LOCAL ] MPX: Loaded 4213 existing records from primary storage. [2025-09-28T02:52:49.330125] [INFO ] [MAIN ] MPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:49.330432] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPX took 0.5s. Estimated remaining: 4m 38s. Rate: 210.4 symbols/min [2025-09-28T02:52:49.438141] [DEBUG] [LOCAL ] MQT: Loaded 8523 existing records from primary storage. [2025-09-28T02:52:49.455498] [INFO ] [MAIN ] MQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:49.523329] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MQT took 0.6s. Estimated remaining: 4m 38s. Rate: 210.4 symbols/min [2025-09-28T02:52:49.568884] [DEBUG] [LOCAL ] MPW: Loaded 54275 existing records from primary storage. [2025-09-28T02:52:49.552142] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:49.586498] [INFO ] [MAIN ] MPW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:49.618420] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MPW took 0.9s. Estimated remaining: 4m 38s. Rate: 210.5 symbols/min [2025-09-28T02:52:49.759227] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:49.797635] [DEBUG] [LOCAL ] MQY: Loaded 16979 existing records from primary storage. [2025-09-28T02:52:49.798687] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-28T02:52:49.809125] [INFO ] [MAIN ] MQY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:49.810994] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQY took 0.5s. Estimated remaining: 4m 37s. Rate: 210.6 symbols/min [2025-09-28T02:52:49.811508] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-28T02:52:49.845505] [DEBUG] [LOCAL ] MRC: Loaded 38128 existing records from primary storage. [2025-09-28T02:52:49.845907] [INFO ] [MAIN ] MRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:49.846027] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MRC took 0.3s. Estimated remaining: 4m 37s. Rate: 210.7 symbols/min [2025-09-28T02:52:50.688137] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-28T02:52:50.700185] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-28T02:52:51.431688] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-28T02:52:51.444304] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-28T02:52:52.308887] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-28T02:52:52.321209] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-28T02:52:53.103291] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-28T02:52:53.114721] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-28T02:52:53.943378] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-28T02:52:53.955779] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-28T02:52:54.722557] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-28T02:52:54.741971] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-28T02:52:55.491480] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-28T02:52:55.501969] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-28T02:52:55.502183] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-28T02:52:55.717848] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:52:55.718675] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:52:55.718759] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:52:55.718843] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-28T02:52:55.718951] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-28T02:52:55.719029] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-28T02:52:55.719136] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-28T02:52:55.720162] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MO took 10.5s. Estimated remaining: 4m 40s. Rate: 207.8 symbols/min [2025-09-28T02:52:56.316114] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:56.362434] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:56.435014] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:56.470796] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:56.472904] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-28T02:52:56.472989] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-28T02:52:56.473084] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-28T02:52:56.473135] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-28T02:52:56.473191] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-28T02:52:56.473240] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-28T02:52:56.610683] [DEBUG] [LOCAL ] MSA: Loaded 18988 existing records from primary storage. [2025-09-28T02:52:56.632994] [INFO ] [MAIN ] MSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:56.643532] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MSA took 0.9s. Estimated remaining: 4m 41s. Rate: 207.5 symbols/min [2025-09-28T02:52:56.991863] [DEBUG] [LOCAL ] MRK: Loaded 54569 existing records from primary storage. [2025-09-28T02:52:57.003462] [DEBUG] [LOCAL ] MS: Loaded 54472 existing records from primary storage. [2025-09-28T02:52:57.050601] [INFO ] [MAIN ] MRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:57.073254] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MRK took 1.4s. Estimated remaining: 4m 40s. Rate: 207.4 symbols/min [2025-09-28T02:52:57.051095] [INFO ] [MAIN ] MS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:57.078780] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MS took 1.4s. Estimated remaining: 4m 40s. Rate: 207.5 symbols/min [2025-09-28T02:52:57.110426] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:57.219805] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:57.266304] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-28T02:52:57.402916] [DEBUG] [LOCAL ] MSB: Loaded 7895 existing records from primary storage. [2025-09-28T02:52:57.436423] [INFO ] [MAIN ] MSB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:57.467049] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MSB took 0.8s. Estimated remaining: 4m 40s. Rate: 207.5 symbols/min [2025-09-28T02:52:57.501331] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:52:57.519824] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:57.552800] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-28T02:52:57.563112] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:52:57.562973] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:57.559122] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-28T02:52:57.573113] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-09-28T02:52:57.578569] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-28T02:52:57.607489] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-28T02:52:57.607238] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:52:57.618908] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-28T02:52:57.634909] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-28T02:52:57.618630] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-28T02:52:57.641104] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-28T02:52:57.654997] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-28T02:52:57.654501] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-28T02:52:57.671149] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MRP took 1.9s. Estimated remaining: 4m 39s. Rate: 207.5 symbols/min [2025-09-28T02:52:57.676499] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-28T02:52:57.820932] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:58.015968] [DEBUG] [LOCAL ] MSCI: Loaded 35351 existing records from primary storage. [2025-09-28T02:52:58.096297] [INFO ] [MAIN ] MSCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:58.131410] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSCI took 1.0s. Estimated remaining: 4m 39s. Rate: 207.4 symbols/min [2025-09-28T02:52:58.135128] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:58.205491] [DEBUG] [LOCAL ] MSD: Loaded 15775 existing records from primary storage. [2025-09-28T02:52:58.262399] [INFO ] [MAIN ] MSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:58.319892] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSD took 0.8s. Estimated remaining: 4m 39s. Rate: 207.5 symbols/min [2025-09-28T02:52:58.712931] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:58.737549] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:52:58.758197] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-28T02:52:58.746014] [DEBUG] [LOCAL ] MSDL: Loaded 38645 existing records from primary storage. [2025-09-28T02:52:58.759716] [INFO ] [MAIN ] MSDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:58.759841] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSDL took 1.1s. Estimated remaining: 4m 39s. Rate: 207.4 symbols/min [2025-09-28T02:52:58.916467] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:59.038590] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:59.046990] [DEBUG] [LOCAL ] MSGE: Loaded 27513 existing records from primary storage. [2025-09-28T02:52:59.048574] [INFO ] [MAIN ] MSGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:59.048748] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSGE took 0.9s. Estimated remaining: 4m 38s. Rate: 207.4 symbols/min [2025-09-28T02:52:59.097541] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-28T02:52:59.105779] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-28T02:52:59.099071] [DEBUG] [LOCAL ] MSGS: Loaded 17318 existing records from primary storage. [2025-09-28T02:52:59.157212] [INFO ] [MAIN ] MSGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:59.184685] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSGS took 0.8s. Estimated remaining: 4m 38s. Rate: 207.5 symbols/min [2025-09-28T02:52:59.303482] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:52:59.335382] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-28T02:52:59.354591] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-28T02:52:59.368783] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-28T02:52:59.385938] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-28T02:52:59.420313] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-28T02:52:59.414855] [DEBUG] [LOCAL ] MSI: Loaded 41128 existing records from primary storage. [2025-09-28T02:52:59.443098] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-28T02:52:59.461790] [INFO ] [MAIN ] MSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:52:59.532768] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSI took 0.8s. Estimated remaining: 4m 38s. Rate: 207.5 symbols/min [2025-09-28T02:52:59.532557] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-28T02:52:59.565984] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-28T02:52:59.694977] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:00.005181] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:00.155554] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-28T02:53:00.193947] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-28T02:53:00.204278] [DEBUG] [LOCAL ] MSM: Loaded 36004 existing records from primary storage. [2025-09-28T02:53:00.214856] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:00.215991] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-28T02:53:00.217130] [INFO ] [MAIN ] MSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:00.218621] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSM took 1.0s. Estimated remaining: 4m 38s. Rate: 207.3 symbols/min [2025-09-28T02:53:00.413940] [DEBUG] [LOCAL ] MT: Loaded 51417 existing records from primary storage. [2025-09-28T02:53:00.446094] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:53:00.448056] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:00.449201] [INFO ] [MAIN ] MT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:00.449874] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MT took 0.9s. Estimated remaining: 4m 37s. Rate: 207.3 symbols/min [2025-09-28T02:53:00.449380] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-28T02:53:00.450523] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:53:00.481205] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-09-28T02:53:00.530053] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:53:00.558813] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-28T02:53:00.575469] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-28T02:53:00.577844] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-28T02:53:00.589059] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-28T02:53:00.589600] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-28T02:53:00.606054] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-28T02:53:00.609414] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MSIF took 1.6s. Estimated remaining: 4m 37s. Rate: 207.3 symbols/min [2025-09-28T02:53:00.830828] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:00.840021] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-28T02:53:00.869003] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-28T02:53:00.949410] [DEBUG] [LOCAL ] MTAL: Loaded 37002 existing records from primary storage. [2025-09-28T02:53:00.950542] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:00.951787] [INFO ] [MAIN ] MTAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:00.952455] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MTAL took 0.7s. Estimated remaining: 4m 37s. Rate: 207.3 symbols/min [2025-09-28T02:53:01.126605] [DEBUG] [LOCAL ] MTD: Loaded 15342 existing records from primary storage. [2025-09-28T02:53:01.134505] [INFO ] [MAIN ] MTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:01.147947] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MTD took 0.5s. Estimated remaining: 4m 36s. Rate: 207.4 symbols/min [2025-09-28T02:53:01.237436] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-28T02:53:01.251910] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-28T02:53:01.240807] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:01.321564] [DEBUG] [LOCAL ] MTB: Loaded 47562 existing records from primary storage. [2025-09-28T02:53:01.349737] [INFO ] [MAIN ] MTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:01.354795] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTB took 0.9s. Estimated remaining: 4m 36s. Rate: 207.4 symbols/min [2025-09-28T02:53:01.517188] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:01.573041] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-28T02:53:01.600061] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-28T02:53:01.668930] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:01.692566] [DEBUG] [LOCAL ] MTDR: Loaded 52316 existing records from primary storage. [2025-09-28T02:53:01.693432] [INFO ] [MAIN ] MTDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:01.693754] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTDR took 0.7s. Estimated remaining: 4m 36s. Rate: 207.4 symbols/min [2025-09-28T02:53:01.876858] [DEBUG] [LOCAL ] MTG: Loaded 52091 existing records from primary storage. [2025-09-28T02:53:01.940385] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:01.941130] [INFO ] [MAIN ] MTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:01.941747] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTG took 0.8s. Estimated remaining: 4m 35s. Rate: 207.4 symbols/min [2025-09-28T02:53:02.016397] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-28T02:53:02.071819] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-28T02:53:02.077111] [DEBUG] [LOCAL ] MTH: Loaded 44547 existing records from primary storage. [2025-09-28T02:53:02.078795] [INFO ] [MAIN ] MTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:02.078905] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTH took 0.7s. Estimated remaining: 4m 35s. Rate: 207.5 symbols/min [2025-09-28T02:53:02.284844] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:02.286205] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-28T02:53:02.300357] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-28T02:53:02.328399] [DEBUG] [LOCAL ] MTN: Loaded 39607 existing records from primary storage. [2025-09-28T02:53:02.334418] [INFO ] [MAIN ] MTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:02.329061] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-28T02:53:02.334694] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTN took 0.6s. Estimated remaining: 4m 35s. Rate: 207.5 symbols/min [2025-09-28T02:53:02.359828] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-28T02:53:02.427931] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:02.428239] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-28T02:53:02.444812] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-28T02:53:02.455758] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-28T02:53:02.492404] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-28T02:53:02.799860] [DEBUG] [LOCAL ] MTRN: Loaded 18303 existing records from primary storage. [2025-09-28T02:53:02.861795] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:02.861983] [INFO ] [MAIN ] MTRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:02.918684] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTRN took 0.8s. Estimated remaining: 4m 35s. Rate: 207.4 symbols/min [2025-09-28T02:53:03.241775] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-28T02:53:03.292150] [DEBUG] [LOCAL ] MTUS: Loaded 28984 existing records from primary storage. [2025-09-28T02:53:03.304830] [INFO ] [REMOTE ] MSC: Full fetch complete (2509 records). [2025-09-28T02:53:03.397946] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-28T02:53:03.399523] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:03.397751] [INFO ] [MAIN ] MTUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:03.474173] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTUS took 1.1s. Estimated remaining: 4m 34s. Rate: 207.2 symbols/min [2025-09-28T02:53:03.574316] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:03.605854] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-28T02:53:03.847539] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-28T02:53:03.840021] [DEBUG] [LOCAL ] MTW: Loaded 26888 existing records from primary storage. [2025-09-28T02:53:03.863874] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:53:03.864141] [INFO ] [MAIN ] MTW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:03.875390] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:53:03.870182] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTW took 0.9s. Estimated remaining: 4m 34s. Rate: 207.2 symbols/min [2025-09-28T02:53:03.890268] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-28T02:53:03.942741] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-28T02:53:03.975078] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-28T02:53:03.950325] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:03.985970] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-28T02:53:03.986138] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MSC took 6.9s. Estimated remaining: 4m 34s. Rate: 207.3 symbols/min [2025-09-28T02:53:04.051968] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-28T02:53:04.097175] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-28T02:53:04.328943] [DEBUG] [LOCAL ] MTX: Loaded 23150 existing records from primary storage. [2025-09-28T02:53:04.328141] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:04.371101] [INFO ] [MAIN ] MTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:04.398544] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTX took 0.8s. Estimated remaining: 4m 34s. Rate: 207.2 symbols/min [2025-09-28T02:53:04.400317] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:04.427357] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-28T02:53:04.451269] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-28T02:53:04.535675] [DEBUG] [LOCAL ] MUA: Loaded 12391 existing records from primary storage. [2025-09-28T02:53:04.579594] [INFO ] [MAIN ] MUA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:04.615613] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MUA took 0.6s. Estimated remaining: 4m 33s. Rate: 207.2 symbols/min [2025-09-28T02:53:04.614974] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:04.772099] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-28T02:53:04.773810] [DEBUG] [LOCAL ] MTZ: Loaded 43922 existing records from primary storage. [2025-09-28T02:53:04.798518] [INFO ] [MAIN ] MTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:04.781929] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-28T02:53:04.809677] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MTZ took 0.9s. Estimated remaining: 4m 33s. Rate: 207.3 symbols/min [2025-09-28T02:53:04.804399] [DEBUG] [LOCAL ] MUC: Loaded 20721 existing records from primary storage. [2025-09-28T02:53:04.899300] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:04.868457] [INFO ] [MAIN ] MUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:04.906842] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MUC took 0.5s. Estimated remaining: 4m 33s. Rate: 207.4 symbols/min [2025-09-28T02:53:05.103555] [DEBUG] [LOCAL ] MUE: Loaded 12092 existing records from primary storage. [2025-09-28T02:53:05.125225] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-28T02:53:05.157754] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-28T02:53:05.151099] [INFO ] [MAIN ] MUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:05.199692] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUE took 0.6s. Estimated remaining: 4m 32s. Rate: 207.4 symbols/min [2025-09-28T02:53:05.194170] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:05.289359] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:05.433110] [DEBUG] [LOCAL ] MUJ: Loaded 13473 existing records from primary storage. [2025-09-28T02:53:05.455313] [INFO ] [MAIN ] MUJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:05.513347] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:05.485076] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUJ took 0.6s. Estimated remaining: 4m 32s. Rate: 207.4 symbols/min [2025-09-28T02:53:05.531875] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-28T02:53:05.555852] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-28T02:53:05.648831] [DEBUG] [LOCAL ] MUFG: Loaded 53341 existing records from primary storage. [2025-09-28T02:53:05.666184] [INFO ] [MAIN ] MUFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:05.670869] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUFG took 0.8s. Estimated remaining: 4m 32s. Rate: 207.4 symbols/min [2025-09-28T02:53:05.888769] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:05.992216] [DEBUG] [LOCAL ] MUR: Loaded 53705 existing records from primary storage. [2025-09-28T02:53:05.994974] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:05.995695] [INFO ] [MAIN ] MUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:05.995764] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-28T02:53:05.995907] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-28T02:53:05.996090] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUR took 0.8s. Estimated remaining: 4m 31s. Rate: 207.4 symbols/min [2025-09-28T02:53:05.996188] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-28T02:53:06.016464] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-28T02:53:06.055028] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-28T02:53:06.064570] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-28T02:53:06.064870] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-28T02:53:06.066274] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-28T02:53:06.253871] [DEBUG] [LOCAL ] MUSA: Loaded 25221 existing records from primary storage. [2025-09-28T02:53:06.302475] [INFO ] [MAIN ] MUSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:06.404674] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:06.369708] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUSA took 0.8s. Estimated remaining: 4m 31s. Rate: 207.4 symbols/min [2025-09-28T02:53:06.656416] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-28T02:53:06.691796] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-28T02:53:06.822788] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:06.828592] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-28T02:53:06.920711] [DEBUG] [LOCAL ] MUX: Loaded 43253 existing records from primary storage. [2025-09-28T02:53:06.922738] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:06.923455] [INFO ] [MAIN ] MUX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:06.924993] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUX took 0.9s. Estimated remaining: 4m 31s. Rate: 207.2 symbols/min [2025-09-28T02:53:07.074128] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-28T02:53:07.105219] [DEBUG] [LOCAL ] MVF: Loaded 12921 existing records from primary storage. [2025-09-28T02:53:07.113123] [INFO ] [MAIN ] MVF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:07.074756] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-28T02:53:07.130765] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-28T02:53:07.134847] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:07.137861] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-28T02:53:07.135144] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MVF took 0.7s. Estimated remaining: 4m 31s. Rate: 207.3 symbols/min [2025-09-28T02:53:07.278700] [DEBUG] [LOCAL ] MVO: Loaded 9140 existing records from primary storage. [2025-09-28T02:53:07.305330] [INFO ] [MAIN ] MVO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:07.313570] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MVO took 0.4s. Estimated remaining: 4m 30s. Rate: 207.3 symbols/min [2025-09-28T02:53:07.330822] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:53:07.338688] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-28T02:53:07.338426] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:07.340717] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-28T02:53:07.342572] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-28T02:53:07.342698] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:53:07.342789] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-09-28T02:53:07.342901] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:53:07.343032] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-28T02:53:07.343227] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-28T02:53:07.343306] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-28T02:53:07.343446] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-28T02:53:07.343549] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MUSE took 1.7s. Estimated remaining: 4m 30s. Rate: 207.5 symbols/min [2025-09-28T02:53:07.356261] [DEBUG] [LOCAL ] MVT: Loaded 10355 existing records from primary storage. [2025-09-28T02:53:07.356547] [INFO ] [MAIN ] MVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:07.356677] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVT took 0.2s. Estimated remaining: 4m 29s. Rate: 207.6 symbols/min [2025-09-28T02:53:07.574568] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-28T02:53:07.575490] [INFO ] [REMOTE ] MTR: Full fetch complete (2549 records). [2025-09-28T02:53:07.575587] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-28T02:53:07.800109] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:53:07.800311] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:53:07.800386] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:53:07.800465] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-28T02:53:07.800565] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-28T02:53:07.800638] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-28T02:53:07.800749] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-28T02:53:07.800846] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MTR took 5.9s. Estimated remaining: 4m 29s. Rate: 207.5 symbols/min [2025-09-28T02:53:08.463815] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:08.488993] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-28T02:53:08.493213] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:08.547843] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:08.549192] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-28T02:53:08.577553] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:08.577900] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-28T02:53:08.578280] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-28T02:53:08.580518] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-28T02:53:08.580600] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-28T02:53:08.630944] [DEBUG] [LOCAL ] MXF: Loaded 5984 existing records from primary storage. [2025-09-28T02:53:08.672612] [INFO ] [MAIN ] MXF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:08.684153] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXF took 0.9s. Estimated remaining: 4m 29s. Rate: 207.2 symbols/min [2025-09-28T02:53:08.855899] [DEBUG] [LOCAL ] MX: Loaded 23379 existing records from primary storage. [2025-09-28T02:53:08.896008] [INFO ] [MAIN ] MX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:08.928752] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MX took 1.1s. Estimated remaining: 4m 29s. Rate: 207.2 symbols/min [2025-09-28T02:53:08.993370] [DEBUG] [LOCAL ] MWA: Loaded 47633 existing records from primary storage. [2025-09-28T02:53:09.154856] [INFO ] [MAIN ] MWA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:09.193834] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:09.214613] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MWA took 1.4s. Estimated remaining: 4m 29s. Rate: 207.2 symbols/min [2025-09-28T02:53:09.527899] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:09.575582] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-28T02:53:09.529909] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:09.587031] [DEBUG] [LOCAL ] MYD: Loaded 13946 existing records from primary storage. [2025-09-28T02:53:09.601334] [INFO ] [MAIN ] MYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:09.602056] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MYD took 0.9s. Estimated remaining: 4m 28s. Rate: 207.2 symbols/min [2025-09-28T02:53:09.729283] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:09.880885] [DEBUG] [LOCAL ] MYE: Loaded 25346 existing records from primary storage. [2025-09-28T02:53:09.904897] [INFO ] [MAIN ] MYE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:09.927123] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:09.931554] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-28T02:53:09.931369] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYE took 0.9s. Estimated remaining: 4m 28s. Rate: 207.2 symbols/min [2025-09-28T02:53:09.939851] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-28T02:53:10.018503] [DEBUG] [LOCAL ] MYI: Loaded 19636 existing records from primary storage. [2025-09-28T02:53:10.032451] [INFO ] [MAIN ] MYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:10.077692] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYI took 0.8s. Estimated remaining: 4m 28s. Rate: 207.2 symbols/min [2025-09-28T02:53:10.078266] [DEBUG] [LOCAL ] MYN: Loaded 10324 existing records from primary storage. [2025-09-28T02:53:10.104879] [INFO ] [MAIN ] MYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:10.138134] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. MYN took 0.5s. Estimated remaining: 4m 27s. Rate: 207.4 symbols/min [2025-09-28T02:53:10.189280] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:10.401163] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-28T02:53:10.468028] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-28T02:53:10.546261] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:10.566931] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:10.589959] [DEBUG] [LOCAL ] NABL: Loaded 40294 existing records from primary storage. [2025-09-28T02:53:10.590550] [INFO ] [MAIN ] NABL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:10.590863] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. NABL took 0.7s. Estimated remaining: 4m 27s. Rate: 207.3 symbols/min [2025-09-28T02:53:10.805787] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-28T02:53:10.792055] [DEBUG] [LOCAL ] NAC: Loaded 25076 existing records from primary storage. [2025-09-28T02:53:10.807424] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-28T02:53:10.828200] [DEBUG] [LOCAL ] NAD: Loaded 34318 existing records from primary storage. [2025-09-28T02:53:10.839502] [INFO ] [MAIN ] NAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:10.835131] [INFO ] [MAIN ] NAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:10.861579] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAD took 0.7s. Estimated remaining: 4m 27s. Rate: 207.3 symbols/min [2025-09-28T02:53:10.871294] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAC took 0.8s. Estimated remaining: 4m 26s. Rate: 207.4 symbols/min [2025-09-28T02:53:10.871128] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:11.110834] [DEBUG] [LOCAL ] NAN: Loaded 9084 existing records from primary storage. [2025-09-28T02:53:11.122426] [INFO ] [MAIN ] NAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:11.148226] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAN took 0.6s. Estimated remaining: 4m 26s. Rate: 207.4 symbols/min [2025-09-28T02:53:11.184272] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-28T02:53:11.292773] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:11.324369] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-28T02:53:11.398891] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:11.479148] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:11.495151] [DEBUG] [LOCAL ] NAZ: Loaded 2703 existing records from primary storage. [2025-09-28T02:53:11.495693] [INFO ] [MAIN ] NAZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:11.496021] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAZ took 0.3s. Estimated remaining: 4m 26s. Rate: 207.4 symbols/min [2025-09-28T02:53:11.632993] [DEBUG] [LOCAL ] NATL: Loaded 33367 existing records from primary storage. [2025-09-28T02:53:11.634023] [INFO ] [MAIN ] NATL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:11.634557] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NATL took 0.7s. Estimated remaining: 4m 25s. Rate: 207.5 symbols/min [2025-09-28T02:53:11.795343] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-28T02:53:11.797777] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:11.849899] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-28T02:53:11.829198] [DEBUG] [LOCAL ] NAT: Loaded 49859 existing records from primary storage. [2025-09-28T02:53:11.854924] [INFO ] [MAIN ] NAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:11.860535] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NAT took 1.0s. Estimated remaining: 4m 25s. Rate: 207.5 symbols/min [2025-09-28T02:53:11.968877] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:12.056822] [DEBUG] [LOCAL ] NBB: Loaded 8967 existing records from primary storage. [2025-09-28T02:53:12.061399] [INFO ] [MAIN ] NBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:12.077874] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NBB took 0.6s. Estimated remaining: 4m 25s. Rate: 207.5 symbols/min [2025-09-28T02:53:12.140155] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-28T02:53:12.187885] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:12.189729] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-28T02:53:12.219618] [DEBUG] [LOCAL ] NBHC: Loaded 23530 existing records from primary storage. [2025-09-28T02:53:12.234557] [INFO ] [MAIN ] NBHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:12.251839] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NBHC took 0.6s. Estimated remaining: 4m 24s. Rate: 207.6 symbols/min [2025-09-28T02:53:12.474084] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:12.561195] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:12.575026] [DEBUG] [LOCAL ] NBR: Loaded 35286 existing records from primary storage. [2025-09-28T02:53:12.581247] [INFO ] [MAIN ] NBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:12.581938] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBR took 0.7s. Estimated remaining: 4m 24s. Rate: 207.6 symbols/min [2025-09-28T02:53:12.589789] [DEBUG] [LOCAL ] NC: Loaded 1933 existing records from primary storage. [2025-09-28T02:53:12.619462] [INFO ] [MAIN ] NC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:12.658300] [DEBUG] [LOCAL ] NBXG: Loaded 22794 existing records from primary storage. [2025-09-28T02:53:12.667996] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NC took 0.4s. Estimated remaining: 4m 24s. Rate: 207.7 symbols/min [2025-09-28T02:53:12.680516] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-28T02:53:12.691197] [INFO ] [MAIN ] NBXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:12.698037] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-28T02:53:12.709104] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NBXG took 0.6s. Estimated remaining: 4m 23s. Rate: 207.8 symbols/min [2025-09-28T02:53:13.072799] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:13.094992] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-28T02:53:13.117570] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:13.135560] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-28T02:53:13.205181] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:13.211510] [DEBUG] [LOCAL ] NCA: Loaded 10178 existing records from primary storage. [2025-09-28T02:53:13.212973] [INFO ] [MAIN ] NCA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:13.213121] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NCA took 0.6s. Estimated remaining: 4m 23s. Rate: 207.7 symbols/min [2025-09-28T02:53:13.349207] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-28T02:53:13.339949] [DEBUG] [LOCAL ] NCDL: Loaded 21828 existing records from primary storage. [2025-09-28T02:53:13.371897] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-28T02:53:13.373135] [INFO ] [MAIN ] NCDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:13.403952] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCDL took 0.7s. Estimated remaining: 4m 23s. Rate: 207.7 symbols/min [2025-09-28T02:53:13.440131] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:13.602134] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-09-28T02:53:13.671580] [INFO ] [MAIN ] NCLH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:13.674676] [DEBUG] [LOCAL ] NCV: Loaded 13602 existing records from primary storage. [2025-09-28T02:53:13.673867] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:13.674906] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCLH took 0.9s. Estimated remaining: 4m 23s. Rate: 207.8 symbols/min [2025-09-28T02:53:13.680819] [INFO ] [MAIN ] NCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:13.718776] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCV took 0.5s. Estimated remaining: 4m 22s. Rate: 207.9 symbols/min [2025-09-28T02:53:13.733582] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-28T02:53:13.805167] [INFO ] [REMOTE ] MXE: Full fetch complete (2667 records). [2025-09-28T02:53:13.831967] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-28T02:53:13.923490] [DEBUG] [LOCAL ] NCZ: Loaded 11998 existing records from primary storage. [2025-09-28T02:53:14.003408] [INFO ] [MAIN ] NCZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:14.045984] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCZ took 0.6s. Estimated remaining: 4m 22s. Rate: 207.9 symbols/min [2025-09-28T02:53:14.261467] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:14.320907] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:14.402518] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:53:14.408408] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:53:14.408782] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:53:14.415362] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-28T02:53:14.419308] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-28T02:53:14.425170] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-28T02:53:14.435884] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-28T02:53:14.441368] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. MXE took 6.6s. Estimated remaining: 4m 22s. Rate: 207.8 symbols/min [2025-09-28T02:53:14.514819] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:14.558989] [DEBUG] [LOCAL ] NDMO: Loaded 16978 existing records from primary storage. [2025-09-28T02:53:14.602157] [INFO ] [MAIN ] NDMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:14.644714] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NDMO took 1.0s. Estimated remaining: 4m 21s. Rate: 207.8 symbols/min [2025-09-28T02:53:14.774950] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:14.872558] [DEBUG] [LOCAL ] NE: Loaded 53157 existing records from primary storage. [2025-09-28T02:53:14.894903] [INFO ] [MAIN ] NE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:14.917351] [DEBUG] [LOCAL ] NEA: Loaded 35808 existing records from primary storage. [2025-09-28T02:53:14.968252] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:14.964459] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NE took 1.2s. Estimated remaining: 4m 21s. Rate: 207.8 symbols/min [2025-09-28T02:53:14.943469] [INFO ] [MAIN ] NEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:14.981890] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NEA took 0.9s. Estimated remaining: 4m 21s. Rate: 208.0 symbols/min [2025-09-28T02:53:15.359132] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:15.402524] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:15.421704] [DEBUG] [LOCAL ] NEE: Loaded 54487 existing records from primary storage. [2025-09-28T02:53:15.423515] [INFO ] [MAIN ] NEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:15.423625] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEE took 0.9s. Estimated remaining: 4m 20s. Rate: 207.9 symbols/min [2025-09-28T02:53:15.549774] [DEBUG] [LOCAL ] NEU: Loaded 8259 existing records from primary storage. [2025-09-28T02:53:15.564463] [DEBUG] [LOCAL ] NEM: Loaded 54488 existing records from primary storage. [2025-09-28T02:53:15.569219] [INFO ] [MAIN ] NEU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:15.580955] [INFO ] [MAIN ] NEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:15.575592] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEU took 0.6s. Estimated remaining: 4m 20s. Rate: 208.0 symbols/min [2025-09-28T02:53:15.624727] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEM took 1.0s. Estimated remaining: 4m 20s. Rate: 208.1 symbols/min [2025-09-28T02:53:15.686971] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:15.919302] [DEBUG] [LOCAL ] NET: Loaded 53808 existing records from primary storage. [2025-09-28T02:53:15.934021] [DEBUG] [LOCAL ] NEUE: Loaded 2271 existing records from primary storage. [2025-09-28T02:53:15.965841] [INFO ] [MAIN ] NET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:15.995284] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:15.995596] [INFO ] [MAIN ] NEUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:16.000923] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NET took 1.0s. Estimated remaining: 4m 19s. Rate: 208.0 symbols/min [2025-09-28T02:53:16.033513] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NEUE took 0.6s. Estimated remaining: 4m 19s. Rate: 208.2 symbols/min [2025-09-28T02:53:16.156019] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:16.222595] [DEBUG] [LOCAL ] NEXA: Loaded 4307 existing records from primary storage. [2025-09-28T02:53:16.304017] [INFO ] [MAIN ] NEXA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:16.317754] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NEXA took 0.7s. Estimated remaining: 4m 19s. Rate: 208.2 symbols/min [2025-09-28T02:53:16.498548] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:16.611156] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:16.717727] [DEBUG] [LOCAL ] NFG: Loaded 39084 existing records from primary storage. [2025-09-28T02:53:16.720252] [DEBUG] [LOCAL ] NFJ: Loaded 20592 existing records from primary storage. [2025-09-28T02:53:16.719157] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:16.720913] [INFO ] [MAIN ] NFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:16.721841] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NFG took 1.0s. Estimated remaining: 4m 18s. Rate: 208.1 symbols/min [2025-09-28T02:53:16.722053] [INFO ] [MAIN ] NFJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:16.743833] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NFJ took 0.7s. Estimated remaining: 4m 18s. Rate: 208.2 symbols/min [2025-09-28T02:53:17.105472] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:17.143625] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:17.122068] [DEBUG] [LOCAL ] NGG: Loaded 46809 existing records from primary storage. [2025-09-28T02:53:17.145495] [DEBUG] [LOCAL ] NGL: Loaded 30754 existing records from primary storage. [2025-09-28T02:53:17.145853] [INFO ] [MAIN ] NGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:17.146501] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGG took 1.0s. Estimated remaining: 4m 18s. Rate: 208.2 symbols/min [2025-09-28T02:53:17.147345] [INFO ] [MAIN ] NGL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:17.147927] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGL took 0.8s. Estimated remaining: 4m 17s. Rate: 208.3 symbols/min [2025-09-28T02:53:17.164072] [DEBUG] [LOCAL ] NGS: Loaded 11682 existing records from primary storage. [2025-09-28T02:53:17.164457] [INFO ] [MAIN ] NGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:17.164559] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGS took 0.4s. Estimated remaining: 4m 17s. Rate: 208.4 symbols/min [2025-09-28T02:53:17.180513] [DEBUG] [LOCAL ] NGVC: Loaded 22650 existing records from primary storage. [2025-09-28T02:53:17.180854] [INFO ] [MAIN ] NGVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:17.180973] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NGVC took 0.4s. Estimated remaining: 4m 16s. Rate: 208.6 symbols/min [2025-09-28T02:53:17.757264] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:17.878073] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:17.942705] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:17.952428] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:17.966330] [DEBUG] [LOCAL ] NHI: Loaded 22283 existing records from primary storage. [2025-09-28T02:53:17.969872] [INFO ] [MAIN ] NHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:17.969978] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NHI took 0.8s. Estimated remaining: 4m 16s. Rate: 208.3 symbols/min [2025-09-28T02:53:18.049708] [DEBUG] [LOCAL ] NIC: Loaded 9026 existing records from primary storage. [2025-09-28T02:53:18.068064] [INFO ] [MAIN ] NIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:18.090960] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NIC took 0.9s. Estimated remaining: 4m 16s. Rate: 208.4 symbols/min [2025-09-28T02:53:18.224335] [DEBUG] [LOCAL ] NGVT: Loaded 24631 existing records from primary storage. [2025-09-28T02:53:18.282529] [INFO ] [MAIN ] NGVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:18.297325] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:18.317582] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NGVT took 1.1s. Estimated remaining: 4m 16s. Rate: 208.4 symbols/min [2025-09-28T02:53:18.441359] [DEBUG] [LOCAL ] NI: Loaded 54201 existing records from primary storage. [2025-09-28T02:53:18.534461] [DEBUG] [LOCAL ] NIE: Loaded 11869 existing records from primary storage. [2025-09-28T02:53:18.534090] [INFO ] [MAIN ] NI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:18.528727] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:18.534689] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NI took 1.3s. Estimated remaining: 4m 15s. Rate: 208.5 symbols/min [2025-09-28T02:53:18.534847] [INFO ] [MAIN ] NIE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:18.567742] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIE took 0.6s. Estimated remaining: 4m 15s. Rate: 208.6 symbols/min [2025-09-28T02:53:18.671096] [DEBUG] [LOCAL ] NIM: Loaded 4149 existing records from primary storage. [2025-09-28T02:53:18.698500] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:18.753988] [INFO ] [MAIN ] NIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:18.851188] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NIM took 0.8s. Estimated remaining: 4m 15s. Rate: 208.6 symbols/min [2025-09-28T02:53:18.979711] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:19.094139] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:19.135883] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-28T02:53:19.149195] [DEBUG] [LOCAL ] NINE: Loaded 28624 existing records from primary storage. [2025-09-28T02:53:19.149893] [INFO ] [MAIN ] NINE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:19.155591] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NINE took 0.8s. Estimated remaining: 4m 14s. Rate: 208.6 symbols/min [2025-09-28T02:53:19.148030] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-28T02:53:19.189830] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-28T02:53:19.201316] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-28T02:53:19.236974] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-28T02:53:19.242312] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-28T02:53:19.329115] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:19.593929] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:19.631283] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-28T02:53:19.647613] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-28T02:53:19.701574] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-28T02:53:19.711952] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-09-28T02:53:19.750927] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-28T02:53:19.751392] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-28T02:53:19.763072] [INFO ] [MAIN ] NIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:19.763174] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-28T02:53:19.789383] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NIO took 1.2s. Estimated remaining: 4m 14s. Rate: 208.4 symbols/min [2025-09-28T02:53:19.830333] [DEBUG] [LOCAL ] NJR: Loaded 38739 existing records from primary storage. [2025-09-28T02:53:19.933356] [INFO ] [MAIN ] NJR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:19.943751] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NJR took 1.0s. Estimated remaining: 4m 14s. Rate: 208.5 symbols/min [2025-09-28T02:53:20.038246] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:20.146551] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-28T02:53:20.358286] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:20.439802] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:53:20.516881] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:20.538163] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-28T02:53:20.538280] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-28T02:53:20.554633] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:53:20.554836] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-28T02:53:20.582021] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-28T02:53:20.592622] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-09-28T02:53:20.592836] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-28T02:53:20.608721] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:53:20.655007] [DEBUG] [LOCAL ] NKX: Loaded 13801 existing records from primary storage. [2025-09-28T02:53:20.672921] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-28T02:53:20.676932] [INFO ] [MAIN ] NKX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:20.680520] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:20.681016] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-28T02:53:20.681557] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NKX took 0.9s. Estimated remaining: 4m 14s. Rate: 208.3 symbols/min [2025-09-28T02:53:20.676437] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-28T02:53:20.655094] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-28T02:53:20.693621] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-28T02:53:20.758513] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-28T02:53:20.769237] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-28T02:53:20.810533] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NIQ took 2.2s. Estimated remaining: 4m 13s. Rate: 208.4 symbols/min [2025-09-28T02:53:21.061810] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:21.355905] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:21.416061] [DEBUG] [LOCAL ] NLOP: Loaded 11997 existing records from primary storage. [2025-09-28T02:53:21.439210] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:21.440267] [INFO ] [MAIN ] NLOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:21.440919] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-28T02:53:21.440602] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NLOP took 0.8s. Estimated remaining: 4m 13s. Rate: 208.2 symbols/min [2025-09-28T02:53:21.625072] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:21.656159] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-28T02:53:21.682467] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-28T02:53:21.694873] [DEBUG] [LOCAL ] NMAI: Loaded 13181 existing records from primary storage. [2025-09-28T02:53:21.695346] [INFO ] [MAIN ] NMAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:21.695453] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NMAI took 0.3s. Estimated remaining: 4m 13s. Rate: 208.2 symbols/min [2025-09-28T02:53:21.826009] [DEBUG] [LOCAL ] NLY: Loaded 54358 existing records from primary storage. [2025-09-28T02:53:21.832573] [INFO ] [MAIN ] NLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:21.883389] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NLY took 1.0s. Estimated remaining: 4m 13s. Rate: 208.3 symbols/min [2025-09-28T02:53:21.904703] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-28T02:53:21.908145] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:21.929726] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-28T02:53:21.941408] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-28T02:53:21.947447] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-28T02:53:21.976614] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-28T02:53:22.017490] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-28T02:53:22.018380] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-28T02:53:22.039728] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-28T02:53:22.117921] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:22.392840] [DEBUG] [LOCAL ] NMCO: Loaded 16803 existing records from primary storage. [2025-09-28T02:53:22.412352] [INFO ] [MAIN ] NMCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:22.458814] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NMCO took 0.6s. Estimated remaining: 4m 13s. Rate: 208.1 symbols/min [2025-09-28T02:53:22.530574] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:22.569878] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-28T02:53:22.577071] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-28T02:53:22.646673] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-28T02:53:22.663078] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-28T02:53:22.675614] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-28T02:53:22.753209] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:22.764958] [DEBUG] [LOCAL ] NMG: Loaded 7913 existing records from primary storage. [2025-09-28T02:53:22.765235] [INFO ] [MAIN ] NMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:22.765338] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NMG took 0.3s. Estimated remaining: 4m 12s. Rate: 208.1 symbols/min [2025-09-28T02:53:22.810083] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:53:22.848398] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-28T02:53:22.848525] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:53:22.867840] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-09-28T02:53:22.870401] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:53:22.870487] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-28T02:53:22.870932] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-28T02:53:22.881524] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-28T02:53:22.881666] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-28T02:53:22.886891] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMAX took 1.2s. Estimated remaining: 4m 12s. Rate: 208.2 symbols/min [2025-09-28T02:53:22.990910] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:23.062383] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-28T02:53:23.070696] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-28T02:53:23.132677] [DEBUG] [LOCAL ] NMI: Loaded 4091 existing records from primary storage. [2025-09-28T02:53:23.160920] [INFO ] [MAIN ] NMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:23.162493] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:23.162729] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMI took 0.4s. Estimated remaining: 4m 12s. Rate: 208.2 symbols/min [2025-09-28T02:53:23.284062] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-09-28T02:53:23.361908] [DEBUG] [LOCAL ] NMM: Loaded 14470 existing records from primary storage. [2025-09-28T02:53:23.361290] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:23.363860] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-28T02:53:23.365638] [INFO ] [MAIN ] NMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:23.365787] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMM took 0.5s. Estimated remaining: 4m 11s. Rate: 208.2 symbols/min [2025-09-28T02:53:23.568612] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:23.611974] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-28T02:53:23.618447] [DEBUG] [LOCAL ] NMS: Loaded 2893 existing records from primary storage. [2025-09-28T02:53:23.625692] [DEBUG] [LOCAL ] NMR: Loaded 35569 existing records from primary storage. [2025-09-28T02:53:23.629349] [INFO ] [MAIN ] NMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:23.630924] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMS took 0.3s. Estimated remaining: 4m 11s. Rate: 208.2 symbols/min [2025-09-28T02:53:23.641839] [INFO ] [MAIN ] NMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:23.653366] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-28T02:53:23.655187] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMR took 0.5s. Estimated remaining: 4m 11s. Rate: 208.4 symbols/min [2025-09-28T02:53:23.654223] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-28T02:53:23.694268] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-28T02:53:24.003050] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:24.024807] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:24.034047] [DEBUG] [LOCAL ] NMT: Loaded 2884 existing records from primary storage. [2025-09-28T02:53:24.034513] [INFO ] [MAIN ] NMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:24.034613] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMT took 0.4s. Estimated remaining: 4m 10s. Rate: 208.3 symbols/min [2025-09-28T02:53:24.162921] [DEBUG] [LOCAL ] NMZ: Loaded 21872 existing records from primary storage. [2025-09-28T02:53:24.179470] [INFO ] [MAIN ] NMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:24.184886] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NMZ took 0.5s. Estimated remaining: 4m 10s. Rate: 208.4 symbols/min [2025-09-28T02:53:24.296278] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-28T02:53:24.282369] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:24.311563] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-28T02:53:24.453796] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:24.454887] [DEBUG] [LOCAL ] NNI: Loaded 10159 existing records from primary storage. [2025-09-28T02:53:24.455722] [INFO ] [MAIN ] NNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:24.455981] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NNI took 0.4s. Estimated remaining: 4m 10s. Rate: 208.4 symbols/min [2025-09-28T02:53:24.670051] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:24.727087] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-28T02:53:24.728876] [DEBUG] [LOCAL ] NNY: Loaded 5750 existing records from primary storage. [2025-09-28T02:53:24.728266] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-28T02:53:24.731786] [INFO ] [MAIN ] NNY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:24.741276] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNY took 0.3s. Estimated remaining: 4m 9s. Rate: 208.4 symbols/min [2025-09-28T02:53:24.747579] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-28T02:53:24.749325] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-28T02:53:24.831464] [DEBUG] [LOCAL ] NNN: Loaded 49151 existing records from primary storage. [2025-09-28T02:53:24.856830] [INFO ] [MAIN ] NNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:24.867729] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NNN took 0.7s. Estimated remaining: 4m 9s. Rate: 208.5 symbols/min [2025-09-28T02:53:25.111729] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:25.248579] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:25.255317] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-28T02:53:25.266824] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-28T02:53:25.267490] [DEBUG] [LOCAL ] NOA: Loaded 16497 existing records from primary storage. [2025-09-28T02:53:25.269013] [INFO ] [MAIN ] NOA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:25.269126] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NOA took 0.5s. Estimated remaining: 4m 9s. Rate: 208.4 symbols/min [2025-09-28T02:53:25.439504] [DEBUG] [LOCAL ] NOAH: Loaded 20358 existing records from primary storage. [2025-09-28T02:53:25.478855] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:25.479286] [INFO ] [MAIN ] NOAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:25.480405] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NOAH took 0.6s. Estimated remaining: 4m 8s. Rate: 208.5 symbols/min [2025-09-28T02:53:25.589386] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-28T02:53:25.615034] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-28T02:53:25.695953] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:25.760580] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-28T02:53:25.762365] [DEBUG] [LOCAL ] NOC: Loaded 43141 existing records from primary storage. [2025-09-28T02:53:25.775291] [INFO ] [MAIN ] NOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:25.775682] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOC took 0.5s. Estimated remaining: 4m 8s. Rate: 208.5 symbols/min [2025-09-28T02:53:25.826685] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-28T02:53:25.980091] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:26.000517] [DEBUG] [LOCAL ] NOG: Loaded 51932 existing records from primary storage. [2025-09-28T02:53:26.001251] [INFO ] [MAIN ] NOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:26.001396] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOG took 0.5s. Estimated remaining: 4m 8s. Rate: 208.5 symbols/min [2025-09-28T02:53:26.044917] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-28T02:53:26.082281] [INFO ] [REMOTE ] NL: Full fetch complete (6922 records). [2025-09-28T02:53:26.089784] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-28T02:53:26.332244] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:26.338286] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-28T02:53:26.367435] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-28T02:53:26.392113] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-28T02:53:26.436109] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-28T02:53:26.435800] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:53:26.436830] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:53:26.439051] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-09-28T02:53:26.437059] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:53:26.439296] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-28T02:53:26.439829] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-28T02:53:26.440480] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-28T02:53:26.440168] [INFO ] [MAIN ] NOK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:26.440755] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-28T02:53:26.440898] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-28T02:53:26.462464] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-28T02:53:26.452503] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOK took 0.7s. Estimated remaining: 4m 8s. Rate: 208.4 symbols/min [2025-09-28T02:53:26.496708] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NL took 6.5s. Estimated remaining: 4m 7s. Rate: 208.5 symbols/min [2025-09-28T02:53:26.922481] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:27.068135] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:27.222066] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:27.222954] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-28T02:53:27.268400] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-28T02:53:27.304870] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-28T02:53:27.306192] [DEBUG] [LOCAL ] NOMD: Loaded 42016 existing records from primary storage. [2025-09-28T02:53:27.307855] [INFO ] [MAIN ] NOMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:27.308544] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOMD took 0.8s. Estimated remaining: 4m 7s. Rate: 208.3 symbols/min [2025-09-28T02:53:27.433306] [DEBUG] [LOCAL ] NOTE: Loaded 43143 existing records from primary storage. [2025-09-28T02:53:27.434079] [INFO ] [MAIN ] NOTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:27.439624] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NOTE took 0.9s. Estimated remaining: 4m 7s. Rate: 208.4 symbols/min [2025-09-28T02:53:27.595693] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:27.622573] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-28T02:53:27.624682] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-28T02:53:27.703529] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:27.769192] [DEBUG] [LOCAL ] NOV: Loaded 53961 existing records from primary storage. [2025-09-28T02:53:27.771006] [INFO ] [MAIN ] NOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:27.771239] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NOV took 0.5s. Estimated remaining: 4m 7s. Rate: 208.3 symbols/min [2025-09-28T02:53:27.837573] [DEBUG] [LOCAL ] NOW: Loaded 49444 existing records from primary storage. [2025-09-28T02:53:27.864790] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-28T02:53:27.885888] [INFO ] [MAIN ] NOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:27.904598] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-28T02:53:27.886055] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NOW took 0.4s. Estimated remaining: 4m 6s. Rate: 208.4 symbols/min [2025-09-28T02:53:28.032308] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:28.054073] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-28T02:53:28.079864] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-28T02:53:28.116723] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-28T02:53:28.177727] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:28.177914] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-28T02:53:28.178784] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-28T02:53:28.179146] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-28T02:53:28.272165] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-28T02:53:28.283866] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-28T02:53:28.389534] [DEBUG] [LOCAL ] NPCT: Loaded 17114 existing records from primary storage. [2025-09-28T02:53:28.408231] [INFO ] [MAIN ] NPCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:28.465365] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NPCT took 0.6s. Estimated remaining: 4m 6s. Rate: 208.3 symbols/min [2025-09-28T02:53:28.538374] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-28T02:53:28.561332] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-28T02:53:28.562876] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-28T02:53:28.636290] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:28.637272] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-28T02:53:28.638502] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-28T02:53:28.789103] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:53:28.789517] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-28T02:53:28.789628] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:53:28.789736] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-09-28T02:53:28.789859] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:53:28.789954] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-28T02:53:28.790052] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-28T02:53:28.790125] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-28T02:53:28.790221] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-28T02:53:28.790310] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NPB took 1.0s. Estimated remaining: 4m 6s. Rate: 208.3 symbols/min [2025-09-28T02:53:28.801573] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-28T02:53:28.802817] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-28T02:53:29.010203] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-28T02:53:29.011317] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-28T02:53:29.393729] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-28T02:53:29.394826] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-28T02:53:29.449575] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-28T02:53:29.461669] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-28T02:53:29.549815] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.15 seconds). [2025-09-28T02:53:29.551037] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-28T02:53:29.851152] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-28T02:53:29.852386] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-28T02:53:30.002716] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.15 seconds). [2025-09-28T02:53:30.003822] [INFO ] [REMOTE ] NOM: Full fetch complete (1626 records). [2025-09-28T02:53:30.003915] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-28T02:53:30.204754] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-28T02:53:30.205050] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:53:30.205202] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:53:30.205328] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-28T02:53:30.205455] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-28T02:53:30.205557] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-28T02:53:30.205796] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-28T02:53:30.205913] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NOM took 4.2s. Estimated remaining: 4m 6s. Rate: 207.7 symbols/min [2025-09-28T02:53:30.234541] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-28T02:53:30.246572] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-28T02:53:31.002294] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-28T02:53:31.012337] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-28T02:53:31.012568] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-28T02:53:31.219209] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:53:31.219993] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:53:31.220071] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:53:31.220162] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-28T02:53:31.220290] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-28T02:53:31.220430] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-28T02:53:31.220519] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-28T02:53:31.221103] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NKE took 12.1s. Estimated remaining: 4m 6s. Rate: 207.4 symbols/min [2025-09-28T02:53:31.901537] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:31.874301] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:31.907818] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-28T02:53:31.954188] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-28T02:53:32.018215] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-28T02:53:32.038239] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-28T02:53:32.019300] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:32.039325] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:32.042538] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-28T02:53:32.042717] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-28T02:53:32.121116] [DEBUG] [LOCAL ] NPFD: Loaded 9814 existing records from primary storage. [2025-09-28T02:53:32.204038] [DEBUG] [LOCAL ] NPO: Loaded 13019 existing records from primary storage. [2025-09-28T02:53:32.148240] [INFO ] [MAIN ] NPFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:32.177453] [DEBUG] [LOCAL ] NPK: Loaded 8120 existing records from primary storage. [2025-09-28T02:53:32.223469] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPFD took 1.0s. Estimated remaining: 4m 6s. Rate: 207.0 symbols/min [2025-09-28T02:53:32.224053] [INFO ] [MAIN ] NPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:32.229484] [INFO ] [MAIN ] NPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:32.269763] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPO took 1.0s. Estimated remaining: 4m 6s. Rate: 207.2 symbols/min [2025-09-28T02:53:32.355745] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPK took 1.0s. Estimated remaining: 4m 5s. Rate: 207.3 symbols/min [2025-09-28T02:53:32.902033] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:32.961245] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:32.958080] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:32.986261] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-28T02:53:33.071045] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:33.071735] [DEBUG] [LOCAL ] NPV: Loaded 5070 existing records from primary storage. [2025-09-28T02:53:33.072318] [INFO ] [MAIN ] NPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:33.072907] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPV took 0.8s. Estimated remaining: 4m 5s. Rate: 207.1 symbols/min [2025-09-28T02:53:33.207310] [DEBUG] [LOCAL ] NQP: Loaded 9406 existing records from primary storage. [2025-09-28T02:53:33.235816] [INFO ] [MAIN ] NQP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:33.280496] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NQP took 0.7s. Estimated remaining: 4m 5s. Rate: 207.1 symbols/min [2025-09-28T02:53:33.301636] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:33.316967] [DEBUG] [LOCAL ] NPWR: Loaded 43857 existing records from primary storage. [2025-09-28T02:53:33.344851] [INFO ] [MAIN ] NPWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:33.387301] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NPWR took 1.1s. Estimated remaining: 4m 5s. Rate: 207.2 symbols/min [2025-09-28T02:53:33.624772] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:33.692256] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-28T02:53:33.718900] [DEBUG] [LOCAL ] NRDY: Loaded 33402 existing records from primary storage. [2025-09-28T02:53:33.724465] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-28T02:53:33.720481] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:33.729091] [INFO ] [MAIN ] NRDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:33.729340] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NRDY took 0.7s. Estimated remaining: 4m 4s. Rate: 207.2 symbols/min [2025-09-28T02:53:33.767942] [DEBUG] [LOCAL ] NREF: Loaded 7957 existing records from primary storage. [2025-09-28T02:53:33.795593] [INFO ] [MAIN ] NREF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:33.796043] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NREF took 0.5s. Estimated remaining: 4m 4s. Rate: 207.3 symbols/min [2025-09-28T02:53:34.057093] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:34.156048] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:34.160089] [DEBUG] [LOCAL ] NRG: Loaded 53697 existing records from primary storage. [2025-09-28T02:53:34.162436] [INFO ] [MAIN ] NRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:34.162554] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NRG took 0.8s. Estimated remaining: 4m 4s. Rate: 207.2 symbols/min [2025-09-28T02:53:34.351902] [DEBUG] [LOCAL ] NRK: Loaded 19991 existing records from primary storage. [2025-09-28T02:53:34.400484] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:34.400784] [INFO ] [MAIN ] NRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:34.402532] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRK took 0.6s. Estimated remaining: 4m 3s. Rate: 207.2 symbols/min [2025-09-28T02:53:34.404586] [DEBUG] [LOCAL ] NRGV: Loaded 43716 existing records from primary storage. [2025-09-28T02:53:34.410434] [INFO ] [MAIN ] NRGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:34.410537] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRGV took 0.7s. Estimated remaining: 4m 3s. Rate: 207.4 symbols/min [2025-09-28T02:53:34.606958] [DEBUG] [LOCAL ] NRP: Loaded 4114 existing records from primary storage. [2025-09-28T02:53:34.615131] [INFO ] [MAIN ] NRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:34.630897] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRP took 0.5s. Estimated remaining: 4m 3s. Rate: 207.4 symbols/min [2025-09-28T02:53:34.651074] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-28T02:53:34.886215] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:34.887519] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:34.853772] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-28T02:53:34.930463] [DEBUG] [LOCAL ] NRUC: Loaded 3136 existing records from primary storage. [2025-09-28T02:53:34.959415] [INFO ] [MAIN ] NRUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:35.014745] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:35.010529] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRUC took 0.6s. Estimated remaining: 4m 2s. Rate: 207.4 symbols/min [2025-09-28T02:53:35.018544] [DEBUG] [LOCAL ] NRT: Loaded 4994 existing records from primary storage. [2025-09-28T02:53:35.063592] [INFO ] [MAIN ] NRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:35.091384] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRT took 0.7s. Estimated remaining: 4m 2s. Rate: 207.5 symbols/min [2025-09-28T02:53:35.403838] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:35.380884] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:35.425303] [DEBUG] [LOCAL ] NSA: Loaded 45528 existing records from primary storage. [2025-09-28T02:53:35.425946] [INFO ] [MAIN ] NSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:35.426060] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NSA took 0.7s. Estimated remaining: 4m 2s. Rate: 207.4 symbols/min [2025-09-28T02:53:35.638123] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:35.675202] [DEBUG] [LOCAL ] NSP: Loaded 35480 existing records from primary storage. [2025-09-28T02:53:35.691136] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-28T02:53:35.690365] [INFO ] [MAIN ] NSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:35.698587] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSP took 0.6s. Estimated remaining: 4m 2s. Rate: 207.4 symbols/min [2025-09-28T02:53:35.700209] [DEBUG] [LOCAL ] NSC: Loaded 49879 existing records from primary storage. [2025-09-28T02:53:35.701622] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-28T02:53:35.724182] [INFO ] [MAIN ] NSC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:35.740394] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSC took 0.7s. Estimated remaining: 4m 1s. Rate: 207.6 symbols/min [2025-09-28T02:53:35.934571] [DEBUG] [LOCAL ] NTB: Loaded 20927 existing records from primary storage. [2025-09-28T02:53:36.037048] [INFO ] [MAIN ] NTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:36.038996] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:36.079829] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-28T02:53:36.097826] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-28T02:53:36.097744] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTB took 0.7s. Estimated remaining: 4m 1s. Rate: 207.5 symbols/min [2025-09-28T02:53:36.097569] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:36.103621] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-28T02:53:36.121119] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-28T02:53:36.142174] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-28T02:53:36.184012] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-28T02:53:36.385043] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:36.604592] [DEBUG] [LOCAL ] NTR: Loaded 53356 existing records from primary storage. [2025-09-28T02:53:36.654521] [INFO ] [MAIN ] NTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:36.684324] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NTR took 0.9s. Estimated remaining: 4m 1s. Rate: 207.4 symbols/min [2025-09-28T02:53:36.686616] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-28T02:53:36.778053] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-28T02:53:36.838872] [DEBUG] [LOCAL ] NTST: Loaded 44211 existing records from primary storage. [2025-09-28T02:53:36.888560] [INFO ] [MAIN ] NTST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:36.897829] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:36.914304] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTST took 0.8s. Estimated remaining: 4m 0s. Rate: 207.4 symbols/min [2025-09-28T02:53:36.909022] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-28T02:53:37.129669] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:37.204441] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:37.207606] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-28T02:53:37.208128] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-28T02:53:37.207855] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-28T02:53:37.210607] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-28T02:53:37.210397] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-28T02:53:37.210829] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-28T02:53:37.212051] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-28T02:53:37.212128] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-28T02:53:37.525118] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-09-28T02:53:37.553357] [INFO ] [MAIN ] NU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:37.573975] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NU took 0.9s. Estimated remaining: 4m 0s. Rate: 207.2 symbols/min [2025-09-28T02:53:37.733708] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:37.752697] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-28T02:53:37.763870] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-28T02:53:37.766150] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-28T02:53:37.866442] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-28T02:53:37.927002] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:37.927882] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-28T02:53:37.968118] [DEBUG] [LOCAL ] NUS: Loaded 37005 existing records from primary storage. [2025-09-28T02:53:37.968465] [INFO ] [MAIN ] NUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:37.968568] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NUS took 0.4s. Estimated remaining: 4m 0s. Rate: 207.2 symbols/min [2025-09-28T02:53:38.075202] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-28T02:53:38.092518] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-28T02:53:38.151729] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:38.178469] [DEBUG] [LOCAL ] NUV: Loaded 23576 existing records from primary storage. [2025-09-28T02:53:38.178831] [INFO ] [MAIN ] NUV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:38.178951] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NUV took 0.2s. Estimated remaining: 3m 60s. Rate: 207.2 symbols/min [2025-09-28T02:53:38.361171] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:38.424114] [DEBUG] [LOCAL ] NUVB: Loaded 51998 existing records from primary storage. [2025-09-28T02:53:38.424771] [INFO ] [MAIN ] NUVB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:38.425042] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUVB took 0.2s. Estimated remaining: 3m 59s. Rate: 207.3 symbols/min [2025-09-28T02:53:38.582526] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-28T02:53:38.590870] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-28T02:53:38.624384] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:38.665427] [DEBUG] [LOCAL ] NUW: Loaded 7512 existing records from primary storage. [2025-09-28T02:53:38.667852] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-28T02:53:38.668366] [INFO ] [MAIN ] NUW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:38.668855] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUW took 0.2s. Estimated remaining: 3m 59s. Rate: 207.3 symbols/min [2025-09-28T02:53:38.697170] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-28T02:53:38.814394] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-28T02:53:38.830093] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-28T02:53:38.785431] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-28T02:53:38.892099] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-28T02:53:38.922799] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:38.957960] [DEBUG] [LOCAL ] NVG: Loaded 27703 existing records from primary storage. [2025-09-28T02:53:38.958304] [INFO ] [MAIN ] NVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:38.958411] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NVG took 0.3s. Estimated remaining: 3m 59s. Rate: 207.3 symbols/min [2025-09-28T02:53:39.145922] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:39.152867] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-28T02:53:39.155688] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-28T02:53:39.190850] [DEBUG] [LOCAL ] NVGS: Loaded 31403 existing records from primary storage. [2025-09-28T02:53:39.191182] [INFO ] [MAIN ] NVGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:39.191287] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NVGS took 0.2s. Estimated remaining: 3m 58s. Rate: 207.3 symbols/min [2025-09-28T02:53:39.300709] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.15 seconds). [2025-09-28T02:53:39.354789] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-28T02:53:39.378598] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:39.404488] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-28T02:53:39.414488] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-28T02:53:39.472449] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-09-28T02:53:39.472922] [INFO ] [MAIN ] NVO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:39.473039] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NVO took 0.3s. Estimated remaining: 3m 58s. Rate: 207.3 symbols/min [2025-09-28T02:53:39.590486] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-28T02:53:39.597490] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-28T02:53:39.674441] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:39.705256] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-28T02:53:39.734522] [DEBUG] [LOCAL ] NVR: Loaded 19323 existing records from primary storage. [2025-09-28T02:53:39.734845] [INFO ] [MAIN ] NVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:39.735331] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVR took 0.3s. Estimated remaining: 3m 58s. Rate: 207.3 symbols/min [2025-09-28T02:53:39.812795] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-28T02:53:39.921381] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:39.917818] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-28T02:53:39.963500] [DEBUG] [LOCAL ] NVRI: Loaded 39367 existing records from primary storage. [2025-09-28T02:53:39.963954] [INFO ] [MAIN ] NVRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:39.964056] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVRI took 0.2s. Estimated remaining: 3m 58s. Rate: 207.3 symbols/min [2025-09-28T02:53:40.146837] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:40.201627] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-28T02:53:40.267297] [DEBUG] [LOCAL ] NVS: Loaded 52338 existing records from primary storage. [2025-09-28T02:53:40.267801] [INFO ] [MAIN ] NVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:40.267913] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVS took 0.3s. Estimated remaining: 3m 57s. Rate: 207.3 symbols/min [2025-09-28T02:53:40.450122] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:40.509283] [DEBUG] [LOCAL ] NVST: Loaded 52381 existing records from primary storage. [2025-09-28T02:53:40.509693] [INFO ] [MAIN ] NVST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:40.510100] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVST took 0.2s. Estimated remaining: 3m 57s. Rate: 207.4 symbols/min [2025-09-28T02:53:40.698537] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:40.710715] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-28T02:53:40.757358] [DEBUG] [LOCAL ] NVT: Loaded 52330 existing records from primary storage. [2025-09-28T02:53:40.757779] [INFO ] [MAIN ] NVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:40.757882] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVT took 0.2s. Estimated remaining: 3m 57s. Rate: 207.4 symbols/min [2025-09-28T02:53:40.933836] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-28T02:53:40.966191] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:41.033855] [DEBUG] [LOCAL ] NWG: Loaded 52318 existing records from primary storage. [2025-09-28T02:53:41.034225] [INFO ] [MAIN ] NWG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:41.034628] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NWG took 0.3s. Estimated remaining: 3m 56s. Rate: 207.4 symbols/min [2025-09-28T02:53:41.221430] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:41.249378] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-28T02:53:41.284779] [DEBUG] [LOCAL ] NWN: Loaded 27222 existing records from primary storage. [2025-09-28T02:53:41.285176] [INFO ] [MAIN ] NWN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:41.285296] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NWN took 0.3s. Estimated remaining: 3m 56s. Rate: 207.4 symbols/min [2025-09-28T02:53:41.469840] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:41.511511] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-28T02:53:41.513534] [DEBUG] [LOCAL ] NX: Loaded 33894 existing records from primary storage. [2025-09-28T02:53:41.513853] [INFO ] [MAIN ] NX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:41.514071] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NX took 0.2s. Estimated remaining: 3m 56s. Rate: 207.4 symbols/min [2025-09-28T02:53:41.693572] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:41.701259] [DEBUG] [LOCAL ] NXC: Loaded 4313 existing records from primary storage. [2025-09-28T02:53:41.701485] [INFO ] [MAIN ] NXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:41.701588] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NXC took 0.2s. Estimated remaining: 3m 55s. Rate: 207.5 symbols/min [2025-09-28T02:53:42.310718] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-28T02:53:42.449822] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-28T02:53:43.110731] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-28T02:53:43.162167] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-28T02:53:43.169312] [INFO ] [REMOTE ] NPKI: Full fetch complete (53554 records). [2025-09-28T02:53:43.169478] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-28T02:53:43.364229] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:53:43.364842] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:53:43.364921] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:53:43.365011] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-28T02:53:43.365118] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-28T02:53:43.365194] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-28T02:53:43.365279] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-28T02:53:43.365389] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NPKI took 12.1s. Estimated remaining: 3m 56s. Rate: 206.8 symbols/min [2025-09-28T02:53:43.895838] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-28T02:53:43.910676] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-28T02:53:44.710796] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-28T02:53:44.802765] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-28T02:53:44.866012] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.16 seconds). [2025-09-28T02:53:44.866930] [INFO ] [REMOTE ] NTEST: Full fetch complete (1986 records). [2025-09-28T02:53:44.867031] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-28T02:53:45.061218] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-28T02:53:45.061429] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:53:45.061514] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:53:45.061636] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-28T02:53:45.061759] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-28T02:53:45.061836] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-28T02:53:45.061936] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-28T02:53:45.062039] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NTEST took 9.4s. Estimated remaining: 3m 56s. Rate: 206.2 symbols/min [2025-09-28T02:53:45.510764] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-28T02:53:46.433907] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-28T02:53:46.445146] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-28T02:53:47.226774] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-28T02:53:47.241878] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-28T02:53:48.005563] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-28T02:53:48.018355] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-28T02:53:48.724706] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-28T02:53:48.736005] [INFO ] [REMOTE ] NUE: Full fetch complete (74902 records). [2025-09-28T02:53:48.736252] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-28T02:53:48.938464] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:53:48.939286] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:53:48.939385] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:53:48.939490] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-28T02:53:48.939668] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-28T02:53:48.939767] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-28T02:53:48.939890] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-28T02:53:48.941272] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NUE took 12.0s. Estimated remaining: 3m 58s. Rate: 204.6 symbols/min [2025-09-28T02:53:49.515107] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:49.568151] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:49.625968] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:49.689084] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:49.689600] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-28T02:53:49.689692] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-28T02:53:49.689791] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-28T02:53:49.689835] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-28T02:53:49.689882] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-28T02:53:49.689919] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-28T02:53:49.817765] [DEBUG] [LOCAL ] NXG: Loaded 10647 existing records from primary storage. [2025-09-28T02:53:49.843480] [INFO ] [MAIN ] NXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:49.843005] [DEBUG] [LOCAL ] NXDT: Loaded 16531 existing records from primary storage. [2025-09-28T02:53:49.843842] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXG took 0.9s. Estimated remaining: 3m 58s. Rate: 204.3 symbols/min [2025-09-28T02:53:49.849976] [INFO ] [MAIN ] NXDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:49.906342] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXDT took 1.0s. Estimated remaining: 3m 57s. Rate: 204.4 symbols/min [2025-09-28T02:53:50.160870] [DEBUG] [LOCAL ] NXE: Loaded 53762 existing records from primary storage. [2025-09-28T02:53:50.218384] [INFO ] [MAIN ] NXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:50.323574] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXE took 1.4s. Estimated remaining: 3m 57s. Rate: 204.4 symbols/min [2025-09-28T02:53:50.408491] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:50.604111] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:50.600806] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:50.647357] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-28T02:53:50.719809] [DEBUG] [LOCAL ] NXJ: Loaded 15066 existing records from primary storage. [2025-09-28T02:53:50.722454] [DEBUG] [LOCAL ] NXN: Loaded 2376 existing records from primary storage. [2025-09-28T02:53:50.723346] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:50.723915] [INFO ] [MAIN ] NXN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:50.724277] [INFO ] [MAIN ] NXJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:50.725220] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXN took 0.7s. Estimated remaining: 3m 57s. Rate: 204.3 symbols/min [2025-09-28T02:53:50.726177] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXJ took 0.9s. Estimated remaining: 3m 57s. Rate: 204.4 symbols/min [2025-09-28T02:53:50.907879] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:53:50.953388] [DEBUG] [LOCAL ] NXP: Loaded 12465 existing records from primary storage. [2025-09-28T02:53:50.958830] [INFO ] [MAIN ] NXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:50.959314] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXP took 0.6s. Estimated remaining: 3m 56s. Rate: 204.5 symbols/min [2025-09-28T02:53:50.958559] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-28T02:53:51.022276] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:53:51.177675] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-09-28T02:53:51.167383] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:51.206093] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:53:51.200851] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:51.222056] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-28T02:53:51.234460] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-28T02:53:51.239585] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-28T02:53:51.234618] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-28T02:53:51.245850] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-28T02:53:51.246301] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-28T02:53:51.246438] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-28T02:53:51.262207] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-28T02:53:51.251632] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-28T02:53:51.283160] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXDR took 2.3s. Estimated remaining: 3m 56s. Rate: 204.5 symbols/min [2025-09-28T02:53:51.281797] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-28T02:53:51.429669] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:51.550022] [DEBUG] [LOCAL ] NXRT: Loaded 19307 existing records from primary storage. [2025-09-28T02:53:51.554681] [INFO ] [MAIN ] NXRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:51.561169] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NXRT took 0.8s. Estimated remaining: 3m 56s. Rate: 204.5 symbols/min [2025-09-28T02:53:51.790194] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:52.021481] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:52.046504] [DEBUG] [LOCAL ] NYT: Loaded 50645 existing records from primary storage. [2025-09-28T02:53:52.057246] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-28T02:53:52.062695] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-28T02:53:52.063231] [INFO ] [MAIN ] NYT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:52.063070] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-28T02:53:52.068610] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NYT took 1.1s. Estimated remaining: 3m 55s. Rate: 204.4 symbols/min [2025-09-28T02:53:52.068439] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-28T02:53:52.091916] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-28T02:53:52.183202] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-28T02:53:52.249484] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:52.293218] [DEBUG] [LOCAL ] NZF: Loaded 29361 existing records from primary storage. [2025-09-28T02:53:52.304017] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-28T02:53:52.318317] [INFO ] [MAIN ] NZF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:52.438155] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NZF took 1.2s. Estimated remaining: 3m 55s. Rate: 204.3 symbols/min [2025-09-28T02:53:52.470268] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:52.751986] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-28T02:53:52.835877] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:52.854748] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-28T02:53:52.978382] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:53:52.995638] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-28T02:53:52.998114] [DEBUG] [LOCAL ] OBDC: Loaded 52426 existing records from primary storage. [2025-09-28T02:53:52.999539] [INFO ] [MAIN ] OBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:52.999762] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. OBDC took 0.9s. Estimated remaining: 3m 55s. Rate: 204.2 symbols/min [2025-09-28T02:53:53.017885] [DEBUG] [LOCAL ] OBK: Loaded 16512 existing records from primary storage. [2025-09-28T02:53:53.046834] [INFO ] [MAIN ] OBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:53.069934] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. OBK took 0.6s. Estimated remaining: 3m 55s. Rate: 204.3 symbols/min [2025-09-28T02:53:53.195199] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-28T02:53:53.235872] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-28T02:53:53.353781] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:53.390951] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:53.405173] [DEBUG] [LOCAL ] OCFT: Loaded 8916 existing records from primary storage. [2025-09-28T02:53:53.405475] [INFO ] [MAIN ] OCFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:53.405581] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OCFT took 0.3s. Estimated remaining: 3m 54s. Rate: 204.3 symbols/min [2025-09-28T02:53:53.604273] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:53.620948] [DEBUG] [LOCAL ] OC: Loaded 45369 existing records from primary storage. [2025-09-28T02:53:53.621520] [INFO ] [MAIN ] OC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:53.621962] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OC took 0.6s. Estimated remaining: 3m 54s. Rate: 204.3 symbols/min [2025-09-28T02:53:53.702128] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-28T02:53:53.719549] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-28T02:53:53.755136] [DEBUG] [LOCAL ] ODC: Loaded 8633 existing records from primary storage. [2025-09-28T02:53:53.785583] [INFO ] [MAIN ] ODC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:53.796122] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. ODC took 0.4s. Estimated remaining: 3m 54s. Rate: 204.4 symbols/min [2025-09-28T02:53:53.821663] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:53.992725] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-28T02:53:54.015536] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:54.017304] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-28T02:53:54.059538] [DEBUG] [LOCAL ] ODV: Loaded 26258 existing records from primary storage. [2025-09-28T02:53:54.061779] [INFO ] [MAIN ] ODV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:54.061376] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-28T02:53:54.061949] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. ODV took 0.4s. Estimated remaining: 3m 53s. Rate: 204.4 symbols/min [2025-09-28T02:53:54.294495] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:54.296615] [DEBUG] [LOCAL ] OEC: Loaded 37689 existing records from primary storage. [2025-09-28T02:53:54.297813] [INFO ] [MAIN ] OEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:54.298039] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. OEC took 0.5s. Estimated remaining: 3m 53s. Rate: 204.4 symbols/min [2025-09-28T02:53:54.316005] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-28T02:53:54.398131] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-28T02:53:54.523153] [DEBUG] [LOCAL ] OFG: Loaded 22393 existing records from primary storage. [2025-09-28T02:53:54.522233] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:54.523557] [INFO ] [MAIN ] OFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:54.524007] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. OFG took 0.5s. Estimated remaining: 3m 53s. Rate: 204.5 symbols/min [2025-09-28T02:53:54.726753] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:54.763023] [DEBUG] [LOCAL ] OGE: Loaded 47046 existing records from primary storage. [2025-09-28T02:53:54.763587] [INFO ] [MAIN ] OGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:54.763739] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OGE took 0.5s. Estimated remaining: 3m 52s. Rate: 204.5 symbols/min [2025-09-28T02:53:55.083666] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:55.086463] [DEBUG] [LOCAL ] OGN: Loaded 53882 existing records from primary storage. [2025-09-28T02:53:55.087814] [INFO ] [MAIN ] OGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:55.088123] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OGN took 0.6s. Estimated remaining: 3m 52s. Rate: 204.5 symbols/min [2025-09-28T02:53:55.123722] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-28T02:53:55.391734] [DEBUG] [LOCAL ] OGS: Loaded 34591 existing records from primary storage. [2025-09-28T02:53:55.417625] [INFO ] [MAIN ] OGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:55.417299] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:55.417920] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGS took 0.7s. Estimated remaining: 3m 52s. Rate: 204.5 symbols/min [2025-09-28T02:53:55.463616] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-28T02:53:55.614711] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-28T02:53:55.732349] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:55.762592] [DEBUG] [LOCAL ] OHI: Loaded 52824 existing records from primary storage. [2025-09-28T02:53:55.763225] [INFO ] [MAIN ] OHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:55.764150] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OHI took 0.7s. Estimated remaining: 3m 52s. Rate: 204.4 symbols/min [2025-09-28T02:53:55.910822] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-28T02:53:55.987683] [DEBUG] [LOCAL ] OI: Loaded 48011 existing records from primary storage. [2025-09-28T02:53:56.015004] [INFO ] [MAIN ] OI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:56.016671] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:56.016931] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OI took 0.6s. Estimated remaining: 3m 51s. Rate: 204.4 symbols/min [2025-09-28T02:53:56.200016] [DEBUG] [LOCAL ] OIA: Loaded 14218 existing records from primary storage. [2025-09-28T02:53:56.219717] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:56.220124] [INFO ] [MAIN ] OIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:56.220547] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OIA took 0.5s. Estimated remaining: 3m 51s. Rate: 204.5 symbols/min [2025-09-28T02:53:56.270493] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-28T02:53:56.437886] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:56.458242] [DEBUG] [LOCAL ] OII: Loaded 43406 existing records from primary storage. [2025-09-28T02:53:56.458881] [INFO ] [MAIN ] OII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:56.459039] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OII took 0.4s. Estimated remaining: 3m 51s. Rate: 204.5 symbols/min [2025-09-28T02:53:56.669372] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:56.683519] [DEBUG] [LOCAL ] OIS: Loaded 41135 existing records from primary storage. [2025-09-28T02:53:56.684261] [INFO ] [MAIN ] OIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:56.684974] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OIS took 0.5s. Estimated remaining: 3m 50s. Rate: 204.5 symbols/min [2025-09-28T02:53:56.720397] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-28T02:53:56.931317] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:56.963568] [DEBUG] [LOCAL ] OKE: Loaded 54316 existing records from primary storage. [2025-09-28T02:53:56.964301] [INFO ] [MAIN ] OKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:56.964442] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OKE took 0.5s. Estimated remaining: 3m 50s. Rate: 204.5 symbols/min [2025-09-28T02:53:57.162179] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:57.186530] [DEBUG] [LOCAL ] OKLO: Loaded 54599 existing records from primary storage. [2025-09-28T02:53:57.187253] [INFO ] [MAIN ] OKLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:57.187459] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OKLO took 0.5s. Estimated remaining: 3m 50s. Rate: 204.6 symbols/min [2025-09-28T02:53:57.393488] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:57.410942] [DEBUG] [LOCAL ] OLN: Loaded 52512 existing records from primary storage. [2025-09-28T02:53:57.411456] [INFO ] [MAIN ] OLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:57.411940] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OLN took 0.4s. Estimated remaining: 3m 49s. Rate: 204.6 symbols/min [2025-09-28T02:53:57.512098] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-28T02:53:57.547836] [DEBUG] [LOCAL ] OLP: Loaded 9963 existing records from primary storage. [2025-09-28T02:53:57.587459] [INFO ] [MAIN ] OLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:57.609912] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:57.610629] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OLP took 0.4s. Estimated remaining: 3m 49s. Rate: 204.6 symbols/min [2025-09-28T02:53:57.796629] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:57.799531] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-28T02:53:57.846791] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-28T02:53:57.878141] [DEBUG] [LOCAL ] OMC: Loaded 54068 existing records from primary storage. [2025-09-28T02:53:57.878671] [INFO ] [MAIN ] OMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:57.878781] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OMC took 0.5s. Estimated remaining: 3m 49s. Rate: 204.7 symbols/min [2025-09-28T02:53:58.095945] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:58.097861] [DEBUG] [LOCAL ] OMF: Loaded 46898 existing records from primary storage. [2025-09-28T02:53:58.098710] [INFO ] [MAIN ] OMF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:58.098827] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OMF took 0.5s. Estimated remaining: 3m 48s. Rate: 204.7 symbols/min [2025-09-28T02:53:58.296712] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:58.314028] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-28T02:53:58.321113] [DEBUG] [LOCAL ] OMI: Loaded 46583 existing records from primary storage. [2025-09-28T02:53:58.321764] [INFO ] [MAIN ] OMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:58.322188] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. OMI took 0.4s. Estimated remaining: 3m 48s. Rate: 204.7 symbols/min [2025-09-28T02:53:58.339286] [DEBUG] [LOCAL ] ONIT: Loaded 7871 existing records from primary storage. [2025-09-28T02:53:58.363633] [INFO ] [MAIN ] ONIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:58.390838] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. ONIT took 0.3s. Estimated remaining: 3m 48s. Rate: 204.8 symbols/min [2025-09-28T02:53:58.685149] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:58.704632] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:58.744784] [DEBUG] [LOCAL ] ONL: Loaded 31806 existing records from primary storage. [2025-09-28T02:53:58.745242] [INFO ] [MAIN ] ONL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:58.745347] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. ONL took 0.4s. Estimated remaining: 3m 47s. Rate: 204.8 symbols/min [2025-09-28T02:53:58.910086] [DEBUG] [LOCAL ] ONON: Loaded 54392 existing records from primary storage. [2025-09-28T02:53:58.937018] [INFO ] [MAIN ] ONON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:58.970492] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. ONON took 0.6s. Estimated remaining: 3m 47s. Rate: 204.8 symbols/min [2025-09-28T02:53:58.975272] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:59.115223] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-28T02:53:59.181971] [DEBUG] [LOCAL ] ONTF: Loaded 23187 existing records from primary storage. [2025-09-28T02:53:59.180746] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:53:59.182504] [INFO ] [MAIN ] ONTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:59.183140] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONTF took 0.4s. Estimated remaining: 3m 47s. Rate: 204.9 symbols/min [2025-09-28T02:53:59.217294] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-28T02:53:59.277827] [DEBUG] [LOCAL ] ONTO: Loaded 47339 existing records from primary storage. [2025-09-28T02:53:59.278250] [INFO ] [MAIN ] ONTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:53:59.278636] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONTO took 0.3s. Estimated remaining: 3m 46s. Rate: 204.9 symbols/min [2025-09-28T02:53:59.409294] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-28T02:53:59.910731] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-28T02:54:00.214615] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-28T02:54:00.215952] [INFO ] [REMOTE ] NYC: Full fetch complete (1919 records). [2025-09-28T02:54:00.216110] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-28T02:54:00.410637] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-28T02:54:00.410855] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:54:00.410928] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:54:00.411004] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-28T02:54:00.411121] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-28T02:54:00.411247] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-28T02:54:00.411336] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-28T02:54:00.411434] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. NYC took 9.7s. Estimated remaining: 3m 46s. Rate: 204.6 symbols/min [2025-09-28T02:54:00.710740] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-28T02:54:01.562312] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-28T02:54:01.574780] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-28T02:54:02.858101] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-28T02:54:02.869638] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-28T02:54:03.694675] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-28T02:54:03.705904] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-28T02:54:04.124010] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-28T02:54:04.136284] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-28T02:54:04.931783] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-28T02:54:04.943955] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-28T02:54:05.371346] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-28T02:54:05.383762] [INFO ] [REMOTE ] O: Full fetch complete (77559 records). [2025-09-28T02:54:05.384015] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-28T02:54:05.620698] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:54:05.621484] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:54:05.621565] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:54:05.621681] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-28T02:54:05.621825] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-28T02:54:05.621904] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-28T02:54:05.622032] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-28T02:54:05.623208] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. O took 14.0s. Estimated remaining: 3m 48s. Rate: 202.5 symbols/min [2025-09-28T02:54:06.238595] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:06.318723] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:06.338989] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:06.419066] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:06.424590] [DEBUG] [LOCAL ] OPP: Loaded 11678 existing records from primary storage. [2025-09-28T02:54:06.425736] [INFO ] [MAIN ] OPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:06.426038] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPP took 0.8s. Estimated remaining: 3m 48s. Rate: 202.2 symbols/min [2025-09-28T02:54:06.563989] [DEBUG] [LOCAL ] OOMA: Loaded 19260 existing records from primary storage. [2025-09-28T02:54:06.562852] [DEBUG] [LOCAL ] OPAD: Loaded 20793 existing records from primary storage. [2025-09-28T02:54:06.565081] [INFO ] [MAIN ] OPAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:06.575793] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OPAD took 1.0s. Estimated remaining: 3m 48s. Rate: 202.3 symbols/min [2025-09-28T02:54:06.666496] [INFO ] [MAIN ] OOMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:06.744579] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:06.755080] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OOMA took 1.1s. Estimated remaining: 3m 48s. Rate: 202.4 symbols/min [2025-09-28T02:54:06.755843] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-28T02:54:06.819580] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-28T02:54:06.876123] [DEBUG] [LOCAL ] OPFI: Loaded 47258 existing records from primary storage. [2025-09-28T02:54:06.887391] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-28T02:54:06.928064] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-28T02:54:06.948819] [INFO ] [MAIN ] OPFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:06.976671] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-28T02:54:06.998550] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-28T02:54:07.002335] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:07.020963] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPFI took 1.4s. Estimated remaining: 3m 47s. Rate: 202.4 symbols/min [2025-09-28T02:54:07.223512] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:07.523346] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:07.610394] [DEBUG] [LOCAL ] OR: Loaded 46786 existing records from primary storage. [2025-09-28T02:54:07.626787] [INFO ] [MAIN ] OR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:07.681558] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. OR took 1.1s. Estimated remaining: 3m 47s. Rate: 202.2 symbols/min [2025-09-28T02:54:07.720314] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:54:07.746028] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-28T02:54:07.830142] [DEBUG] [LOCAL ] ORA: Loaded 33001 existing records from primary storage. [2025-09-28T02:54:07.863062] [INFO ] [MAIN ] ORA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:07.885436] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. ORA took 1.1s. Estimated remaining: 3m 47s. Rate: 202.2 symbols/min [2025-09-28T02:54:07.982580] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:08.055286] [DEBUG] [LOCAL ] ORC: Loaded 53083 existing records from primary storage. [2025-09-28T02:54:08.078888] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-28T02:54:08.079374] [INFO ] [MAIN ] ORC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:08.079511] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-28T02:54:08.079873] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-28T02:54:08.079799] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. ORC took 1.0s. Estimated remaining: 3m 47s. Rate: 202.3 symbols/min [2025-09-28T02:54:08.080063] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-28T02:54:08.241936] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:08.262701] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-28T02:54:08.279593] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-28T02:54:08.279707] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-28T02:54:08.279897] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-28T02:54:08.356518] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-28T02:54:08.320552] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-28T02:54:08.442863] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-28T02:54:08.475155] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-28T02:54:08.458157] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:08.476511] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-28T02:54:08.482432] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-28T02:54:08.866836] [DEBUG] [LOCAL ] ORN: Loaded 31979 existing records from primary storage. [2025-09-28T02:54:08.977014] [INFO ] [MAIN ] ORN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:09.024507] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORN took 0.9s. Estimated remaining: 3m 47s. Rate: 202.0 symbols/min [2025-09-28T02:54:09.094516] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-28T02:54:09.111836] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:54:09.128288] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-28T02:54:09.191952] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-28T02:54:09.426350] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:54:09.430569] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:09.431171] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-28T02:54:09.501229] [DEBUG] [LOCAL ] OSCR: Loaded 54502 existing records from primary storage. [2025-09-28T02:54:09.501627] [INFO ] [MAIN ] OSCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:09.501818] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. OSCR took 0.4s. Estimated remaining: 3m 46s. Rate: 201.9 symbols/min [2025-09-28T02:54:09.685801] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:09.686407] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-28T02:54:09.691468] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-28T02:54:09.691585] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-28T02:54:09.693668] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-28T02:54:09.693850] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-28T02:54:09.694198] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-28T02:54:09.694956] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-28T02:54:09.695062] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-28T02:54:10.102920] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:54:10.153462] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-28T02:54:10.167566] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-28T02:54:10.231622] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-28T02:54:10.310774] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-28T02:54:11.098844] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-28T02:54:11.110701] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-28T02:54:11.632173] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-28T02:54:11.910745] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-28T02:54:12.710704] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-28T02:54:12.753583] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-28T02:54:13.109281] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-28T02:54:13.510752] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-28T02:54:14.050999] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-28T02:54:14.310770] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-28T02:54:15.049059] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-28T02:54:15.110718] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-28T02:54:15.885544] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-28T02:54:15.910703] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-28T02:54:16.716375] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-28T02:54:16.745096] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-28T02:54:17.510693] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-28T02:54:17.544776] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-28T02:54:18.283635] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-28T02:54:18.310709] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-28T02:54:19.110719] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-28T02:54:19.141351] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-28T02:54:19.908016] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-28T02:54:19.918687] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-28T02:54:20.275935] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-28T02:54:20.710725] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-28T02:54:21.521249] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-28T02:54:21.546755] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-28T02:54:22.017431] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-28T02:54:22.310759] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-28T02:54:22.981900] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-28T02:54:23.110747] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-28T02:54:23.920262] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-28T02:54:23.925939] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-28T02:54:24.710703] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-28T02:54:24.816302] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-28T02:54:25.454805] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-28T02:54:25.510710] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-28T02:54:25.878366] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-28T02:54:26.310741] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-28T02:54:27.110734] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-28T02:54:27.168222] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-28T02:54:27.585632] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-28T02:54:27.910744] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-28T02:54:28.657335] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-28T02:54:28.710717] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-28T02:54:29.510744] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-28T02:54:29.547980] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-28T02:54:29.558031] [INFO ] [REMOTE ] ORCL: Full fetch complete (77532 records). [2025-09-28T02:54:29.558239] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-28T02:54:29.769914] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:54:29.771195] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:54:29.771286] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:54:29.771374] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-28T02:54:29.771487] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-28T02:54:29.771567] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-28T02:54:29.771682] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-28T02:54:29.772848] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. ORCL took 22.1s. Estimated remaining: 3m 56s. Rate: 193.8 symbols/min [2025-09-28T02:54:29.958954] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:29.959188] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-28T02:54:29.959262] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-28T02:54:29.959377] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-28T02:54:29.959449] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-28T02:54:29.959530] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-28T02:54:29.959602] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-28T02:54:30.313531] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-28T02:54:30.375456] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:54:30.402680] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-28T02:54:31.110701] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-28T02:54:31.152393] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-28T02:54:31.847884] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-28T02:54:31.910745] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-28T02:54:32.237767] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-28T02:54:32.710729] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-28T02:54:33.492528] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-28T02:54:33.510692] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-28T02:54:34.286391] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-28T02:54:34.296974] [INFO ] [REMOTE ] ORI: Full fetch complete (70200 records). [2025-09-28T02:54:34.297171] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-28T02:54:34.319555] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-28T02:54:34.515070] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:54:34.515891] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:54:34.516066] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:54:34.516151] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-28T02:54:34.516272] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-28T02:54:34.516352] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-28T02:54:34.516436] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-28T02:54:34.518049] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. ORI took 26.6s. Estimated remaining: 3m 57s. Rate: 192.1 symbols/min [2025-09-28T02:54:34.697427] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:34.763399] [DEBUG] [LOCAL ] OTIS: Loaded 53481 existing records from primary storage. [2025-09-28T02:54:34.763823] [INFO ] [MAIN ] OTIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:34.763926] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. OTIS took 0.2s. Estimated remaining: 3m 57s. Rate: 192.2 symbols/min [2025-09-28T02:54:34.946360] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:35.001610] [DEBUG] [LOCAL ] OUT: Loaded 48630 existing records from primary storage. [2025-09-28T02:54:35.002084] [INFO ] [MAIN ] OUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:35.003317] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OUT took 0.2s. Estimated remaining: 3m 57s. Rate: 192.2 symbols/min [2025-09-28T02:54:35.115865] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-28T02:54:35.201009] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:35.230687] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-28T02:54:35.297159] [DEBUG] [LOCAL ] OVV: Loaded 54295 existing records from primary storage. [2025-09-28T02:54:35.298048] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:54:35.298875] [INFO ] [MAIN ] OVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:35.298722] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-28T02:54:35.299184] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OVV took 0.3s. Estimated remaining: 3m 56s. Rate: 192.2 symbols/min [2025-09-28T02:54:35.299269] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:54:35.304854] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-09-28T02:54:35.344727] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:54:35.373179] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-28T02:54:35.407147] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-28T02:54:35.418282] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-28T02:54:35.463185] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-28T02:54:35.484908] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:35.485243] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OTF took 5.7s. Estimated remaining: 3m 56s. Rate: 192.2 symbols/min [2025-09-28T02:54:35.709790] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:35.741548] [DEBUG] [LOCAL ] OWLT: Loaded 9099 existing records from primary storage. [2025-09-28T02:54:35.742014] [INFO ] [MAIN ] OWLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:35.742146] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OWLT took 0.3s. Estimated remaining: 3m 56s. Rate: 192.3 symbols/min [2025-09-28T02:54:35.874122] [DEBUG] [LOCAL ] OWL: Loaded 54335 existing records from primary storage. [2025-09-28T02:54:35.895130] [INFO ] [MAIN ] OWL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:35.918205] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OWL took 0.6s. Estimated remaining: 3m 55s. Rate: 192.3 symbols/min [2025-09-28T02:54:35.916880] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-28T02:54:35.949535] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:36.151744] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:36.153776] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-28T02:54:36.163987] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-28T02:54:36.164247] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-28T02:54:36.164372] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-28T02:54:36.164554] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-28T02:54:36.164744] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-28T02:54:36.170784] [DEBUG] [LOCAL ] OXM: Loaded 33928 existing records from primary storage. [2025-09-28T02:54:36.248721] [INFO ] [MAIN ] OXM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:36.274557] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OXM took 0.5s. Estimated remaining: 3m 55s. Rate: 192.3 symbols/min [2025-09-28T02:54:36.641860] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:36.712275] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-28T02:54:36.774922] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:54:36.801541] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-28T02:54:36.810543] [INFO ] [REMOTE ] OSK: Full fetch complete (61451 records). [2025-09-28T02:54:36.810773] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-28T02:54:37.052290] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:54:37.050102] [DEBUG] [LOCAL ] PAAS: Loaded 54383 existing records from primary storage. [2025-09-28T02:54:37.053226] [INFO ] [MAIN ] PAAS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:37.053101] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:54:37.053427] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. PAAS took 0.8s. Estimated remaining: 3m 55s. Rate: 192.1 symbols/min [2025-09-28T02:54:37.053518] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:54:37.091605] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-28T02:54:37.142575] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-28T02:54:37.149685] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-28T02:54:37.157470] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-28T02:54:37.161742] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. OSK took 27.7s. Estimated remaining: 3m 54s. Rate: 192.2 symbols/min [2025-09-28T02:54:37.277438] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:37.227348] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-28T02:54:37.411937] [DEBUG] [LOCAL ] PAC: Loaded 11725 existing records from primary storage. [2025-09-28T02:54:37.439466] [INFO ] [MAIN ] PAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:37.439116] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:37.440411] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. PAC took 0.4s. Estimated remaining: 3m 54s. Rate: 192.2 symbols/min [2025-09-28T02:54:37.515539] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-28T02:54:37.655463] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:37.656883] [DEBUG] [LOCAL ] PACK: Loaded 32471 existing records from primary storage. [2025-09-28T02:54:37.657455] [INFO ] [MAIN ] PACK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:37.657610] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PACK took 0.5s. Estimated remaining: 3m 54s. Rate: 192.3 symbols/min [2025-09-28T02:54:37.861225] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:37.873190] [DEBUG] [LOCAL ] PACS: Loaded 34761 existing records from primary storage. [2025-09-28T02:54:37.873725] [INFO ] [MAIN ] PACS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:37.873830] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PACS took 0.4s. Estimated remaining: 3m 53s. Rate: 192.3 symbols/min [2025-09-28T02:54:38.073882] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:38.075134] [DEBUG] [LOCAL ] PAG: Loaded 22217 existing records from primary storage. [2025-09-28T02:54:38.082376] [INFO ] [MAIN ] PAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:38.082589] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PAG took 0.4s. Estimated remaining: 3m 53s. Rate: 192.3 symbols/min [2025-09-28T02:54:38.098237] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-28T02:54:38.159747] [INFO ] [REMOTE ] OPY: Full fetch complete (10014 records). [2025-09-28T02:54:38.193212] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-28T02:54:38.315446] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-28T02:54:38.378064] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:38.498742] [DEBUG] [LOCAL ] PAI: Loaded 2758 existing records from primary storage. [2025-09-28T02:54:38.507807] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:54:38.508405] [INFO ] [MAIN ] PAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:38.508575] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PAI took 0.4s. Estimated remaining: 3m 53s. Rate: 192.3 symbols/min [2025-09-28T02:54:38.508930] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:54:38.510841] [DEBUG] [LOCAL ] PAGS: Loaded 53447 existing records from primary storage. [2025-09-28T02:54:38.532611] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:54:38.556506] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-28T02:54:38.549177] [INFO ] [MAIN ] PAGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:38.584564] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-28T02:54:38.591547] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PAGS took 0.7s. Estimated remaining: 3m 52s. Rate: 192.4 symbols/min [2025-09-28T02:54:38.617367] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-28T02:54:38.633057] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-28T02:54:38.653743] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. OPY took 32.2s. Estimated remaining: 3m 52s. Rate: 192.5 symbols/min [2025-09-28T02:54:38.856433] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:38.911223] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-28T02:54:38.934489] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-28T02:54:39.016586] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-28T02:54:39.060737] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:39.077147] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-28T02:54:39.096471] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:39.096858] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-28T02:54:39.097680] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-28T02:54:39.322138] [DEBUG] [LOCAL ] PAM: Loaded 28420 existing records from primary storage. [2025-09-28T02:54:39.341132] [DEBUG] [LOCAL ] PAR: Loaded 33188 existing records from primary storage. [2025-09-28T02:54:39.380263] [INFO ] [MAIN ] PAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:39.385778] [INFO ] [MAIN ] PAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:39.396968] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAR took 0.7s. Estimated remaining: 3m 52s. Rate: 192.3 symbols/min [2025-09-28T02:54:39.518583] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PAM took 0.8s. Estimated remaining: 3m 51s. Rate: 192.4 symbols/min [2025-09-28T02:54:39.644913] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-28T02:54:39.790430] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:54:39.807387] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-28T02:54:39.915284] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-28T02:54:39.934283] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:39.984939] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:40.059476] [DEBUG] [LOCAL ] PARR: Loaded 49062 existing records from primary storage. [2025-09-28T02:54:40.059997] [INFO ] [MAIN ] PARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:40.060120] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PARR took 0.6s. Estimated remaining: 3m 51s. Rate: 192.3 symbols/min [2025-09-28T02:54:40.130770] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:54:40.175795] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-28T02:54:40.206720] [DEBUG] [LOCAL ] PATH: Loaded 54457 existing records from primary storage. [2025-09-28T02:54:40.205165] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:54:40.217693] [INFO ] [MAIN ] PATH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:40.217786] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-09-28T02:54:40.223068] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PATH took 0.7s. Estimated remaining: 3m 51s. Rate: 192.3 symbols/min [2025-09-28T02:54:40.233463] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:54:40.285223] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:40.318346] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-28T02:54:40.324030] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-28T02:54:40.361818] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-28T02:54:40.399551] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-28T02:54:40.470508] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PAII took 2.0s. Estimated remaining: 3m 50s. Rate: 192.4 symbols/min [2025-09-28T02:54:40.538803] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:40.593933] [DEBUG] [LOCAL ] PAXS: Loaded 21210 existing records from primary storage. [2025-09-28T02:54:40.623910] [INFO ] [MAIN ] PAXS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:40.648705] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PAXS took 0.6s. Estimated remaining: 3m 50s. Rate: 192.4 symbols/min [2025-09-28T02:54:40.829962] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:40.912537] [DEBUG] [LOCAL ] PAY: Loaded 38892 existing records from primary storage. [2025-09-28T02:54:40.940512] [INFO ] [MAIN ] PAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:40.959698] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:40.960679] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PAY took 0.7s. Estimated remaining: 3m 50s. Rate: 192.4 symbols/min [2025-09-28T02:54:41.095456] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-28T02:54:41.152009] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-28T02:54:41.213620] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:41.215843] [DEBUG] [LOCAL ] PAYC: Loaded 36903 existing records from primary storage. [2025-09-28T02:54:41.226851] [INFO ] [MAIN ] PAYC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:41.227121] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PAYC took 0.7s. Estimated remaining: 3m 49s. Rate: 192.4 symbols/min [2025-09-28T02:54:41.372961] [DEBUG] [LOCAL ] PB: Loaded 42025 existing records from primary storage. [2025-09-28T02:54:41.444763] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:41.425122] [INFO ] [MAIN ] PB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:41.445330] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PB took 0.8s. Estimated remaining: 3m 49s. Rate: 192.5 symbols/min [2025-09-28T02:54:41.597910] [DEBUG] [LOCAL ] PBA: Loaded 49665 existing records from primary storage. [2025-09-28T02:54:41.604691] [INFO ] [MAIN ] PBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:41.646970] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PBA took 0.7s. Estimated remaining: 3m 49s. Rate: 192.5 symbols/min [2025-09-28T02:54:41.677823] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:41.720879] [DEBUG] [LOCAL ] PBF: Loaded 53866 existing records from primary storage. [2025-09-28T02:54:41.728605] [INFO ] [MAIN ] PBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:41.728811] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBF took 0.5s. Estimated remaining: 3m 48s. Rate: 192.6 symbols/min [2025-09-28T02:54:41.742766] [DEBUG] [LOCAL ] PBH: Loaded 32156 existing records from primary storage. [2025-09-28T02:54:41.743079] [INFO ] [MAIN ] PBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:41.743205] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PBH took 0.3s. Estimated remaining: 3m 48s. Rate: 192.7 symbols/min [2025-09-28T02:54:41.980043] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-28T02:54:41.990207] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-28T02:54:42.756978] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-28T02:54:42.768974] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-28T02:54:43.600576] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-28T02:54:43.612418] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-28T02:54:44.520563] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-28T02:54:44.532743] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-28T02:54:45.321487] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-28T02:54:45.332478] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-28T02:54:46.186201] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-28T02:54:46.199280] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-28T02:54:47.115859] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-28T02:54:47.127730] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-28T02:54:47.872247] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-28T02:54:47.883854] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-28T02:54:47.884045] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-28T02:54:48.133063] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:54:48.133900] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:54:48.133979] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:54:48.134059] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-28T02:54:48.134188] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-28T02:54:48.134284] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-28T02:54:48.134387] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-28T02:54:48.135376] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. OXY took 12.2s. Estimated remaining: 3m 50s. Rate: 190.4 symbols/min [2025-09-28T02:54:48.817822] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:48.900490] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:48.901950] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:48.922966] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:48.942609] [DEBUG] [LOCAL ] PCF: Loaded 8720 existing records from primary storage. [2025-09-28T02:54:48.942969] [INFO ] [MAIN ] PCF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:48.943072] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PCF took 0.8s. Estimated remaining: 3m 50s. Rate: 190.3 symbols/min [2025-09-28T02:54:49.031587] [DEBUG] [LOCAL ] PBT: Loaded 17533 existing records from primary storage. [2025-09-28T02:54:49.053959] [INFO ] [MAIN ] PBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:49.054257] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PBT took 0.9s. Estimated remaining: 3m 50s. Rate: 190.3 symbols/min [2025-09-28T02:54:49.321002] [DEBUG] [LOCAL ] PBI: Loaded 50788 existing records from primary storage. [2025-09-28T02:54:49.319429] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:49.327116] [INFO ] [MAIN ] PBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:49.364938] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PBI took 1.2s. Estimated remaining: 3m 49s. Rate: 190.3 symbols/min [2025-09-28T02:54:49.422418] [DEBUG] [LOCAL ] PBR: Loaded 54492 existing records from primary storage. [2025-09-28T02:54:49.415815] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:49.428733] [INFO ] [MAIN ] PBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:49.434594] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PBR took 1.3s. Estimated remaining: 3m 49s. Rate: 190.4 symbols/min [2025-09-28T02:54:49.616612] [DEBUG] [LOCAL ] PCM: Loaded 6857 existing records from primary storage. [2025-09-28T02:54:49.644411] [INFO ] [MAIN ] PCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:49.693910] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PCM took 0.6s. Estimated remaining: 3m 49s. Rate: 190.4 symbols/min [2025-09-28T02:54:49.754947] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:49.891469] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:49.963070] [DEBUG] [LOCAL ] PCG: Loaded 54498 existing records from primary storage. [2025-09-28T02:54:49.980716] [INFO ] [MAIN ] PCG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:49.980930] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCG took 1.0s. Estimated remaining: 3m 48s. Rate: 190.5 symbols/min [2025-09-28T02:54:50.066383] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:50.176010] [DEBUG] [LOCAL ] PCN: Loaded 24709 existing records from primary storage. [2025-09-28T02:54:50.196897] [INFO ] [MAIN ] PCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:50.202334] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCN took 0.8s. Estimated remaining: 3m 48s. Rate: 190.5 symbols/min [2025-09-28T02:54:50.288875] [DEBUG] [LOCAL ] PCQ: Loaded 12298 existing records from primary storage. [2025-09-28T02:54:50.329002] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:50.308309] [DEBUG] [LOCAL ] PCOR: Loaded 48849 existing records from primary storage. [2025-09-28T02:54:50.341500] [INFO ] [MAIN ] PCQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:50.367722] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PCQ took 0.6s. Estimated remaining: 3m 48s. Rate: 190.5 symbols/min [2025-09-28T02:54:50.367580] [INFO ] [MAIN ] PCOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:50.423309] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PCOR took 1.0s. Estimated remaining: 3m 47s. Rate: 190.6 symbols/min [2025-09-28T02:54:50.586125] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:50.671813] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-28T02:54:50.672196] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-28T02:54:50.711050] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-28T02:54:50.744704] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-28T02:54:50.826755] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-28T02:54:50.830307] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-28T02:54:50.850764] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:50.939833] [DEBUG] [LOCAL ] PD: Loaded 48580 existing records from primary storage. [2025-09-28T02:54:50.980700] [INFO ] [MAIN ] PD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:50.996741] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:50.996887] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PD took 1.0s. Estimated remaining: 3m 47s. Rate: 190.5 symbols/min [2025-09-28T02:54:51.469510] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:51.485808] [DEBUG] [LOCAL ] PDM: Loaded 40354 existing records from primary storage. [2025-09-28T02:54:51.515926] [INFO ] [MAIN ] PDM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:51.548390] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PDM took 1.0s. Estimated remaining: 3m 47s. Rate: 190.5 symbols/min [2025-09-28T02:54:51.622142] [DEBUG] [LOCAL ] PDI: Loaded 50909 existing records from primary storage. [2025-09-28T02:54:51.626036] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:54:51.652304] [INFO ] [MAIN ] PDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:51.670768] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDI took 1.3s. Estimated remaining: 3m 46s. Rate: 190.5 symbols/min [2025-09-28T02:54:51.653154] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-28T02:54:51.878727] [DEBUG] [LOCAL ] PDO: Loaded 32146 existing records from primary storage. [2025-09-28T02:54:51.925156] [INFO ] [MAIN ] PDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:51.931883] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDO took 0.9s. Estimated remaining: 3m 46s. Rate: 190.6 symbols/min [2025-09-28T02:54:51.959870] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:51.988171] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-28T02:54:52.016187] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-28T02:54:52.055477] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:52.239323] [DEBUG] [LOCAL ] PDS: Loaded 18297 existing records from primary storage. [2025-09-28T02:54:52.238536] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:52.240368] [DEBUG] [LOCAL ] PDT: Loaded 17549 existing records from primary storage. [2025-09-28T02:54:52.241786] [INFO ] [MAIN ] PDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:52.241600] [INFO ] [MAIN ] PDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:52.243446] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDT took 0.6s. Estimated remaining: 3m 46s. Rate: 190.6 symbols/min [2025-09-28T02:54:52.260595] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDS took 0.7s. Estimated remaining: 3m 45s. Rate: 190.7 symbols/min [2025-09-28T02:54:52.487631] [DEBUG] [LOCAL ] PDX: Loaded 14514 existing records from primary storage. [2025-09-28T02:54:52.487840] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-28T02:54:52.490609] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-28T02:54:52.491058] [INFO ] [MAIN ] PDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:52.512491] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDX took 0.5s. Estimated remaining: 3m 45s. Rate: 190.7 symbols/min [2025-09-28T02:54:52.627725] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:52.683697] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:52.855372] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:52.859763] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-28T02:54:52.862355] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-28T02:54:52.952483] [DEBUG] [LOCAL ] PEG: Loaded 53893 existing records from primary storage. [2025-09-28T02:54:52.951143] [DEBUG] [LOCAL ] PEB: Loaded 51448 existing records from primary storage. [2025-09-28T02:54:52.953460] [INFO ] [MAIN ] PEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:52.953926] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PEG took 0.7s. Estimated remaining: 3m 45s. Rate: 190.6 symbols/min [2025-09-28T02:54:52.953662] [INFO ] [MAIN ] PEB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:52.965839] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEB took 0.7s. Estimated remaining: 3m 44s. Rate: 190.7 symbols/min [2025-09-28T02:54:53.184803] [DEBUG] [LOCAL ] PEN: Loaded 30842 existing records from primary storage. [2025-09-28T02:54:53.242020] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-28T02:54:53.323523] [INFO ] [MAIN ] PEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:53.328161] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:53.347806] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:53.349502] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-28T02:54:53.349876] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEN took 0.7s. Estimated remaining: 3m 44s. Rate: 190.7 symbols/min [2025-09-28T02:54:53.461745] [DEBUG] [LOCAL ] PEO: Loaded 10999 existing records from primary storage. [2025-09-28T02:54:53.497573] [DEBUG] [LOCAL ] PERF: Loaded 14231 existing records from primary storage. [2025-09-28T02:54:53.498867] [INFO ] [MAIN ] PERF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:53.498424] [INFO ] [MAIN ] PEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:53.499153] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEO took 0.5s. Estimated remaining: 3m 44s. Rate: 190.8 symbols/min [2025-09-28T02:54:53.545701] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PERF took 0.5s. Estimated remaining: 3m 43s. Rate: 190.9 symbols/min [2025-09-28T02:54:53.589162] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:53.602110] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-28T02:54:53.623880] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-28T02:54:53.655890] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-28T02:54:53.729782] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-28T02:54:53.730388] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-28T02:54:53.787828] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-28T02:54:53.806027] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-28T02:54:53.815403] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-28T02:54:53.941822] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:54.102828] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-28T02:54:54.104163] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:54.111397] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-28T02:54:54.210892] [DEBUG] [LOCAL ] PFD: Loaded 5199 existing records from primary storage. [2025-09-28T02:54:54.229349] [INFO ] [MAIN ] PFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:54.253482] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PFD took 0.7s. Estimated remaining: 3m 43s. Rate: 190.7 symbols/min [2025-09-28T02:54:54.465842] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-28T02:54:54.525463] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-28T02:54:54.564215] [DEBUG] [LOCAL ] PFE: Loaded 54593 existing records from primary storage. [2025-09-28T02:54:54.555866] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:54:54.575158] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-28T02:54:54.587077] [INFO ] [MAIN ] PFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:54.612109] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PFE took 1.0s. Estimated remaining: 3m 43s. Rate: 190.7 symbols/min [2025-09-28T02:54:54.647875] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:54.802800] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:54:54.826619] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-28T02:54:54.827603] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:54.827823] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:54:54.831985] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-28T02:54:54.831858] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-09-28T02:54:54.833803] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-28T02:54:54.833940] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:54:54.834407] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-28T02:54:54.835250] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-28T02:54:54.835331] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-28T02:54:54.835432] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-28T02:54:54.835526] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PEW took 1.5s. Estimated remaining: 3m 42s. Rate: 190.8 symbols/min [2025-09-28T02:54:54.932222] [DEBUG] [LOCAL ] PFH: Loaded 6911 existing records from primary storage. [2025-09-28T02:54:54.943152] [INFO ] [MAIN ] PFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:54.969625] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFH took 0.3s. Estimated remaining: 3m 42s. Rate: 190.8 symbols/min [2025-09-28T02:54:55.045088] [DEBUG] [LOCAL ] PFGC: Loaded 47650 existing records from primary storage. [2025-09-28T02:54:55.116456] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-28T02:54:55.141023] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-28T02:54:55.127794] [INFO ] [MAIN ] PFGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:55.161287] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFGC took 0.9s. Estimated remaining: 3m 42s. Rate: 190.9 symbols/min [2025-09-28T02:54:55.160272] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:55.337964] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:55.399360] [DEBUG] [LOCAL ] PFL: Loaded 13959 existing records from primary storage. [2025-09-28T02:54:55.415207] [INFO ] [MAIN ] PFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:55.420475] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFL took 0.6s. Estimated remaining: 3m 41s. Rate: 190.9 symbols/min [2025-09-28T02:54:55.479785] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-28T02:54:55.536719] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:55.567928] [INFO ] [REMOTE ] PDCC: Full fetch complete (1345 records). [2025-09-28T02:54:55.590335] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-28T02:54:55.758628] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:55.810844] [DEBUG] [LOCAL ] PFN: Loaded 21992 existing records from primary storage. [2025-09-28T02:54:55.836923] [INFO ] [MAIN ] PFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:55.869088] [DEBUG] [LOCAL ] PFLT: Loaded 44333 existing records from primary storage. [2025-09-28T02:54:55.919202] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-28T02:54:55.909930] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFN took 0.7s. Estimated remaining: 3m 41s. Rate: 190.8 symbols/min [2025-09-28T02:54:55.922293] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:54:55.922898] [DEBUG] [LOCAL ] PFO: Loaded 5948 existing records from primary storage. [2025-09-28T02:54:55.928623] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:54:55.922066] [INFO ] [MAIN ] PFLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:55.934964] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFLT took 0.9s. Estimated remaining: 3m 41s. Rate: 190.9 symbols/min [2025-09-28T02:54:55.945607] [INFO ] [MAIN ] PFO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:55.935010] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-28T02:54:56.005875] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-28T02:54:55.995086] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFO took 0.6s. Estimated remaining: 3m 40s. Rate: 191.0 symbols/min [2025-09-28T02:54:56.027593] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-28T02:54:56.170542] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-28T02:54:56.264161] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PDCC took 6.0s. Estimated remaining: 3m 40s. Rate: 191.0 symbols/min [2025-09-28T02:54:56.258719] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:56.570448] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:56.636554] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:56.689381] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:56.702558] [DEBUG] [LOCAL ] PFS: Loaded 36188 existing records from primary storage. [2025-09-28T02:54:56.703318] [INFO ] [MAIN ] PFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:56.703424] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PFS took 0.8s. Estimated remaining: 3m 40s. Rate: 191.0 symbols/min [2025-09-28T02:54:56.793210] [DEBUG] [LOCAL ] PGP: Loaded 5515 existing records from primary storage. [2025-09-28T02:54:56.817857] [INFO ] [MAIN ] PGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:56.818195] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PGP took 0.5s. Estimated remaining: 3m 39s. Rate: 191.1 symbols/min [2025-09-28T02:54:56.924627] [DEBUG] [LOCAL ] PFSI: Loaded 29259 existing records from primary storage. [2025-09-28T02:54:56.972914] [INFO ] [MAIN ] PFSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:56.984827] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PFSI took 1.0s. Estimated remaining: 3m 39s. Rate: 191.1 symbols/min [2025-09-28T02:54:57.134265] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:57.275894] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:57.260822] [DEBUG] [LOCAL ] PG: Loaded 54532 existing records from primary storage. [2025-09-28T02:54:57.307572] [INFO ] [MAIN ] PG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:57.323207] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PG took 1.3s. Estimated remaining: 3m 39s. Rate: 191.1 symbols/min [2025-09-28T02:54:57.348806] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:57.486928] [DEBUG] [LOCAL ] PGZ: Loaded 5440 existing records from primary storage. [2025-09-28T02:54:57.540454] [INFO ] [MAIN ] PGZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:57.580455] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:57.581350] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGZ took 0.6s. Estimated remaining: 3m 38s. Rate: 191.1 symbols/min [2025-09-28T02:54:57.646338] [DEBUG] [LOCAL ] PGR: Loaded 53757 existing records from primary storage. [2025-09-28T02:54:57.677713] [DEBUG] [LOCAL ] PGRE: Loaded 47177 existing records from primary storage. [2025-09-28T02:54:57.692948] [INFO ] [MAIN ] PGRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:57.699027] [INFO ] [MAIN ] PGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:57.698829] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGRE took 0.9s. Estimated remaining: 3m 38s. Rate: 191.2 symbols/min [2025-09-28T02:54:57.716526] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PGR took 1.0s. Estimated remaining: 3m 37s. Rate: 191.3 symbols/min [2025-09-28T02:54:57.817747] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:57.834791] [DEBUG] [LOCAL ] PH: Loaded 39166 existing records from primary storage. [2025-09-28T02:54:57.835395] [INFO ] [MAIN ] PH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:57.835503] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PH took 0.5s. Estimated remaining: 3m 37s. Rate: 191.4 symbols/min [2025-09-28T02:54:57.845087] [DEBUG] [LOCAL ] PHD: Loaded 10098 existing records from primary storage. [2025-09-28T02:54:57.845364] [INFO ] [MAIN ] PHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:57.845465] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PHD took 0.2s. Estimated remaining: 3m 37s. Rate: 191.5 symbols/min [2025-09-28T02:54:58.525258] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:58.518897] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:58.576860] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:58.600603] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:58.619632] [DEBUG] [LOCAL ] PHI: Loaded 15230 existing records from primary storage. [2025-09-28T02:54:58.620594] [INFO ] [MAIN ] PHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:58.620756] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHI took 0.8s. Estimated remaining: 3m 36s. Rate: 191.3 symbols/min [2025-09-28T02:54:58.790331] [DEBUG] [LOCAL ] PHK: Loaded 26792 existing records from primary storage. [2025-09-28T02:54:58.812298] [INFO ] [MAIN ] PHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:58.873160] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHK took 1.0s. Estimated remaining: 3m 36s. Rate: 191.3 symbols/min [2025-09-28T02:54:58.877822] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:58.891621] [DEBUG] [LOCAL ] PHIN: Loaded 33541 existing records from primary storage. [2025-09-28T02:54:58.952051] [INFO ] [MAIN ] PHIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:58.937561] [DEBUG] [LOCAL ] PHG: Loaded 46835 existing records from primary storage. [2025-09-28T02:54:58.969089] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHIN took 1.1s. Estimated remaining: 3m 36s. Rate: 191.4 symbols/min [2025-09-28T02:54:58.974376] [INFO ] [MAIN ] PHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:59.016783] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHG took 1.2s. Estimated remaining: 3m 35s. Rate: 191.5 symbols/min [2025-09-28T02:54:59.272612] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:59.430520] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:59.472478] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:59.491783] [DEBUG] [LOCAL ] PHM: Loaded 52386 existing records from primary storage. [2025-09-28T02:54:59.492521] [INFO ] [MAIN ] PHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:59.492778] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PHM took 0.9s. Estimated remaining: 3m 35s. Rate: 191.5 symbols/min [2025-09-28T02:54:59.583345] [DEBUG] [LOCAL ] PIM: Loaded 4814 existing records from primary storage. [2025-09-28T02:54:59.600356] [INFO ] [MAIN ] PIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:59.646739] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PIM took 0.6s. Estimated remaining: 3m 35s. Rate: 191.5 symbols/min [2025-09-28T02:54:59.815261] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:54:59.722867] [DEBUG] [LOCAL ] PHR: Loaded 38045 existing records from primary storage. [2025-09-28T02:54:59.850371] [INFO ] [MAIN ] PHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:54:59.851362] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PHR took 1.0s. Estimated remaining: 3m 34s. Rate: 191.6 symbols/min [2025-09-28T02:55:00.107544] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:00.094359] [DEBUG] [LOCAL ] PII: Loaded 49815 existing records from primary storage. [2025-09-28T02:55:00.108214] [DEBUG] [LOCAL ] PINE: Loaded 14365 existing records from primary storage. [2025-09-28T02:55:00.109376] [INFO ] [MAIN ] PII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:00.127033] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PII took 1.2s. Estimated remaining: 3m 34s. Rate: 191.6 symbols/min [2025-09-28T02:55:00.120284] [INFO ] [MAIN ] PINE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:00.164948] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PINE took 0.7s. Estimated remaining: 3m 33s. Rate: 191.7 symbols/min [2025-09-28T02:55:00.240865] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:00.568466] [DEBUG] [LOCAL ] PIPR: Loaded 15331 existing records from primary storage. [2025-09-28T02:55:00.597180] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:00.597691] [INFO ] [MAIN ] PIPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:00.623552] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:00.623969] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PIPR took 0.8s. Estimated remaining: 3m 33s. Rate: 191.6 symbols/min [2025-09-28T02:55:00.682093] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-09-28T02:55:00.720133] [INFO ] [MAIN ] PINS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:00.747809] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PINS took 1.1s. Estimated remaining: 3m 33s. Rate: 191.7 symbols/min [2025-09-28T02:55:00.992226] [DEBUG] [LOCAL ] PJT: Loaded 22579 existing records from primary storage. [2025-09-28T02:55:00.974317] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:01.006573] [INFO ] [MAIN ] PJT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:01.067751] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PJT took 0.9s. Estimated remaining: 3m 33s. Rate: 191.7 symbols/min [2025-09-28T02:55:01.093138] [DEBUG] [LOCAL ] PK: Loaded 53626 existing records from primary storage. [2025-09-28T02:55:01.101792] [INFO ] [MAIN ] PK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:01.123013] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PK took 0.9s. Estimated remaining: 3m 32s. Rate: 191.8 symbols/min [2025-09-28T02:55:01.122861] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:01.219107] [DEBUG] [LOCAL ] PKE: Loaded 12775 existing records from primary storage. [2025-09-28T02:55:01.262255] [INFO ] [MAIN ] PKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:01.286934] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PKE took 0.7s. Estimated remaining: 3m 32s. Rate: 191.8 symbols/min [2025-09-28T02:55:01.552612] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:01.659749] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:01.724133] [DEBUG] [LOCAL ] PKG: Loaded 39785 existing records from primary storage. [2025-09-28T02:55:01.783853] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:01.784116] [INFO ] [MAIN ] PKG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:01.784508] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKG took 1.0s. Estimated remaining: 3m 32s. Rate: 191.8 symbols/min [2025-09-28T02:55:01.848538] [DEBUG] [LOCAL ] PKST: Loaded 19461 existing records from primary storage. [2025-09-28T02:55:01.894995] [INFO ] [MAIN ] PKST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:01.933923] [DEBUG] [LOCAL ] PKX: Loaded 25141 existing records from primary storage. [2025-09-28T02:55:01.934040] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKST took 0.8s. Estimated remaining: 3m 31s. Rate: 191.8 symbols/min [2025-09-28T02:55:01.940801] [INFO ] [MAIN ] PKX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:01.999009] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PKX took 0.8s. Estimated remaining: 3m 31s. Rate: 191.9 symbols/min [2025-09-28T02:55:02.091136] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:02.308787] [DEBUG] [LOCAL ] PL: Loaded 53894 existing records from primary storage. [2025-09-28T02:55:02.357161] [INFO ] [MAIN ] PL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:02.386072] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PL took 1.1s. Estimated remaining: 3m 30s. Rate: 191.9 symbols/min [2025-09-28T02:55:02.395997] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:02.466134] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:02.723993] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:02.726083] [DEBUG] [LOCAL ] PLD: Loaded 54226 existing records from primary storage. [2025-09-28T02:55:02.734562] [INFO ] [MAIN ] PLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:02.737495] [DEBUG] [LOCAL ] PLOW: Loaded 20792 existing records from primary storage. [2025-09-28T02:55:02.738658] [INFO ] [MAIN ] PLOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:02.737716] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PLD took 0.9s. Estimated remaining: 3m 30s. Rate: 191.9 symbols/min [2025-09-28T02:55:02.751209] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLOW took 0.6s. Estimated remaining: 3m 30s. Rate: 192.0 symbols/min [2025-09-28T02:55:02.840176] [DEBUG] [LOCAL ] PLNT: Loaded 49144 existing records from primary storage. [2025-09-28T02:55:02.909812] [INFO ] [MAIN ] PLNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:02.978618] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLNT took 1.0s. Estimated remaining: 3m 29s. Rate: 192.0 symbols/min [2025-09-28T02:55:03.152457] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:03.256871] [DEBUG] [LOCAL ] PLYM: Loaded 33884 existing records from primary storage. [2025-09-28T02:55:03.322966] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:03.336436] [INFO ] [MAIN ] PLYM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:03.344424] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PLYM took 0.9s. Estimated remaining: 3m 29s. Rate: 192.0 symbols/min [2025-09-28T02:55:03.454699] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:03.535455] [DEBUG] [LOCAL ] PML: Loaded 20999 existing records from primary storage. [2025-09-28T02:55:03.566117] [INFO ] [MAIN ] PML: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:03.571294] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PML took 0.8s. Estimated remaining: 3m 29s. Rate: 192.0 symbols/min [2025-09-28T02:55:03.727539] [DEBUG] [LOCAL ] PMM: Loaded 10760 existing records from primary storage. [2025-09-28T02:55:03.694346] [DEBUG] [LOCAL ] PM: Loaded 54445 existing records from primary storage. [2025-09-28T02:55:03.750377] [INFO ] [MAIN ] PMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:03.732841] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:03.761127] [INFO ] [MAIN ] PM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:03.755765] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PMM took 0.7s. Estimated remaining: 3m 28s. Rate: 192.1 symbols/min [2025-09-28T02:55:03.796022] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PM took 1.0s. Estimated remaining: 3m 28s. Rate: 192.2 symbols/min [2025-09-28T02:55:04.060996] [DEBUG] [LOCAL ] PMO: Loaded 10547 existing records from primary storage. [2025-09-28T02:55:04.108849] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:04.107565] [INFO ] [MAIN ] PMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:04.160504] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMO took 0.8s. Estimated remaining: 3m 28s. Rate: 192.1 symbols/min [2025-09-28T02:55:04.247229] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:04.307552] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:04.332787] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-28T02:55:04.343447] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-28T02:55:04.355321] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-28T02:55:04.372283] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-28T02:55:04.372468] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-28T02:55:04.395065] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-28T02:55:04.394812] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-28T02:55:04.395668] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-28T02:55:04.395867] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-28T02:55:04.402113] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-28T02:55:04.401960] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-28T02:55:04.423053] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-28T02:55:04.505522] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:04.705133] [DEBUG] [LOCAL ] PMT: Loaded 40798 existing records from primary storage. [2025-09-28T02:55:04.720447] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-28T02:55:04.735835] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-28T02:55:04.746458] [INFO ] [MAIN ] PMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:04.767864] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-28T02:55:04.783762] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMT took 1.2s. Estimated remaining: 3m 27s. Rate: 192.0 symbols/min [2025-09-28T02:55:04.823852] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-28T02:55:04.865097] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-28T02:55:04.897889] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-28T02:55:05.859560] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:05.934992] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-28T02:55:05.985714] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:05.968183] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:06.006217] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-28T02:55:06.216814] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:06.217916] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:55:06.218414] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-28T02:55:06.219979] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-28T02:55:06.220092] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:55:06.220171] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-09-28T02:55:06.220239] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:55:06.220316] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-28T02:55:06.220516] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-28T02:55:06.220573] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-28T02:55:06.220639] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-28T02:55:06.220826] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMTV took 2.4s. Estimated remaining: 3m 28s. Rate: 191.6 symbols/min [2025-09-28T02:55:06.322431] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-28T02:55:06.377163] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-28T02:55:06.435963] [DEBUG] [LOCAL ] PNC: Loaded 53000 existing records from primary storage. [2025-09-28T02:55:06.452762] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:55:06.480433] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-28T02:55:06.473037] [INFO ] [MAIN ] PNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:06.491260] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:55:06.517556] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:06.517926] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-09-28T02:55:06.518076] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PNC took 1.7s. Estimated remaining: 3m 27s. Rate: 191.6 symbols/min [2025-09-28T02:55:06.518261] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:55:06.545868] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-28T02:55:06.596982] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-28T02:55:06.667090] [DEBUG] [LOCAL ] PNI: Loaded 6782 existing records from primary storage. [2025-09-28T02:55:06.667282] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-28T02:55:06.667577] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-28T02:55:06.667880] [INFO ] [MAIN ] PNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:06.669310] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PNI took 0.4s. Estimated remaining: 3m 27s. Rate: 191.7 symbols/min [2025-09-28T02:55:06.719793] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-28T02:55:06.785210] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-28T02:55:06.784159] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:06.751172] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PMTW took 2.5s. Estimated remaining: 3m 26s. Rate: 191.8 symbols/min [2025-09-28T02:55:07.081970] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:07.141326] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-28T02:55:07.169886] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:07.171269] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-28T02:55:07.187871] [DEBUG] [LOCAL ] PNNT: Loaded 33337 existing records from primary storage. [2025-09-28T02:55:07.188468] [INFO ] [MAIN ] PNNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:07.188906] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNNT took 0.7s. Estimated remaining: 3m 26s. Rate: 191.7 symbols/min [2025-09-28T02:55:07.444137] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:07.447232] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-28T02:55:07.476515] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-28T02:55:07.480585] [DEBUG] [LOCAL ] PNR: Loaded 48589 existing records from primary storage. [2025-09-28T02:55:07.481286] [INFO ] [MAIN ] PNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:07.481431] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNR took 0.8s. Estimated remaining: 3m 26s. Rate: 191.7 symbols/min [2025-09-28T02:55:07.494284] [DEBUG] [LOCAL ] PNW: Loaded 46531 existing records from primary storage. [2025-09-28T02:55:07.537755] [INFO ] [MAIN ] PNW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:07.559351] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. PNW took 0.8s. Estimated remaining: 3m 26s. Rate: 191.8 symbols/min [2025-09-28T02:55:07.787513] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:07.806633] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-28T02:55:07.830434] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-28T02:55:07.879931] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:07.903365] [DEBUG] [LOCAL ] POR: Loaded 47706 existing records from primary storage. [2025-09-28T02:55:07.904032] [INFO ] [MAIN ] POR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:07.904382] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. POR took 0.7s. Estimated remaining: 3m 25s. Rate: 191.8 symbols/min [2025-09-28T02:55:08.062710] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-28T02:55:08.083156] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-28T02:55:08.100473] [DEBUG] [LOCAL ] POST: Loaded 39494 existing records from primary storage. [2025-09-28T02:55:08.137236] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:08.138242] [INFO ] [MAIN ] POST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:08.138833] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. POST took 0.7s. Estimated remaining: 3m 25s. Rate: 191.8 symbols/min [2025-09-28T02:55:08.289679] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-09-28T02:55:08.297518] [DEBUG] [LOCAL ] PPG: Loaded 51455 existing records from primary storage. [2025-09-28T02:55:08.314726] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-28T02:55:08.353878] [INFO ] [MAIN ] PPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:08.374881] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:08.373149] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. PPG took 0.8s. Estimated remaining: 3m 25s. Rate: 191.9 symbols/min [2025-09-28T02:55:08.415246] [DEBUG] [LOCAL ] PPL: Loaded 54285 existing records from primary storage. [2025-09-28T02:55:08.415821] [INFO ] [MAIN ] PPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:08.415932] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPL took 0.5s. Estimated remaining: 3m 24s. Rate: 192.0 symbols/min [2025-09-28T02:55:08.432542] [DEBUG] [LOCAL ] PPT: Loaded 20342 existing records from primary storage. [2025-09-28T02:55:08.432914] [INFO ] [MAIN ] PPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:08.433018] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PPT took 0.3s. Estimated remaining: 3m 24s. Rate: 192.1 symbols/min [2025-09-28T02:55:08.550362] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-28T02:55:08.551377] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-28T02:55:08.774713] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-28T02:55:08.775719] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-28T02:55:09.004382] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-28T02:55:09.005363] [INFO ] [REMOTE ] PMTU: Full fetch complete (1236 records). [2025-09-28T02:55:09.005486] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-28T02:55:09.202482] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:55:09.202765] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:55:09.202864] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:55:09.202971] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-28T02:55:09.203105] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-28T02:55:09.203201] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-28T02:55:09.203331] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-28T02:55:09.203462] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PMTU took 5.4s. Estimated remaining: 3m 24s. Rate: 191.9 symbols/min [2025-09-28T02:55:09.907103] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:09.961703] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:09.946839] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:09.981467] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-28T02:55:09.982723] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:09.983273] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-28T02:55:09.983896] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-28T02:55:09.983973] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-28T02:55:09.984121] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-28T02:55:09.984252] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-28T02:55:10.343393] [DEBUG] [LOCAL ] PRG: Loaded 30420 existing records from primary storage. [2025-09-28T02:55:10.344209] [DEBUG] [LOCAL ] PRA: Loaded 35243 existing records from primary storage. [2025-09-28T02:55:10.372310] [INFO ] [MAIN ] PRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:10.372473] [INFO ] [MAIN ] PRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:10.399680] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRG took 1.2s. Estimated remaining: 3m 24s. Rate: 191.6 symbols/min [2025-09-28T02:55:10.410595] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRA took 1.2s. Estimated remaining: 3m 23s. Rate: 191.7 symbols/min [2025-09-28T02:55:10.504477] [DEBUG] [LOCAL ] PR: Loaded 54389 existing records from primary storage. [2025-09-28T02:55:10.630359] [INFO ] [MAIN ] PR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:10.737622] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:10.739094] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PR took 1.5s. Estimated remaining: 3m 23s. Rate: 191.7 symbols/min [2025-09-28T02:55:10.756780] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-28T02:55:10.929342] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:10.966499] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:11.067310] [DEBUG] [LOCAL ] PRH: Loaded 4908 existing records from primary storage. [2025-09-28T02:55:11.119998] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:11.120218] [INFO ] [MAIN ] PRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:11.121061] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PRH took 0.6s. Estimated remaining: 3m 23s. Rate: 191.7 symbols/min [2025-09-28T02:55:11.254062] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-28T02:55:11.255539] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-28T02:55:11.342993] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:11.339115] [DEBUG] [LOCAL ] PRI: Loaded 18636 existing records from primary storage. [2025-09-28T02:55:11.357621] [INFO ] [MAIN ] PRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:11.358554] [DEBUG] [LOCAL ] PRGO: Loaded 47634 existing records from primary storage. [2025-09-28T02:55:11.359022] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRI took 0.6s. Estimated remaining: 3m 22s. Rate: 191.7 symbols/min [2025-09-28T02:55:11.359127] [INFO ] [MAIN ] PRGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:11.370918] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRGO took 1.0s. Estimated remaining: 3m 22s. Rate: 191.8 symbols/min [2025-09-28T02:55:11.711965] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:11.751878] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:11.779572] [DEBUG] [LOCAL ] PRIM: Loaded 45072 existing records from primary storage. [2025-09-28T02:55:11.780196] [INFO ] [MAIN ] PRIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:11.780432] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRIM took 0.7s. Estimated remaining: 3m 21s. Rate: 191.8 symbols/min [2025-09-28T02:55:11.813753] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-28T02:55:11.816128] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-28T02:55:11.945875] [DEBUG] [LOCAL ] PRLB: Loaded 20919 existing records from primary storage. [2025-09-28T02:55:11.980787] [INFO ] [MAIN ] PRLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:12.009032] [DEBUG] [LOCAL ] PRKS: Loaded 43308 existing records from primary storage. [2025-09-28T02:55:12.035551] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRLB took 0.6s. Estimated remaining: 3m 21s. Rate: 191.8 symbols/min [2025-09-28T02:55:12.036777] [INFO ] [MAIN ] PRKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:12.041063] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:12.053589] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRKS took 0.7s. Estimated remaining: 3m 21s. Rate: 191.9 symbols/min [2025-09-28T02:55:12.251162] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-28T02:55:12.291530] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-28T02:55:12.425932] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:12.466538] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:12.489622] [DEBUG] [LOCAL ] PRM: Loaded 45298 existing records from primary storage. [2025-09-28T02:55:12.490339] [INFO ] [MAIN ] PRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:12.490807] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRM took 0.7s. Estimated remaining: 3m 20s. Rate: 191.9 symbols/min [2025-09-28T02:55:12.750505] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:12.754952] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-28T02:55:12.770695] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-28T02:55:12.788193] [DEBUG] [LOCAL ] PRO: Loaded 38444 existing records from primary storage. [2025-09-28T02:55:12.773302] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-28T02:55:12.773163] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-28T02:55:12.791456] [INFO ] [MAIN ] PRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:12.791282] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-28T02:55:12.791831] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-28T02:55:12.791960] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-28T02:55:12.791744] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRO took 0.7s. Estimated remaining: 3m 20s. Rate: 191.9 symbols/min [2025-09-28T02:55:12.792169] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-28T02:55:12.804971] [DEBUG] [LOCAL ] PRMB: Loaded 53928 existing records from primary storage. [2025-09-28T02:55:12.892407] [INFO ] [MAIN ] PRMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:12.972029] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRMB took 0.9s. Estimated remaining: 3m 20s. Rate: 191.9 symbols/min [2025-09-28T02:55:13.232453] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:13.461714] [DEBUG] [LOCAL ] PRT: Loaded 5402 existing records from primary storage. [2025-09-28T02:55:13.499252] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-28T02:55:13.501333] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:13.506739] [INFO ] [MAIN ] PRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:13.508943] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRT took 0.7s. Estimated remaining: 3m 20s. Rate: 191.8 symbols/min [2025-09-28T02:55:13.509284] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-28T02:55:13.683288] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:13.696111] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-28T02:55:13.817710] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:13.818034] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-28T02:55:13.818113] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-28T02:55:13.818348] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-28T02:55:13.818430] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-28T02:55:13.818541] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-28T02:55:13.818619] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-28T02:55:13.965941] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:55:13.975491] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-28T02:55:13.977588] [DEBUG] [LOCAL ] PRU: Loaded 52204 existing records from primary storage. [2025-09-28T02:55:14.001573] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-28T02:55:13.996242] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-28T02:55:14.022722] [INFO ] [MAIN ] PRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:14.033861] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:55:14.066367] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRU took 1.0s. Estimated remaining: 3m 19s. Rate: 191.7 symbols/min [2025-09-28T02:55:14.073039] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-09-28T02:55:14.080319] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:55:14.197368] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-28T02:55:14.254452] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-28T02:55:14.254620] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-28T02:55:14.286308] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-28T02:55:14.294436] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRSU took 1.8s. Estimated remaining: 3m 19s. Rate: 191.8 symbols/min [2025-09-28T02:55:14.540983] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:14.582542] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:14.550561] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-28T02:55:14.599113] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-28T02:55:14.615693] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-28T02:55:14.695051] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:14.705897] [DEBUG] [LOCAL ] PSBD: Loaded 7130 existing records from primary storage. [2025-09-28T02:55:14.706288] [INFO ] [MAIN ] PSBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:14.706394] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PSBD took 0.4s. Estimated remaining: 3m 19s. Rate: 191.7 symbols/min [2025-09-28T02:55:14.828442] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-09-28T02:55:14.846343] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-28T02:55:14.890029] [DEBUG] [LOCAL ] PSA: Loaded 42474 existing records from primary storage. [2025-09-28T02:55:14.924950] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:14.921159] [INFO ] [MAIN ] PSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:14.925289] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PSA took 0.9s. Estimated remaining: 3m 18s. Rate: 191.8 symbols/min [2025-09-28T02:55:15.036531] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-28T02:55:15.049936] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-28T02:55:15.048366] [DEBUG] [LOCAL ] PSF: Loaded 6990 existing records from primary storage. [2025-09-28T02:55:15.055447] [INFO ] [MAIN ] PSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:15.055579] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PSF took 0.3s. Estimated remaining: 3m 18s. Rate: 191.8 symbols/min [2025-09-28T02:55:15.220913] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:15.329954] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:15.333563] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-28T02:55:15.335144] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-28T02:55:15.365862] [DEBUG] [LOCAL ] PSFE: Loaded 30702 existing records from primary storage. [2025-09-28T02:55:15.366384] [INFO ] [MAIN ] PSFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:15.366526] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSFE took 0.4s. Estimated remaining: 3m 18s. Rate: 191.8 symbols/min [2025-09-28T02:55:15.479272] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-28T02:55:15.566454] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:15.584012] [DEBUG] [LOCAL ] PSN: Loaded 46808 existing records from primary storage. [2025-09-28T02:55:15.584521] [INFO ] [MAIN ] PSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:15.584701] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSN took 0.5s. Estimated remaining: 3m 17s. Rate: 191.9 symbols/min [2025-09-28T02:55:15.677871] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-28T02:55:15.698054] [INFO ] [REMOTE ] PRCS: Full fetch complete (3804 records). [2025-09-28T02:55:15.755995] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-28T02:55:15.805258] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:15.914306] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-28T02:55:15.967611] [DEBUG] [LOCAL ] PSO: Loaded 37751 existing records from primary storage. [2025-09-28T02:55:16.039766] [INFO ] [MAIN ] PSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:16.039633] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:55:16.040027] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSO took 0.7s. Estimated remaining: 3m 17s. Rate: 191.8 symbols/min [2025-09-28T02:55:16.061452] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:55:16.107378] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:55:16.162678] [DEBUG] [LOCAL ] PSQH: Loaded 35426 existing records from primary storage. [2025-09-28T02:55:16.157903] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-28T02:55:16.163241] [INFO ] [MAIN ] PSQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:16.163098] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-28T02:55:16.169058] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSQH took 0.6s. Estimated remaining: 3m 17s. Rate: 191.9 symbols/min [2025-09-28T02:55:16.174328] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-28T02:55:16.190080] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-28T02:55:16.235389] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PRCS took 7.0s. Estimated remaining: 3m 16s. Rate: 192.0 symbols/min [2025-09-28T02:55:16.277510] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-28T02:55:16.277286] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:16.610569] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:16.614873] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:16.654004] [DEBUG] [LOCAL ] PSTL: Loaded 20585 existing records from primary storage. [2025-09-28T02:55:16.656594] [INFO ] [MAIN ] PSTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:16.672415] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSTL took 0.5s. Estimated remaining: 3m 16s. Rate: 191.9 symbols/min [2025-09-28T02:55:16.708179] [DEBUG] [LOCAL ] PSTG: Loaded 53626 existing records from primary storage. [2025-09-28T02:55:16.713673] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-28T02:55:16.746671] [INFO ] [MAIN ] PSTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:16.769465] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PSTG took 0.7s. Estimated remaining: 3m 16s. Rate: 192.0 symbols/min [2025-09-28T02:55:16.923398] [DEBUG] [LOCAL ] PSX: Loaded 53912 existing records from primary storage. [2025-09-28T02:55:17.007668] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:17.011932] [INFO ] [MAIN ] PSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:17.017822] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSX took 0.7s. Estimated remaining: 3m 15s. Rate: 192.0 symbols/min [2025-09-28T02:55:17.077979] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-28T02:55:17.173384] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:17.221740] [DEBUG] [LOCAL ] PTA: Loaded 15299 existing records from primary storage. [2025-09-28T02:55:17.243702] [INFO ] [MAIN ] PTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:17.296899] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PTA took 0.6s. Estimated remaining: 3m 15s. Rate: 192.0 symbols/min [2025-09-28T02:55:17.301241] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:17.491527] [DEBUG] [LOCAL ] PTY: Loaded 37902 existing records from primary storage. [2025-09-28T02:55:17.506014] [INFO ] [MAIN ] PTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:17.523538] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-28T02:55:17.528212] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PTY took 0.7s. Estimated remaining: 3m 15s. Rate: 192.1 symbols/min [2025-09-28T02:55:17.528063] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:17.670815] [DEBUG] [LOCAL ] PUK: Loaded 45565 existing records from primary storage. [2025-09-28T02:55:17.692099] [INFO ] [MAIN ] PUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:17.712942] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PUK took 0.7s. Estimated remaining: 3m 14s. Rate: 192.1 symbols/min [2025-09-28T02:55:17.783202] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:17.927007] [DEBUG] [LOCAL ] PUMP: Loaded 50160 existing records from primary storage. [2025-09-28T02:55:17.955505] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-28T02:55:17.982803] [INFO ] [MAIN ] PUMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:17.989138] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:17.989522] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PUMP took 0.7s. Estimated remaining: 3m 14s. Rate: 192.1 symbols/min [2025-09-28T02:55:18.099579] [DEBUG] [LOCAL ] PVL: Loaded 4819 existing records from primary storage. [2025-09-28T02:55:18.126742] [INFO ] [MAIN ] PVL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:18.128068] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PVL took 0.4s. Estimated remaining: 3m 14s. Rate: 192.2 symbols/min [2025-09-28T02:55:18.318561] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-28T02:55:18.278699] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:18.299223] [DEBUG] [LOCAL ] PVH: Loaded 51137 existing records from primary storage. [2025-09-28T02:55:18.345178] [INFO ] [MAIN ] PVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:18.345557] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PVH took 0.8s. Estimated remaining: 3m 13s. Rate: 192.2 symbols/min [2025-09-28T02:55:18.515463] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:18.614761] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:18.629105] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-28T02:55:18.663374] [DEBUG] [LOCAL ] PWR: Loaded 48047 existing records from primary storage. [2025-09-28T02:55:18.664190] [INFO ] [MAIN ] PWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:18.664318] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PWR took 0.7s. Estimated remaining: 3m 13s. Rate: 192.2 symbols/min [2025-09-28T02:55:18.800002] [DEBUG] [LOCAL ] PX: Loaded 35085 existing records from primary storage. [2025-09-28T02:55:18.811577] [INFO ] [MAIN ] PX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:18.850325] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PX took 0.7s. Estimated remaining: 3m 13s. Rate: 192.3 symbols/min [2025-09-28T02:55:18.899014] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:19.029478] [DEBUG] [LOCAL ] QBTS: Loaded 54526 existing records from primary storage. [2025-09-28T02:55:19.051820] [INFO ] [MAIN ] QBTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:19.117624] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-28T02:55:19.087538] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. QBTS took 0.7s. Estimated remaining: 3m 12s. Rate: 192.3 symbols/min [2025-09-28T02:55:19.117475] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:19.252282] [DEBUG] [LOCAL ] QD: Loaded 28475 existing records from primary storage. [2025-09-28T02:55:19.307313] [INFO ] [MAIN ] QD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:19.348365] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:19.348672] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QD took 0.7s. Estimated remaining: 3m 12s. Rate: 192.3 symbols/min [2025-09-28T02:55:19.468879] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-28T02:55:19.579860] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:19.583960] [DEBUG] [LOCAL ] QGEN: Loaded 49874 existing records from primary storage. [2025-09-28T02:55:19.584756] [INFO ] [MAIN ] QGEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:19.585101] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QGEN took 0.7s. Estimated remaining: 3m 12s. Rate: 192.3 symbols/min [2025-09-28T02:55:19.631941] [DEBUG] [LOCAL ] QS: Loaded 54522 existing records from primary storage. [2025-09-28T02:55:19.632412] [INFO ] [MAIN ] QS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:19.632515] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QS took 0.5s. Estimated remaining: 3m 11s. Rate: 192.4 symbols/min [2025-09-28T02:55:19.671237] [DEBUG] [LOCAL ] QSR: Loaded 53178 existing records from primary storage. [2025-09-28T02:55:19.671706] [INFO ] [MAIN ] QSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:19.671814] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QSR took 0.3s. Estimated remaining: 3m 11s. Rate: 192.5 symbols/min [2025-09-28T02:55:19.910735] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-28T02:55:20.141125] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-28T02:55:20.710756] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-28T02:55:20.926770] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-28T02:55:21.510752] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-28T02:55:21.731518] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-28T02:55:21.732528] [INFO ] [REMOTE ] PRVS: Full fetch complete (1271 records). [2025-09-28T02:55:21.732626] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-28T02:55:21.922470] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-28T02:55:21.922693] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:55:21.922768] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:55:21.922858] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-28T02:55:21.922958] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-28T02:55:21.923034] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-28T02:55:21.923117] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-28T02:55:21.923227] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. PRVS took 8.4s. Estimated remaining: 3m 11s. Rate: 191.8 symbols/min [2025-09-28T02:55:22.667068] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:22.706535] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:22.730194] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:22.731452] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:22.751289] [DEBUG] [LOCAL ] QVCD: Loaded 4542 existing records from primary storage. [2025-09-28T02:55:22.757384] [INFO ] [MAIN ] QVCD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:22.758229] [DEBUG] [LOCAL ] QVCC: Loaded 9018 existing records from primary storage. [2025-09-28T02:55:22.765396] [INFO ] [MAIN ] QVCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:22.764878] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCD took 0.8s. Estimated remaining: 3m 11s. Rate: 191.6 symbols/min [2025-09-28T02:55:22.771138] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QVCC took 0.8s. Estimated remaining: 3m 11s. Rate: 191.8 symbols/min [2025-09-28T02:55:22.891138] [DEBUG] [LOCAL ] QUAD: Loaded 23938 existing records from primary storage. [2025-09-28T02:55:22.933867] [INFO ] [MAIN ] QUAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:22.985045] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 10s. Rate: 191.8 symbols/min [2025-09-28T02:55:23.029622] [DEBUG] [LOCAL ] QTWO: Loaded 39754 existing records from primary storage. [2025-09-28T02:55:23.062318] [INFO ] [MAIN ] QTWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:23.113778] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 10s. Rate: 191.9 symbols/min [2025-09-28T02:55:23.221919] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:23.268436] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:23.512362] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:23.611291] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:23.623768] [DEBUG] [LOCAL ] R: Loaded 29775 existing records from primary storage. [2025-09-28T02:55:23.625901] [INFO ] [MAIN ] R: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:23.626519] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. R took 0.8s. Estimated remaining: 3m 10s. Rate: 191.8 symbols/min [2025-09-28T02:55:23.700133] [DEBUG] [LOCAL ] QXO: Loaded 53964 existing records from primary storage. [2025-09-28T02:55:23.719831] [INFO ] [MAIN ] QXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:23.742405] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. QXO took 1.0s. Estimated remaining: 3m 9s. Rate: 191.9 symbols/min [2025-09-28T02:55:23.785574] [DEBUG] [LOCAL ] RA: Loaded 22045 existing records from primary storage. [2025-09-28T02:55:23.818392] [INFO ] [MAIN ] RA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:23.851485] [DEBUG] [LOCAL ] RACE: Loaded 33300 existing records from primary storage. [2025-09-28T02:55:23.866886] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. RA took 0.8s. Estimated remaining: 3m 9s. Rate: 191.9 symbols/min [2025-09-28T02:55:23.964145] [INFO ] [MAIN ] RACE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:24.041874] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:24.079791] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RACE took 0.8s. Estimated remaining: 3m 8s. Rate: 192.0 symbols/min [2025-09-28T02:55:24.291865] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:24.423933] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:24.497939] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:24.500334] [DEBUG] [LOCAL ] RAMP: Loaded 38208 existing records from primary storage. [2025-09-28T02:55:24.501178] [INFO ] [MAIN ] RAMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:24.501311] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RAMP took 0.9s. Estimated remaining: 3m 8s. Rate: 191.9 symbols/min [2025-09-28T02:55:24.630913] [DEBUG] [LOCAL ] RBC: Loaded 15326 existing records from primary storage. [2025-09-28T02:55:24.636134] [INFO ] [MAIN ] RBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:24.658716] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBC took 0.8s. Estimated remaining: 3m 8s. Rate: 192.0 symbols/min [2025-09-28T02:55:24.813104] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:24.860040] [DEBUG] [LOCAL ] RBA: Loaded 46598 existing records from primary storage. [2025-09-28T02:55:24.891887] [INFO ] [MAIN ] RBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:24.908306] [DEBUG] [LOCAL ] RBOT: Loaded 5223 existing records from primary storage. [2025-09-28T02:55:24.909229] [INFO ] [MAIN ] RBOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:24.910145] [DEBUG] [LOCAL ] RBLX: Loaded 54496 existing records from primary storage. [2025-09-28T02:55:24.908576] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBA took 1.1s. Estimated remaining: 3m 8s. Rate: 192.0 symbols/min [2025-09-28T02:55:24.931324] [INFO ] [MAIN ] RBLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:24.956422] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBOT took 0.5s. Estimated remaining: 3m 7s. Rate: 192.1 symbols/min [2025-09-28T02:55:24.996506] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBLX took 0.9s. Estimated remaining: 3m 7s. Rate: 192.2 symbols/min [2025-09-28T02:55:25.087121] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:25.380610] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:25.499430] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:25.569771] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-28T02:55:25.574890] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-28T02:55:25.574481] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:25.575194] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-28T02:55:25.575146] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-28T02:55:25.575422] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-28T02:55:25.575632] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-28T02:55:25.575512] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-28T02:55:25.575896] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-28T02:55:25.575844] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-28T02:55:25.592330] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-28T02:55:25.653163] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-28T02:55:25.672911] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-28T02:55:25.845952] [DEBUG] [LOCAL ] RBRK: Loaded 53892 existing records from primary storage. [2025-09-28T02:55:25.867076] [INFO ] [MAIN ] RBRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:25.929044] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RBRK took 1.2s. Estimated remaining: 3m 7s. Rate: 192.0 symbols/min [2025-09-28T02:55:26.007750] [DEBUG] [LOCAL ] RC: Loaded 49676 existing records from primary storage. [2025-09-28T02:55:26.090218] [INFO ] [MAIN ] RC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:26.236878] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RC took 1.3s. Estimated remaining: 3m 6s. Rate: 192.0 symbols/min [2025-09-28T02:55:26.547285] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:26.731725] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:26.782091] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-28T02:55:26.858833] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:26.869996] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-28T02:55:26.899429] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:26.948568] [DEBUG] [LOCAL ] RCI: Loaded 49383 existing records from primary storage. [2025-09-28T02:55:26.949179] [INFO ] [MAIN ] RCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:26.949899] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RCI took 1.0s. Estimated remaining: 3m 6s. Rate: 191.8 symbols/min [2025-09-28T02:55:27.118468] [DEBUG] [LOCAL ] RCL: Loaded 52876 existing records from primary storage. [2025-09-28T02:55:27.136921] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-28T02:55:27.143505] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-28T02:55:27.158912] [INFO ] [MAIN ] RCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:27.193479] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCL took 0.9s. Estimated remaining: 3m 6s. Rate: 191.8 symbols/min [2025-09-28T02:55:27.193387] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:27.334523] [DEBUG] [LOCAL ] RCS: Loaded 11593 existing records from primary storage. [2025-09-28T02:55:27.366980] [INFO ] [MAIN ] RCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:27.395484] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCS took 0.4s. Estimated remaining: 3m 5s. Rate: 191.9 symbols/min [2025-09-28T02:55:27.395317] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:27.414154] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-28T02:55:27.439475] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-28T02:55:27.523140] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-28T02:55:27.530510] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-28T02:55:27.615300] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:27.631056] [DEBUG] [LOCAL ] RCUS: Loaded 43206 existing records from primary storage. [2025-09-28T02:55:27.631459] [INFO ] [MAIN ] RCUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:27.632251] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCUS took 0.4s. Estimated remaining: 3m 5s. Rate: 191.9 symbols/min [2025-09-28T02:55:27.824431] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:27.869933] [DEBUG] [LOCAL ] RDDT: Loaded 54563 existing records from primary storage. [2025-09-28T02:55:27.870431] [INFO ] [MAIN ] RDDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:27.870825] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RDDT took 0.5s. Estimated remaining: 3m 5s. Rate: 191.9 symbols/min [2025-09-28T02:55:28.003266] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-28T02:55:28.028042] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-28T02:55:28.118916] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:28.076813] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-28T02:55:28.125437] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-28T02:55:28.128482] [DEBUG] [LOCAL ] RDN: Loaded 45976 existing records from primary storage. [2025-09-28T02:55:28.129082] [INFO ] [MAIN ] RDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:28.129206] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RDN took 0.5s. Estimated remaining: 3m 4s. Rate: 192.0 symbols/min [2025-09-28T02:55:28.322703] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:28.326856] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-28T02:55:28.347137] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-28T02:55:28.374222] [DEBUG] [LOCAL ] RDW: Loaded 52794 existing records from primary storage. [2025-09-28T02:55:28.374788] [INFO ] [MAIN ] RDW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:28.375510] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDW took 0.5s. Estimated remaining: 3m 4s. Rate: 192.0 symbols/min [2025-09-28T02:55:28.577232] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:28.600109] [DEBUG] [LOCAL ] RDY: Loaded 47418 existing records from primary storage. [2025-09-28T02:55:28.600884] [INFO ] [MAIN ] RDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:28.597763] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-28T02:55:28.602262] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDY took 0.5s. Estimated remaining: 3m 4s. Rate: 192.0 symbols/min [2025-09-28T02:55:28.720582] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-28T02:55:28.740097] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-28T02:55:28.813286] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:28.847304] [DEBUG] [LOCAL ] RELX: Loaded 48567 existing records from primary storage. [2025-09-28T02:55:28.847780] [INFO ] [MAIN ] RELX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:28.848217] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RELX took 0.5s. Estimated remaining: 3m 3s. Rate: 192.0 symbols/min [2025-09-28T02:55:29.053014] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:29.069189] [DEBUG] [LOCAL ] RERE: Loaded 41690 existing records from primary storage. [2025-09-28T02:55:29.069705] [INFO ] [MAIN ] RERE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:29.069809] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RERE took 0.5s. Estimated remaining: 3m 3s. Rate: 192.1 symbols/min [2025-09-28T02:55:29.209145] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-28T02:55:29.306837] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:29.324911] [DEBUG] [LOCAL ] RES: Loaded 48190 existing records from primary storage. [2025-09-28T02:55:29.325333] [INFO ] [MAIN ] RES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:29.325695] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RES took 0.5s. Estimated remaining: 3m 3s. Rate: 192.1 symbols/min [2025-09-28T02:55:29.511415] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-28T02:55:29.533949] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:29.552200] [DEBUG] [LOCAL ] REVG: Loaded 41461 existing records from primary storage. [2025-09-28T02:55:29.552777] [INFO ] [MAIN ] REVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:29.552889] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. REVG took 0.5s. Estimated remaining: 3m 2s. Rate: 192.1 symbols/min [2025-09-28T02:55:29.686087] [DEBUG] [LOCAL ] REX: Loaded 14221 existing records from primary storage. [2025-09-28T02:55:29.702290] [INFO ] [MAIN ] REX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:29.707540] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. REX took 0.4s. Estimated remaining: 3m 2s. Rate: 192.2 symbols/min [2025-09-28T02:55:29.804686] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:29.943685] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:29.948168] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-28T02:55:30.009924] [DEBUG] [LOCAL ] REXR: Loaded 52852 existing records from primary storage. [2025-09-28T02:55:30.010427] [INFO ] [MAIN ] REXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:30.010535] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. REXR took 0.5s. Estimated remaining: 3m 2s. Rate: 192.2 symbols/min [2025-09-28T02:55:30.133395] [DEBUG] [LOCAL ] REZI: Loaded 47576 existing records from primary storage. [2025-09-28T02:55:30.144782] [INFO ] [MAIN ] REZI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:30.155174] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REZI took 0.4s. Estimated remaining: 3m 1s. Rate: 192.2 symbols/min [2025-09-28T02:55:30.304457] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:30.324169] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-28T02:55:30.409719] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:30.426398] [DEBUG] [LOCAL ] RFI: Loaded 10550 existing records from primary storage. [2025-09-28T02:55:30.426873] [INFO ] [MAIN ] RFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:30.426977] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. RFI took 0.3s. Estimated remaining: 3m 1s. Rate: 192.2 symbols/min [2025-09-28T02:55:30.633210] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:30.651241] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-09-28T02:55:30.651695] [INFO ] [MAIN ] RF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:30.653077] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. RF took 0.6s. Estimated remaining: 3m 1s. Rate: 192.3 symbols/min [2025-09-28T02:55:30.701007] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-28T02:55:30.772354] [DEBUG] [LOCAL ] RFL: Loaded 11051 existing records from primary storage. [2025-09-28T02:55:30.778498] [INFO ] [MAIN ] RFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:30.788879] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RFL took 0.4s. Estimated remaining: 3m 0s. Rate: 192.3 symbols/min [2025-09-28T02:55:30.953198] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:31.033164] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:31.036303] [DEBUG] [LOCAL ] RFM: Loaded 4196 existing records from primary storage. [2025-09-28T02:55:31.036946] [INFO ] [MAIN ] RFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:31.037212] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFM took 0.4s. Estimated remaining: 2m 60s. Rate: 192.4 symbols/min [2025-09-28T02:55:31.111494] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-28T02:55:31.156856] [DEBUG] [LOCAL ] RFMZ: Loaded 8822 existing records from primary storage. [2025-09-28T02:55:31.157161] [INFO ] [MAIN ] RFMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:31.157556] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RFMZ took 0.4s. Estimated remaining: 2m 60s. Rate: 192.4 symbols/min [2025-09-28T02:55:31.345505] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:31.432856] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:31.466215] [DEBUG] [LOCAL ] RGR: Loaded 20706 existing records from primary storage. [2025-09-28T02:55:31.468009] [INFO ] [MAIN ] RGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:31.477223] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RGR took 0.3s. Estimated remaining: 2m 59s. Rate: 192.4 symbols/min [2025-09-28T02:55:31.525639] [DEBUG] [LOCAL ] RGA: Loaded 30535 existing records from primary storage. [2025-09-28T02:55:31.565594] [INFO ] [MAIN ] RGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:31.597741] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RGA took 0.6s. Estimated remaining: 2m 59s. Rate: 192.5 symbols/min [2025-09-28T02:55:31.597570] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-28T02:55:31.670777] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:31.675498] [DEBUG] [LOCAL ] RGT: Loaded 2885 existing records from primary storage. [2025-09-28T02:55:31.675737] [INFO ] [MAIN ] RGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:31.675838] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RGT took 0.2s. Estimated remaining: 2m 59s. Rate: 192.6 symbols/min [2025-09-28T02:55:31.910724] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-28T02:55:32.301231] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-28T02:55:32.710734] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-28T02:55:32.934390] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-28T02:55:33.510728] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-28T02:55:33.800879] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-28T02:55:34.310776] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-28T02:55:34.683887] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-28T02:55:35.110736] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-28T02:55:35.494177] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-28T02:55:35.910729] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-28T02:55:36.301170] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-28T02:55:36.710731] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-28T02:55:36.931726] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-28T02:55:36.932673] [INFO ] [REMOTE ] RCB: Full fetch complete (3747 records). [2025-09-28T02:55:36.932802] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-28T02:55:37.118261] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:55:37.118456] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:55:37.118528] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:55:37.118604] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-28T02:55:37.118748] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-28T02:55:37.118851] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-28T02:55:37.118948] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-28T02:55:37.119043] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RCB took 12.1s. Estimated remaining: 2m 60s. Rate: 190.8 symbols/min [2025-09-28T02:55:37.510729] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-28T02:55:37.881882] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-28T02:55:37.883396] [INFO ] [REMOTE ] RCD: Full fetch complete (6867 records). [2025-09-28T02:55:37.883516] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-28T02:55:38.079985] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-28T02:55:38.080247] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:55:38.080320] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:55:38.080399] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-28T02:55:38.080504] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-28T02:55:38.080576] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-28T02:55:38.080682] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-28T02:55:38.080798] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RCD took 13.0s. Estimated remaining: 2m 60s. Rate: 190.6 symbols/min [2025-09-28T02:55:38.756010] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:38.837495] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:38.838797] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:38.849764] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-09-28T02:55:38.867703] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-09-28T02:55:38.871325] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:38.872308] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-09-28T02:55:38.872422] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-28T02:55:38.872667] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-28T02:55:38.872838] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-09-28T02:55:39.253474] [DEBUG] [LOCAL ] RHP: Loaded 42305 existing records from primary storage. [2025-09-28T02:55:39.254358] [DEBUG] [LOCAL ] RHI: Loaded 49995 existing records from primary storage. [2025-09-28T02:55:39.281338] [INFO ] [MAIN ] RHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:39.288150] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RHP took 1.2s. Estimated remaining: 2m 60s. Rate: 190.3 symbols/min [2025-09-28T02:55:39.288470] [INFO ] [MAIN ] RHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:39.331752] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RHI took 1.3s. Estimated remaining: 2m 59s. Rate: 190.4 symbols/min [2025-09-28T02:55:39.321389] [DEBUG] [LOCAL ] RH: Loaded 48340 existing records from primary storage. [2025-09-28T02:55:39.420721] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:39.431186] [INFO ] [MAIN ] RH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:39.436960] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RH took 1.4s. Estimated remaining: 2m 59s. Rate: 190.5 symbols/min [2025-09-28T02:55:39.483937] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-28T02:55:39.793545] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:55:39.822964] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:39.872322] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-28T02:55:39.879279] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:55:39.872226] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:39.903273] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-09-28T02:55:39.925864] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:55:39.930207] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:39.930712] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-28T02:55:39.931171] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-28T02:55:39.931545] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-09-28T02:55:39.931765] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-09-28T02:55:39.932018] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RHLD took 1.9s. Estimated remaining: 2m 59s. Rate: 190.4 symbols/min [2025-09-28T02:55:40.159414] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:40.214492] [DEBUG] [LOCAL ] RIG: Loaded 54449 existing records from primary storage. [2025-09-28T02:55:40.220341] [DEBUG] [LOCAL ] RIO: Loaded 54173 existing records from primary storage. [2025-09-28T02:55:40.238556] [INFO ] [MAIN ] RIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:40.220781] [INFO ] [MAIN ] RIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:40.239784] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RIO took 0.8s. Estimated remaining: 2m 58s. Rate: 190.4 symbols/min [2025-09-28T02:55:40.240237] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RIG took 1.0s. Estimated remaining: 2m 58s. Rate: 190.5 symbols/min [2025-09-28T02:55:40.262517] [DEBUG] [LOCAL ] RITM: Loaded 53589 existing records from primary storage. [2025-09-28T02:55:40.361534] [DEBUG] [LOCAL ] RIV: Loaded 12193 existing records from primary storage. [2025-09-28T02:55:40.340246] [INFO ] [MAIN ] RITM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:40.377387] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RITM took 0.9s. Estimated remaining: 2m 58s. Rate: 190.6 symbols/min [2025-09-28T02:55:40.411132] [INFO ] [MAIN ] RIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:40.533009] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RIV took 0.6s. Estimated remaining: 2m 57s. Rate: 190.6 symbols/min [2025-09-28T02:55:40.762339] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:40.758746] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:40.929966] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:41.009559] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:41.097013] [DEBUG] [LOCAL ] RKT: Loaded 54501 existing records from primary storage. [2025-09-28T02:55:41.097234] [DEBUG] [LOCAL ] RJF: Loaded 47804 existing records from primary storage. [2025-09-28T02:55:41.097872] [INFO ] [MAIN ] RJF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:41.097957] [INFO ] [MAIN ] RKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:41.098163] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RJF took 0.9s. Estimated remaining: 2m 57s. Rate: 190.5 symbols/min [2025-09-28T02:55:41.104961] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RKT took 0.8s. Estimated remaining: 2m 57s. Rate: 190.6 symbols/min [2025-09-28T02:55:41.211693] [DEBUG] [LOCAL ] RLI: Loaded 33794 existing records from primary storage. [2025-09-28T02:55:41.289448] [INFO ] [MAIN ] RLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:41.304747] [DEBUG] [LOCAL ] RL: Loaded 41998 existing records from primary storage. [2025-09-28T02:55:41.320821] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RLI took 0.7s. Estimated remaining: 2m 56s. Rate: 190.7 symbols/min [2025-09-28T02:55:41.396158] [INFO ] [MAIN ] RL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:41.447747] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:41.542580] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RL took 1.1s. Estimated remaining: 2m 56s. Rate: 190.7 symbols/min [2025-09-28T02:55:41.620241] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:41.770452] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:41.870437] [DEBUG] [LOCAL ] RLTY: Loaded 11255 existing records from primary storage. [2025-09-28T02:55:41.913246] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:41.916385] [DEBUG] [LOCAL ] RLJ: Loaded 48922 existing records from primary storage. [2025-09-28T02:55:41.914967] [INFO ] [MAIN ] RLTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:41.917172] [INFO ] [MAIN ] RLJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:41.917394] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLTY took 0.7s. Estimated remaining: 2m 56s. Rate: 190.7 symbols/min [2025-09-28T02:55:41.918065] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RLJ took 0.8s. Estimated remaining: 2m 55s. Rate: 190.8 symbols/min [2025-09-28T02:55:42.105533] [DEBUG] [LOCAL ] RM: Loaded 7734 existing records from primary storage. [2025-09-28T02:55:42.155131] [INFO ] [MAIN ] RM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:42.176842] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RM took 0.6s. Estimated remaining: 2m 55s. Rate: 190.8 symbols/min [2025-09-28T02:55:42.252308] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:42.373500] [DEBUG] [LOCAL ] RLX: Loaded 48987 existing records from primary storage. [2025-09-28T02:55:42.414690] [INFO ] [MAIN ] RLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:42.399846] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:42.427535] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RLX took 1.1s. Estimated remaining: 2m 55s. Rate: 190.8 symbols/min [2025-09-28T02:55:42.663158] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:42.723219] [DEBUG] [LOCAL ] RMAX: Loaded 22121 existing records from primary storage. [2025-09-28T02:55:42.763018] [INFO ] [MAIN ] RMAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:42.766346] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMAX took 0.8s. Estimated remaining: 2m 54s. Rate: 190.8 symbols/min [2025-09-28T02:55:42.764242] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:42.806522] [DEBUG] [LOCAL ] RMI: Loaded 4716 existing records from primary storage. [2025-09-28T02:55:42.852490] [INFO ] [MAIN ] RMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:42.828137] [DEBUG] [LOCAL ] RMD: Loaded 42855 existing records from primary storage. [2025-09-28T02:55:42.858067] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMI took 0.6s. Estimated remaining: 2m 54s. Rate: 190.9 symbols/min [2025-09-28T02:55:42.863917] [INFO ] [MAIN ] RMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:42.895153] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMD took 1.0s. Estimated remaining: 2m 53s. Rate: 191.0 symbols/min [2025-09-28T02:55:42.961783] [DEBUG] [LOCAL ] RMM: Loaded 10624 existing records from primary storage. [2025-09-28T02:55:43.060599] [INFO ] [MAIN ] RMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:43.147702] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMM took 0.7s. Estimated remaining: 2m 53s. Rate: 191.0 symbols/min [2025-09-28T02:55:43.185229] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:43.410095] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:43.443791] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:43.460712] [DEBUG] [LOCAL ] RMMZ: Loaded 4875 existing records from primary storage. [2025-09-28T02:55:43.484709] [INFO ] [MAIN ] RMMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:43.506893] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMMZ took 0.7s. Estimated remaining: 2m 53s. Rate: 191.0 symbols/min [2025-09-28T02:55:43.616865] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:43.684388] [DEBUG] [LOCAL ] RMT: Loaded 17682 existing records from primary storage. [2025-09-28T02:55:43.697395] [INFO ] [MAIN ] RMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:43.708868] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RMT took 0.8s. Estimated remaining: 2m 52s. Rate: 191.0 symbols/min [2025-09-28T02:55:43.812898] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:43.938013] [DEBUG] [LOCAL ] RNG: Loaded 48830 existing records from primary storage. [2025-09-28T02:55:43.954572] [DEBUG] [LOCAL ] RNGR: Loaded 20653 existing records from primary storage. [2025-09-28T02:55:43.960151] [INFO ] [MAIN ] RNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:43.965770] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNG took 1.0s. Estimated remaining: 2m 52s. Rate: 191.0 symbols/min [2025-09-28T02:55:44.024264] [INFO ] [MAIN ] RNGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:44.067404] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:44.097253] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNGR took 0.9s. Estimated remaining: 2m 52s. Rate: 191.1 symbols/min [2025-09-28T02:55:44.155371] [DEBUG] [LOCAL ] RNP: Loaded 15940 existing records from primary storage. [2025-09-28T02:55:44.206604] [INFO ] [MAIN ] RNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:44.296621] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNP took 0.8s. Estimated remaining: 2m 51s. Rate: 191.1 symbols/min [2025-09-28T02:55:44.362708] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:44.523920] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:44.575030] [DEBUG] [LOCAL ] RNR: Loaded 34623 existing records from primary storage. [2025-09-28T02:55:44.592980] [INFO ] [MAIN ] RNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:44.603520] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNR took 0.9s. Estimated remaining: 2m 51s. Rate: 191.2 symbols/min [2025-09-28T02:55:44.679117] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:44.797460] [DEBUG] [LOCAL ] ROG: Loaded 23367 existing records from primary storage. [2025-09-28T02:55:44.885089] [INFO ] [MAIN ] ROG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:44.861890] [DEBUG] [LOCAL ] RNST: Loaded 37619 existing records from primary storage. [2025-09-28T02:55:44.884904] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:44.885364] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. ROG took 0.8s. Estimated remaining: 2m 51s. Rate: 191.2 symbols/min [2025-09-28T02:55:44.902354] [INFO ] [MAIN ] RNST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:44.902732] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. RNST took 0.9s. Estimated remaining: 2m 50s. Rate: 191.3 symbols/min [2025-09-28T02:55:45.159114] [DEBUG] [LOCAL ] ROK: Loaded 44522 existing records from primary storage. [2025-09-28T02:55:45.236625] [INFO ] [MAIN ] ROK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:45.287747] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. ROK took 0.9s. Estimated remaining: 2m 50s. Rate: 191.2 symbols/min [2025-09-28T02:55:45.295171] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:45.287607] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:45.442800] [DEBUG] [LOCAL ] ROL: Loaded 51031 existing records from primary storage. [2025-09-28T02:55:45.471183] [INFO ] [MAIN ] ROL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:45.532154] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. ROL took 0.9s. Estimated remaining: 2m 50s. Rate: 191.3 symbols/min [2025-09-28T02:55:45.531443] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:45.532013] [DEBUG] [LOCAL ] RPT: Loaded 19767 existing records from primary storage. [2025-09-28T02:55:45.532908] [INFO ] [MAIN ] RPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:45.533421] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPT took 0.6s. Estimated remaining: 2m 49s. Rate: 191.4 symbols/min [2025-09-28T02:55:45.854966] [DEBUG] [LOCAL ] RPM: Loaded 41763 existing records from primary storage. [2025-09-28T02:55:45.927715] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:45.935005] [DEBUG] [LOCAL ] RQI: Loaded 29573 existing records from primary storage. [2025-09-28T02:55:45.940968] [INFO ] [MAIN ] RPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:45.963868] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RPM took 1.1s. Estimated remaining: 2m 49s. Rate: 191.3 symbols/min [2025-09-28T02:55:45.945334] [INFO ] [MAIN ] RQI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:45.979394] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RQI took 0.7s. Estimated remaining: 2m 49s. Rate: 191.4 symbols/min [2025-09-28T02:55:45.966737] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:46.320829] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:46.358819] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:46.386208] [DEBUG] [LOCAL ] RRC: Loaded 53554 existing records from primary storage. [2025-09-28T02:55:46.390491] [INFO ] [MAIN ] RRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:46.391896] [DEBUG] [LOCAL ] RSF: Loaded 4192 existing records from primary storage. [2025-09-28T02:55:46.391285] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RRC took 0.9s. Estimated remaining: 2m 48s. Rate: 191.4 symbols/min [2025-09-28T02:55:46.392273] [INFO ] [MAIN ] RSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:46.405842] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RSF took 0.4s. Estimated remaining: 2m 48s. Rate: 191.5 symbols/min [2025-09-28T02:55:46.505454] [DEBUG] [LOCAL ] RRX: Loaded 41752 existing records from primary storage. [2025-09-28T02:55:46.571567] [INFO ] [MAIN ] RRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:46.595044] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RRX took 1.0s. Estimated remaining: 2m 48s. Rate: 191.5 symbols/min [2025-09-28T02:55:46.833990] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:46.898802] [DEBUG] [LOCAL ] RS: Loaded 25864 existing records from primary storage. [2025-09-28T02:55:46.950403] [INFO ] [MAIN ] RS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:46.934394] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:46.980463] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RS took 1.0s. Estimated remaining: 2m 47s. Rate: 191.5 symbols/min [2025-09-28T02:55:47.007693] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:47.071260] [DEBUG] [LOCAL ] RSG: Loaded 48173 existing records from primary storage. [2025-09-28T02:55:47.072021] [DEBUG] [LOCAL ] RSKD: Loaded 34254 existing records from primary storage. [2025-09-28T02:55:47.072226] [INFO ] [MAIN ] RSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:47.072592] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSG took 0.7s. Estimated remaining: 2m 47s. Rate: 191.6 symbols/min [2025-09-28T02:55:47.072523] [INFO ] [MAIN ] RSKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:47.073135] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSKD took 0.5s. Estimated remaining: 2m 47s. Rate: 191.7 symbols/min [2025-09-28T02:55:47.110680] [DEBUG] [LOCAL ] RSI: Loaded 47695 existing records from primary storage. [2025-09-28T02:55:47.111078] [INFO ] [MAIN ] RSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:47.111185] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RSI took 0.7s. Estimated remaining: 2m 46s. Rate: 191.8 symbols/min [2025-09-28T02:55:47.864186] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:47.893872] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:47.907367] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:47.932064] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:47.981143] [DEBUG] [LOCAL ] RVT: Loaded 27362 existing records from primary storage. [2025-09-28T02:55:47.983121] [INFO ] [MAIN ] RVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:47.983271] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVT took 0.9s. Estimated remaining: 2m 46s. Rate: 191.6 symbols/min [2025-09-28T02:55:48.109495] [DEBUG] [LOCAL ] RVLV: Loaded 48453 existing records from primary storage. [2025-09-28T02:55:48.138253] [DEBUG] [LOCAL ] RTO: Loaded 40847 existing records from primary storage. [2025-09-28T02:55:48.137231] [INFO ] [MAIN ] RVLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:48.138682] [INFO ] [MAIN ] RTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:48.138900] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RVLV took 1.0s. Estimated remaining: 2m 46s. Rate: 191.6 symbols/min [2025-09-28T02:55:48.152068] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RTO took 1.0s. Estimated remaining: 2m 45s. Rate: 191.7 symbols/min [2025-09-28T02:55:48.324298] [DEBUG] [LOCAL ] RTX: Loaded 54488 existing records from primary storage. [2025-09-28T02:55:48.361330] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:48.395910] [INFO ] [MAIN ] RTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:48.412949] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RTX took 1.3s. Estimated remaining: 2m 45s. Rate: 191.8 symbols/min [2025-09-28T02:55:48.713491] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:48.755115] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:48.755213] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-28T02:55:48.798980] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-28T02:55:48.837681] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-28T02:55:48.861272] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:48.846233] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-28T02:55:48.865843] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-28T02:55:48.865974] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-28T02:55:48.866506] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-28T02:55:48.882008] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-28T02:55:48.887568] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-28T02:55:48.887777] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-28T02:55:48.923399] [DEBUG] [LOCAL ] RVTY: Loaded 48199 existing records from primary storage. [2025-09-28T02:55:48.934144] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-28T02:55:48.945432] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-28T02:55:48.958299] [INFO ] [MAIN ] RVTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:48.987484] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RVTY took 1.0s. Estimated remaining: 2m 45s. Rate: 191.7 symbols/min [2025-09-28T02:55:49.438408] [DEBUG] [LOCAL ] RWT: Loaded 41352 existing records from primary storage. [2025-09-28T02:55:49.565447] [INFO ] [MAIN ] RWT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:49.708802] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWT took 1.6s. Estimated remaining: 2m 44s. Rate: 191.5 symbols/min [2025-09-28T02:55:49.754466] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:49.819801] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-28T02:55:49.925876] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-28T02:55:50.018133] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-28T02:55:50.029688] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:50.025129] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:50.057920] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-28T02:55:50.052011] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-28T02:55:50.090094] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-28T02:55:50.079399] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-28T02:55:50.094444] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-28T02:55:50.289939] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:50.436331] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-28T02:55:50.455769] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-28T02:55:50.468806] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-28T02:55:50.483065] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-28T02:55:50.613063] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:50.613684] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-28T02:55:50.636094] [DEBUG] [LOCAL ] RXO: Loaded 48520 existing records from primary storage. [2025-09-28T02:55:50.636564] [INFO ] [MAIN ] RXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:50.636736] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RXO took 0.9s. Estimated remaining: 2m 44s. Rate: 191.3 symbols/min [2025-09-28T02:55:50.765336] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-28T02:55:50.771729] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:55:50.800183] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-28T02:55:50.830793] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-28T02:55:50.852166] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:50.853258] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:55:50.853852] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-09-28T02:55:50.853941] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:55:50.854024] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-28T02:55:50.854128] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-28T02:55:50.854279] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-28T02:55:50.854758] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-28T02:55:50.854923] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWTP took 1.9s. Estimated remaining: 2m 44s. Rate: 191.4 symbols/min [2025-09-28T02:55:50.986117] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-28T02:55:51.010939] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-28T02:55:51.089568] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:51.113279] [DEBUG] [LOCAL ] RY: Loaded 48606 existing records from primary storage. [2025-09-28T02:55:51.113827] [INFO ] [MAIN ] RY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:51.114234] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RY took 0.5s. Estimated remaining: 2m 44s. Rate: 191.4 symbols/min [2025-09-28T02:55:51.240770] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-28T02:55:51.271689] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-28T02:55:51.334551] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:51.335963] [DEBUG] [LOCAL ] RYAM: Loaded 35709 existing records from primary storage. [2025-09-28T02:55:51.341232] [INFO ] [MAIN ] RYAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:51.343244] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RYAM took 0.5s. Estimated remaining: 2m 43s. Rate: 191.4 symbols/min [2025-09-28T02:55:51.415419] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-28T02:55:51.444586] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-28T02:55:51.566774] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-28T02:55:51.573890] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-28T02:55:51.571857] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:51.599156] [DEBUG] [LOCAL ] RYAN: Loaded 44960 existing records from primary storage. [2025-09-28T02:55:51.599692] [INFO ] [MAIN ] RYAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:51.599809] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RYAN took 0.5s. Estimated remaining: 2m 43s. Rate: 191.4 symbols/min [2025-09-28T02:55:51.782848] [DEBUG] [LOCAL ] RYI: Loaded 21835 existing records from primary storage. [2025-09-28T02:55:51.808750] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:51.808971] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-28T02:55:51.809159] [INFO ] [MAIN ] RYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:51.811526] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-28T02:55:51.813169] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYI took 0.5s. Estimated remaining: 2m 43s. Rate: 191.5 symbols/min [2025-09-28T02:55:51.904449] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-28T02:55:51.926024] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-28T02:55:52.021514] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:52.046587] [DEBUG] [LOCAL ] RYN: Loaded 46335 existing records from primary storage. [2025-09-28T02:55:52.051723] [DEBUG] [LOCAL ] RZB: Loaded 6291 existing records from primary storage. [2025-09-28T02:55:52.052177] [INFO ] [MAIN ] RYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:52.052491] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RYN took 0.5s. Estimated remaining: 2m 42s. Rate: 191.5 symbols/min [2025-09-28T02:55:52.052824] [INFO ] [MAIN ] RZB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:52.093080] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RZB took 0.3s. Estimated remaining: 2m 42s. Rate: 191.6 symbols/min [2025-09-28T02:55:52.224604] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-28T02:55:52.265560] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-28T02:55:52.334809] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-28T02:55:52.342063] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-28T02:55:52.466453] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:52.518095] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:52.530760] [DEBUG] [LOCAL ] RZC: Loaded 6838 existing records from primary storage. [2025-09-28T02:55:52.531172] [INFO ] [MAIN ] RZC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:52.531293] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RZC took 0.5s. Estimated remaining: 2m 42s. Rate: 191.5 symbols/min [2025-09-28T02:55:52.718268] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-28T02:55:52.761997] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-28T02:55:52.739873] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:52.765893] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-28T02:55:52.764130] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-28T02:55:52.796151] [DEBUG] [LOCAL ] S: Loaded 54315 existing records from primary storage. [2025-09-28T02:55:52.796731] [INFO ] [MAIN ] S: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:52.796859] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. S took 0.7s. Estimated remaining: 2m 41s. Rate: 191.6 symbols/min [2025-09-28T02:55:53.021466] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-28T02:55:53.022669] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:53.026084] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-28T02:55:53.024491] [DEBUG] [LOCAL ] SA: Loaded 43820 existing records from primary storage. [2025-09-28T02:55:53.029471] [INFO ] [MAIN ] SA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:53.032451] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. SA took 0.5s. Estimated remaining: 2m 41s. Rate: 191.6 symbols/min [2025-09-28T02:55:53.047279] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-28T02:55:53.080987] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-28T02:55:53.157477] [DEBUG] [LOCAL ] SABA: Loaded 9306 existing records from primary storage. [2025-09-28T02:55:53.174249] [INFO ] [MAIN ] SABA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:53.206540] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. SABA took 0.4s. Estimated remaining: 2m 41s. Rate: 191.6 symbols/min [2025-09-28T02:55:53.240230] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:53.340128] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-28T02:55:53.436364] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:53.454123] [DEBUG] [LOCAL ] SAFE: Loaded 30819 existing records from primary storage. [2025-09-28T02:55:53.454455] [INFO ] [MAIN ] SAFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:53.454600] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SAFE took 0.4s. Estimated remaining: 2m 40s. Rate: 191.6 symbols/min [2025-09-28T02:55:53.532411] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-28T02:55:53.573322] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-28T02:55:53.592157] [DEBUG] [LOCAL ] SAH: Loaded 22368 existing records from primary storage. [2025-09-28T02:55:53.600002] [INFO ] [MAIN ] SAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:53.621137] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. SAH took 0.4s. Estimated remaining: 2m 40s. Rate: 191.7 symbols/min [2025-09-28T02:55:53.702316] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:53.743810] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-28T02:55:53.779276] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-28T02:55:53.796392] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-28T02:55:53.796550] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-28T02:55:53.827210] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-28T02:55:53.827747] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-28T02:55:53.857470] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-28T02:55:53.861266] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:54.070739] [DEBUG] [LOCAL ] SAM: Loaded 21766 existing records from primary storage. [2025-09-28T02:55:54.087563] [INFO ] [MAIN ] SAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:54.150624] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAM took 0.5s. Estimated remaining: 2m 40s. Rate: 191.6 symbols/min [2025-09-28T02:55:54.323280] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-28T02:55:54.415517] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:54.466174] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:54.523877] [DEBUG] [LOCAL ] SAN: Loaded 53774 existing records from primary storage. [2025-09-28T02:55:54.524342] [INFO ] [MAIN ] SAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:54.524448] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAN took 0.4s. Estimated remaining: 2m 39s. Rate: 191.6 symbols/min [2025-09-28T02:55:54.705114] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:54.763197] [DEBUG] [LOCAL ] SAND: Loaded 52527 existing records from primary storage. [2025-09-28T02:55:54.763628] [INFO ] [MAIN ] SAND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:54.764124] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAND took 0.2s. Estimated remaining: 2m 39s. Rate: 191.6 symbols/min [2025-09-28T02:55:54.861316] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-28T02:55:54.884396] [INFO ] [REMOTE ] RWTO: Full fetch complete (4801 records). [2025-09-28T02:55:54.895331] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-28T02:55:55.049391] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:55.124542] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-28T02:55:55.166140] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:55:55.167253] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:55:55.167327] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:55:55.167410] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-28T02:55:55.167505] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-28T02:55:55.167584] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-28T02:55:55.167793] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-28T02:55:55.167895] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. RWTO took 6.7s. Estimated remaining: 2m 39s. Rate: 191.6 symbols/min [2025-09-28T02:55:55.368781] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:55.395527] [DEBUG] [LOCAL ] SAP: Loaded 50800 existing records from primary storage. [2025-09-28T02:55:55.396149] [INFO ] [MAIN ] SAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:55.396262] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAP took 0.6s. Estimated remaining: 2m 38s. Rate: 191.6 symbols/min [2025-09-28T02:55:55.516436] [DEBUG] [LOCAL ] SAR: Loaded 16382 existing records from primary storage. [2025-09-28T02:55:55.522837] [INFO ] [MAIN ] SAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:55.528824] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAR took 0.4s. Estimated remaining: 2m 38s. Rate: 191.7 symbols/min [2025-09-28T02:55:55.642883] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:55.631805] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-28T02:55:55.782594] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:55.782847] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-28T02:55:55.782931] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-28T02:55:55.783148] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-28T02:55:55.783235] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-28T02:55:55.783324] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-28T02:55:55.783402] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-28T02:55:55.915707] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-28T02:55:56.088599] [DEBUG] [LOCAL ] SARO: Loaded 49425 existing records from primary storage. [2025-09-28T02:55:56.117035] [INFO ] [MAIN ] SARO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:55:56.117217] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. SARO took 0.7s. Estimated remaining: 2m 38s. Rate: 191.6 symbols/min [2025-09-28T02:55:56.308054] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-28T02:55:56.307898] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:56.401392] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:56.401616] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-28T02:55:56.401716] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-28T02:55:56.401831] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-28T02:55:56.401901] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-28T02:55:56.401983] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-28T02:55:56.402053] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-28T02:55:56.715849] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-28T02:55:56.787878] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:57.091255] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-28T02:55:57.092526] [INFO ] [REMOTE ] RWTN: Full fetch complete (3130 records). [2025-09-28T02:55:57.092675] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-28T02:55:57.287212] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:55:57.287495] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:55:57.287571] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:55:57.287674] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-28T02:55:57.287787] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-28T02:55:57.287863] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-28T02:55:57.287948] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-28T02:55:57.288063] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. RWTN took 9.1s. Estimated remaining: 2m 38s. Rate: 191.3 symbols/min [2025-09-28T02:55:57.467299] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:55:57.467519] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-28T02:55:57.467593] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-28T02:55:57.467737] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-28T02:55:57.467812] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-28T02:55:57.467895] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-28T02:55:57.467967] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-28T02:55:57.515861] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-28T02:55:57.857811] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:55:57.873580] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-28T02:55:58.310798] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-28T02:55:58.539103] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-09-28T02:55:59.110802] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-28T02:55:59.427256] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-28T02:55:59.910751] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-28T02:56:00.341991] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-28T02:56:00.710734] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-28T02:56:00.929614] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-28T02:56:01.510778] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-28T02:56:01.727750] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-09-28T02:56:02.310732] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-28T02:56:02.543487] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-09-28T02:56:03.110755] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-28T02:56:03.342871] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-28T02:56:03.910762] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-28T02:56:04.138226] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-28T02:56:04.710801] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-28T02:56:04.938016] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-28T02:56:05.510810] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-28T02:56:05.817861] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-28T02:56:06.310769] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-28T02:56:06.543905] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-28T02:56:07.110778] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-28T02:56:07.333791] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-28T02:56:07.910747] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-28T02:56:08.205267] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-28T02:56:08.710781] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-28T02:56:09.016482] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-28T02:56:09.510738] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-28T02:56:09.733275] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-28T02:56:10.310830] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-28T02:56:10.607421] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-28T02:56:11.110791] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-28T02:56:11.329012] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-28T02:56:11.910745] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-28T02:56:12.135145] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-28T02:56:12.710769] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-28T02:56:12.937510] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-28T02:56:13.510764] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-28T02:56:13.827516] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-28T02:56:14.310739] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-28T02:56:14.650270] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-28T02:56:15.110781] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-28T02:56:15.395005] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-28T02:56:15.910741] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-28T02:56:16.142040] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-28T02:56:16.710744] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-28T02:56:17.022605] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-28T02:56:17.510801] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-28T02:56:17.742274] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-28T02:56:18.310840] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-28T02:56:18.535403] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-28T02:56:19.110799] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-28T02:56:19.343626] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-28T02:56:19.910811] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-28T02:56:20.212000] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-28T02:56:20.710765] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-28T02:56:20.932119] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-28T02:56:21.510780] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-28T02:56:21.731865] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-28T02:56:22.310737] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-28T02:56:22.620231] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-28T02:56:23.110736] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-28T02:56:23.336560] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-28T02:56:23.337614] [INFO ] [REMOTE ] SAZ: Full fetch complete (1809 records). [2025-09-28T02:56:23.337780] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-28T02:56:23.529785] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:56:23.529990] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:56:23.530062] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:56:23.530140] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-28T02:56:23.530272] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-28T02:56:23.530352] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-28T02:56:23.530456] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-28T02:56:23.530559] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SAZ took 26.2s. Estimated remaining: 2m 44s. Rate: 183.2 symbols/min [2025-09-28T02:56:23.703871] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:23.753166] [DEBUG] [LOCAL ] SB: Loaded 33735 existing records from primary storage. [2025-09-28T02:56:23.753586] [INFO ] [MAIN ] SB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:23.753724] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SB took 0.2s. Estimated remaining: 2m 44s. Rate: 183.2 symbols/min [2025-09-28T02:56:23.929498] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-28T02:56:23.933679] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:23.933902] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-28T02:56:23.935020] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-28T02:56:23.935149] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-28T02:56:23.935233] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-28T02:56:23.935322] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-28T02:56:23.935410] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-28T02:56:24.277137] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-28T02:56:24.294635] [INFO ] [REMOTE ] SAY: Full fetch complete (1412 records). [2025-09-28T02:56:24.318546] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-28T02:56:24.448134] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:56:24.555304] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-28T02:56:24.555499] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:56:24.555573] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:56:24.555716] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-28T02:56:24.555811] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-28T02:56:24.555901] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-28T02:56:24.556001] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-28T02:56:24.556121] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SAY took 28.4s. Estimated remaining: 2m 44s. Rate: 183.1 symbols/min [2025-09-28T02:56:24.730284] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-28T02:56:24.734291] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:24.793009] [DEBUG] [LOCAL ] SBH: Loaded 50565 existing records from primary storage. [2025-09-28T02:56:24.793464] [INFO ] [MAIN ] SBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:24.793588] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SBH took 0.2s. Estimated remaining: 2m 43s. Rate: 183.1 symbols/min [2025-09-28T02:56:24.901059] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:56:24.910106] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-28T02:56:24.925732] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:56:24.958448] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-09-28T02:56:24.976313] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:56:24.977453] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:24.977737] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-28T02:56:24.977954] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-28T02:56:24.978369] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-28T02:56:24.978471] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-28T02:56:24.978588] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SBDS took 1.2s. Estimated remaining: 2m 43s. Rate: 183.2 symbols/min [2025-09-28T02:56:25.096686] [DEBUG] [LOCAL ] SBI: Loaded 7848 existing records from primary storage. [2025-09-28T02:56:25.102904] [INFO ] [MAIN ] SBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:25.113283] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SBI took 0.3s. Estimated remaining: 2m 43s. Rate: 183.2 symbols/min [2025-09-28T02:56:25.256221] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:25.363508] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:25.363884] [DEBUG] [LOCAL ] SBR: Loaded 7350 existing records from primary storage. [2025-09-28T02:56:25.364256] [INFO ] [MAIN ] SBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:25.364387] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SBR took 0.4s. Estimated remaining: 2m 42s. Rate: 183.2 symbols/min [2025-09-28T02:56:25.515327] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-28T02:56:25.552336] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:25.584507] [DEBUG] [LOCAL ] SBSI: Loaded 14974 existing records from primary storage. [2025-09-28T02:56:25.598914] [INFO ] [MAIN ] SBSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:25.599058] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBSI took 0.2s. Estimated remaining: 2m 42s. Rate: 183.3 symbols/min [2025-09-28T02:56:25.600055] [DEBUG] [LOCAL ] SBS: Loaded 50166 existing records from primary storage. [2025-09-28T02:56:25.634410] [INFO ] [MAIN ] SBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:25.681024] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBS took 0.6s. Estimated remaining: 2m 42s. Rate: 183.3 symbols/min [2025-09-28T02:56:25.782819] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:25.787952] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-28T02:56:25.845862] [DEBUG] [LOCAL ] SBSW: Loaded 53745 existing records from primary storage. [2025-09-28T02:56:25.846254] [INFO ] [MAIN ] SBSW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:25.846358] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBSW took 0.2s. Estimated remaining: 2m 41s. Rate: 183.4 symbols/min [2025-09-28T02:56:26.310729] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-28T02:56:26.526016] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-28T02:56:26.526947] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-09-28T02:56:26.527043] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-28T02:56:26.527439] [FATAL] [VALIDATOR ] SAJ: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:56:26.527540] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:56:26.527608] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:56:26.527704] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-28T02:56:26.527801] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-28T02:56:26.527872] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-28T02:56:26.527956] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-28T02:56:26.528045] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SAJ took 33.1s. Estimated remaining: 2m 41s. Rate: 183.3 symbols/min [2025-09-28T02:56:27.110737] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-28T02:56:27.338741] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-28T02:56:27.910733] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-28T02:56:28.130500] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-28T02:56:28.131313] [INFO ] [REMOTE ] SAT: Full fetch complete (1599 records). [2025-09-28T02:56:28.131408] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-28T02:56:28.336942] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-28T02:56:28.337150] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:56:28.337228] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:56:28.337305] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-28T02:56:28.337404] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-28T02:56:28.337488] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-28T02:56:28.337571] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-28T02:56:28.337686] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SAT took 32.8s. Estimated remaining: 2m 41s. Rate: 182.9 symbols/min [2025-09-28T02:56:29.082871] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:29.097570] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:29.120466] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:29.124820] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:29.128710] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-28T02:56:29.128999] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-28T02:56:29.129373] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-28T02:56:29.129604] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-28T02:56:29.131164] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-28T02:56:29.131268] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-28T02:56:29.219890] [DEBUG] [LOCAL ] SCD: Loaded 12749 existing records from primary storage. [2025-09-28T02:56:29.247801] [INFO ] [MAIN ] SCD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:29.257888] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SCD took 0.9s. Estimated remaining: 2m 41s. Rate: 182.7 symbols/min [2025-09-28T02:56:29.621152] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-09-28T02:56:29.646261] [DEBUG] [LOCAL ] SCCO: Loaded 50148 existing records from primary storage. [2025-09-28T02:56:29.651574] [INFO ] [MAIN ] SCHW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:29.716031] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCHW took 1.4s. Estimated remaining: 2m 41s. Rate: 182.6 symbols/min [2025-09-28T02:56:29.716239] [INFO ] [MAIN ] SCCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:29.714937] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:29.744238] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCCO took 1.4s. Estimated remaining: 2m 40s. Rate: 182.7 symbols/min [2025-09-28T02:56:29.950307] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:56:30.024830] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-28T02:56:30.195154] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:30.176436] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:30.214630] [DEBUG] [LOCAL ] SCI: Loaded 47257 existing records from primary storage. [2025-09-28T02:56:30.215257] [INFO ] [MAIN ] SCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:30.215841] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCI took 1.0s. Estimated remaining: 2m 40s. Rate: 182.7 symbols/min [2025-09-28T02:56:30.306257] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-28T02:56:30.324167] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-28T02:56:30.385229] [DEBUG] [LOCAL ] SCM: Loaded 20163 existing records from primary storage. [2025-09-28T02:56:30.409262] [DEBUG] [LOCAL ] SCL: Loaded 15113 existing records from primary storage. [2025-09-28T02:56:30.441739] [INFO ] [MAIN ] SCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:30.441014] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:30.441383] [INFO ] [MAIN ] SCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:30.442474] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCM took 0.7s. Estimated remaining: 2m 40s. Rate: 182.7 symbols/min [2025-09-28T02:56:30.448569] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCL took 0.7s. Estimated remaining: 2m 39s. Rate: 182.8 symbols/min [2025-09-28T02:56:30.574211] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-28T02:56:30.609447] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-28T02:56:30.800584] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:30.836581] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:30.853136] [DEBUG] [LOCAL ] SCS: Loaded 43834 existing records from primary storage. [2025-09-28T02:56:30.855079] [INFO ] [MAIN ] SCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:30.855203] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCS took 0.6s. Estimated remaining: 2m 39s. Rate: 182.8 symbols/min [2025-09-28T02:56:30.934254] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-28T02:56:30.989614] [DEBUG] [LOCAL ] SDHC: Loaded 10686 existing records from primary storage. [2025-09-28T02:56:30.990020] [INFO ] [MAIN ] SDHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:30.990236] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SDHC took 0.5s. Estimated remaining: 2m 38s. Rate: 182.8 symbols/min [2025-09-28T02:56:31.106355] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:31.112582] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-28T02:56:31.147478] [DEBUG] [LOCAL ] SD: Loaded 29368 existing records from primary storage. [2025-09-28T02:56:31.175236] [INFO ] [MAIN ] SD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:31.188138] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SD took 0.7s. Estimated remaining: 2m 38s. Rate: 182.9 symbols/min [2025-09-28T02:56:31.288327] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:31.318819] [DEBUG] [LOCAL ] SDHY: Loaded 10710 existing records from primary storage. [2025-09-28T02:56:31.351206] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-28T02:56:31.363122] [INFO ] [MAIN ] SDHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:31.380325] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SDHY took 0.5s. Estimated remaining: 2m 38s. Rate: 182.9 symbols/min [2025-09-28T02:56:31.578901] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:31.685369] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:31.699125] [DEBUG] [LOCAL ] SDRL: Loaded 42459 existing records from primary storage. [2025-09-28T02:56:31.699565] [INFO ] [MAIN ] SDRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:31.699697] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SDRL took 0.7s. Estimated remaining: 2m 37s. Rate: 182.9 symbols/min [2025-09-28T02:56:31.909742] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:31.910697] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-28T02:56:31.944405] [DEBUG] [LOCAL ] SE: Loaded 54140 existing records from primary storage. [2025-09-28T02:56:31.950274] [DEBUG] [LOCAL ] SEE: Loaded 49069 existing records from primary storage. [2025-09-28T02:56:31.950494] [INFO ] [MAIN ] SE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:31.950821] [INFO ] [MAIN ] SEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:31.950905] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SE took 0.7s. Estimated remaining: 2m 37s. Rate: 182.9 symbols/min [2025-09-28T02:56:31.951210] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SEE took 0.6s. Estimated remaining: 2m 37s. Rate: 183.0 symbols/min [2025-09-28T02:56:32.002203] [DEBUG] [LOCAL ] SEG: Loaded 13887 existing records from primary storage. [2025-09-28T02:56:32.121051] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-28T02:56:32.121177] [INFO ] [MAIN ] SEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:32.153278] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SEG took 0.5s. Estimated remaining: 2m 36s. Rate: 183.1 symbols/min [2025-09-28T02:56:32.362127] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:32.451729] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:32.530509] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:32.619753] [DEBUG] [LOCAL ] SEI: Loaded 50411 existing records from primary storage. [2025-09-28T02:56:32.621140] [DEBUG] [LOCAL ] SEM: Loaded 43533 existing records from primary storage. [2025-09-28T02:56:32.633169] [INFO ] [MAIN ] SEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:32.633783] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEM took 0.6s. Estimated remaining: 2m 36s. Rate: 183.0 symbols/min [2025-09-28T02:56:32.633354] [INFO ] [MAIN ] SEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:32.634438] [DEBUG] [LOCAL ] SEMR: Loaded 42184 existing records from primary storage. [2025-09-28T02:56:32.640163] [INFO ] [MAIN ] SEMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:32.640324] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEI took 0.7s. Estimated remaining: 2m 36s. Rate: 183.1 symbols/min [2025-09-28T02:56:32.740209] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEMR took 0.6s. Estimated remaining: 2m 35s. Rate: 183.2 symbols/min [2025-09-28T02:56:32.739756] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-28T02:56:33.055522] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:33.119769] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-28T02:56:33.131399] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:33.194373] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:33.202461] [DEBUG] [LOCAL ] SFB: Loaded 4046 existing records from primary storage. [2025-09-28T02:56:33.202964] [INFO ] [MAIN ] SFB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:33.203314] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SFB took 0.5s. Estimated remaining: 2m 35s. Rate: 183.2 symbols/min [2025-09-28T02:56:33.382815] [DEBUG] [LOCAL ] SF: Loaded 42360 existing records from primary storage. [2025-09-28T02:56:33.409210] [INFO ] [MAIN ] SF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:33.437409] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:33.438289] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SF took 0.8s. Estimated remaining: 2m 35s. Rate: 183.2 symbols/min [2025-09-28T02:56:33.459726] [DEBUG] [LOCAL ] SES: Loaded 52331 existing records from primary storage. [2025-09-28T02:56:33.503166] [INFO ] [MAIN ] SES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:33.524248] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-28T02:56:33.551450] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SES took 0.9s. Estimated remaining: 2m 34s. Rate: 183.2 symbols/min [2025-09-28T02:56:33.691544] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:33.769491] [DEBUG] [LOCAL ] SFBS: Loaded 21483 existing records from primary storage. [2025-09-28T02:56:33.775670] [INFO ] [MAIN ] SFBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:33.780930] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFBS took 0.6s. Estimated remaining: 2m 34s. Rate: 183.3 symbols/min [2025-09-28T02:56:33.912921] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:34.085355] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:34.101174] [DEBUG] [LOCAL ] SFL: Loaded 46026 existing records from primary storage. [2025-09-28T02:56:34.101776] [INFO ] [MAIN ] SFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:34.102011] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SFL took 0.6s. Estimated remaining: 2m 34s. Rate: 183.3 symbols/min [2025-09-28T02:56:34.234752] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-28T02:56:34.318763] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:34.328477] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-28T02:56:34.314827] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-28T02:56:34.343622] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-28T02:56:34.346002] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-28T02:56:34.346110] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-28T02:56:34.347849] [DEBUG] [LOCAL ] SG: Loaded 54227 existing records from primary storage. [2025-09-28T02:56:34.346297] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-28T02:56:34.348307] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-28T02:56:34.348454] [INFO ] [MAIN ] SG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:34.354065] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SG took 0.8s. Estimated remaining: 2m 33s. Rate: 183.3 symbols/min [2025-09-28T02:56:34.523639] [DEBUG] [LOCAL ] SGHC: Loaded 46435 existing records from primary storage. [2025-09-28T02:56:34.569832] [INFO ] [MAIN ] SGHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:34.634789] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SGHC took 0.9s. Estimated remaining: 2m 33s. Rate: 183.3 symbols/min [2025-09-28T02:56:34.964370] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-28T02:56:34.925422] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:35.129815] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:56:35.138527] [DEBUG] [LOCAL ] SGU: Loaded 6765 existing records from primary storage. [2025-09-28T02:56:35.138850] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-28T02:56:35.165484] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:35.165924] [INFO ] [MAIN ] SGU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:35.166786] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SGU took 0.8s. Estimated remaining: 2m 33s. Rate: 183.3 symbols/min [2025-09-28T02:56:35.350953] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:56:35.355184] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:35.355959] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-28T02:56:35.356250] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:56:35.356351] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-09-28T02:56:35.356437] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:56:35.356531] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-28T02:56:35.356678] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-28T02:56:35.356804] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-28T02:56:35.357021] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-28T02:56:35.357198] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SGI took 1.3s. Estimated remaining: 2m 32s. Rate: 183.3 symbols/min [2025-09-28T02:56:35.538794] [DEBUG] [LOCAL ] SHCO: Loaded 26427 existing records from primary storage. [2025-09-28T02:56:35.567373] [INFO ] [MAIN ] SHCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:35.554577] [DEBUG] [LOCAL ] SHAK: Loaded 49831 existing records from primary storage. [2025-09-28T02:56:35.567796] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SHCO took 0.4s. Estimated remaining: 2m 32s. Rate: 183.3 symbols/min [2025-09-28T02:56:35.590472] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:35.613556] [INFO ] [MAIN ] SHAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:35.643727] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHAK took 1.0s. Estimated remaining: 2m 31s. Rate: 183.4 symbols/min [2025-09-28T02:56:35.944720] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-28T02:56:35.917037] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:35.998821] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:36.023687] [DEBUG] [LOCAL ] SHEL: Loaded 54451 existing records from primary storage. [2025-09-28T02:56:36.024749] [INFO ] [MAIN ] SHEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:36.024934] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHEL took 0.7s. Estimated remaining: 2m 31s. Rate: 183.4 symbols/min [2025-09-28T02:56:36.181700] [DEBUG] [LOCAL ] SHG: Loaded 27307 existing records from primary storage. [2025-09-28T02:56:36.199025] [INFO ] [MAIN ] SHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:36.236212] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHG took 0.7s. Estimated remaining: 2m 31s. Rate: 183.4 symbols/min [2025-09-28T02:56:36.279003] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:36.330413] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-28T02:56:36.409958] [DEBUG] [LOCAL ] SHO: Loaded 50552 existing records from primary storage. [2025-09-28T02:56:36.411092] [INFO ] [MAIN ] SHO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:36.421856] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SHO took 0.7s. Estimated remaining: 2m 30s. Rate: 183.5 symbols/min [2025-09-28T02:56:36.457475] [DEBUG] [LOCAL ] SHOC: Loaded 3747 existing records from primary storage. [2025-09-28T02:56:36.524686] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:36.525010] [INFO ] [MAIN ] SHOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:36.551293] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SHOC took 0.5s. Estimated remaining: 2m 30s. Rate: 183.5 symbols/min [2025-09-28T02:56:36.712968] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-28T02:56:36.842357] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:36.871927] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-28T02:56:36.889727] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-28T02:56:36.896777] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-28T02:56:36.896979] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-28T02:56:36.922752] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-28T02:56:36.926468] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:36.943040] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-28T02:56:36.986334] [DEBUG] [LOCAL ] SHW: Loaded 51174 existing records from primary storage. [2025-09-28T02:56:37.035053] [INFO ] [MAIN ] SHW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:37.064606] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHW took 0.8s. Estimated remaining: 2m 30s. Rate: 183.5 symbols/min [2025-09-28T02:56:37.100209] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-28T02:56:37.178320] [INFO ] [REMOTE ] SBXD: Full fetch complete (3078 records). [2025-09-28T02:56:37.261136] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-28T02:56:37.371899] [DEBUG] [LOCAL ] SID: Loaded 42834 existing records from primary storage. [2025-09-28T02:56:37.292842] [FATAL] [VALIDATOR ] SBXD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-28T02:56:37.382975] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:56:37.383187] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:56:37.420166] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-28T02:56:37.399375] [INFO ] [MAIN ] SID: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:37.462410] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-28T02:56:37.462150] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SID took 0.9s. Estimated remaining: 2m 29s. Rate: 183.4 symbols/min [2025-09-28T02:56:37.526484] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:37.531819] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-28T02:56:37.600930] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-28T02:56:37.659570] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SBXD took 9.3s. Estimated remaining: 2m 29s. Rate: 183.5 symbols/min [2025-09-28T02:56:37.670019] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:56:37.692258] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-28T02:56:37.872719] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:37.966512] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:56:37.985379] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-28T02:56:38.022240] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:38.029558] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:56:38.030617] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-09-28T02:56:38.031925] [DEBUG] [LOCAL ] SIG: Loaded 47111 existing records from primary storage. [2025-09-28T02:56:38.032074] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:56:38.032416] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-28T02:56:38.032594] [INFO ] [MAIN ] SIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:38.032745] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-28T02:56:38.033810] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SIG took 0.9s. Estimated remaining: 2m 29s. Rate: 183.5 symbols/min [2025-09-28T02:56:38.034058] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-28T02:56:38.087684] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-28T02:56:38.088318] [DEBUG] [LOCAL ] SII: Loaded 23644 existing records from primary storage. [2025-09-28T02:56:38.119932] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SI took 1.7s. Estimated remaining: 2m 28s. Rate: 183.5 symbols/min [2025-09-28T02:56:38.119564] [INFO ] [MAIN ] SII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:38.152247] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SII took 0.6s. Estimated remaining: 2m 28s. Rate: 183.6 symbols/min [2025-09-28T02:56:38.238210] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:38.251594] [DEBUG] [LOCAL ] SILA: Loaded 31635 existing records from primary storage. [2025-09-28T02:56:38.252093] [INFO ] [MAIN ] SILA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:38.252568] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SILA took 0.6s. Estimated remaining: 2m 28s. Rate: 183.7 symbols/min [2025-09-28T02:56:38.291364] [DEBUG] [LOCAL ] SITC: Loaded 42233 existing records from primary storage. [2025-09-28T02:56:38.291757] [INFO ] [MAIN ] SITC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:38.291863] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITC took 0.3s. Estimated remaining: 2m 27s. Rate: 183.8 symbols/min [2025-09-28T02:56:38.860878] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:39.051353] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:39.054969] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:39.025980] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:39.092134] [DEBUG] [LOCAL ] SJT: Loaded 22419 existing records from primary storage. [2025-09-28T02:56:39.092627] [INFO ] [MAIN ] SJT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:39.092813] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SJT took 0.8s. Estimated remaining: 2m 27s. Rate: 183.6 symbols/min [2025-09-28T02:56:39.192207] [DEBUG] [LOCAL ] SKE: Loaded 36252 existing records from primary storage. [2025-09-28T02:56:39.247893] [INFO ] [MAIN ] SKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:39.259075] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SKE took 1.0s. Estimated remaining: 2m 27s. Rate: 183.7 symbols/min [2025-09-28T02:56:39.410761] [DEBUG] [LOCAL ] SITE: Loaded 35513 existing records from primary storage. [2025-09-28T02:56:39.411900] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:39.445094] [INFO ] [MAIN ] SITE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:39.446764] [DEBUG] [LOCAL ] SJM: Loaded 50877 existing records from primary storage. [2025-09-28T02:56:39.457614] [INFO ] [MAIN ] SJM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:39.471680] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SJM took 1.2s. Estimated remaining: 2m 26s. Rate: 183.7 symbols/min [2025-09-28T02:56:39.472017] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SITE took 1.2s. Estimated remaining: 2m 26s. Rate: 183.8 symbols/min [2025-09-28T02:56:39.742366] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:39.706519] [DEBUG] [LOCAL ] SKIL: Loaded 6395 existing records from primary storage. [2025-09-28T02:56:39.807630] [INFO ] [MAIN ] SKIL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:39.818283] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKIL took 0.7s. Estimated remaining: 2m 26s. Rate: 183.8 symbols/min [2025-09-28T02:56:39.880615] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:39.978628] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:40.041256] [DEBUG] [LOCAL ] SKLZ: Loaded 12122 existing records from primary storage. [2025-09-28T02:56:40.062667] [INFO ] [MAIN ] SKLZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:40.063354] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKLZ took 0.8s. Estimated remaining: 2m 25s. Rate: 183.8 symbols/min [2025-09-28T02:56:40.234088] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:40.301718] [DEBUG] [LOCAL ] SKM: Loaded 35557 existing records from primary storage. [2025-09-28T02:56:40.330477] [INFO ] [MAIN ] SKM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:40.345435] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKM took 0.9s. Estimated remaining: 2m 25s. Rate: 183.8 symbols/min [2025-09-28T02:56:40.367468] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:40.434698] [DEBUG] [LOCAL ] SKT: Loaded 43227 existing records from primary storage. [2025-09-28T02:56:40.486470] [INFO ] [MAIN ] SKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:40.503926] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKT took 1.0s. Estimated remaining: 2m 25s. Rate: 183.9 symbols/min [2025-09-28T02:56:40.550782] [DEBUG] [LOCAL ] SKYH: Loaded 16851 existing records from primary storage. [2025-09-28T02:56:40.594504] [INFO ] [MAIN ] SKYH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:40.588523] [DEBUG] [LOCAL ] SKY: Loaded 38305 existing records from primary storage. [2025-09-28T02:56:40.650311] [INFO ] [MAIN ] SKY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:40.625717] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKYH took 0.6s. Estimated remaining: 2m 24s. Rate: 184.0 symbols/min [2025-09-28T02:56:40.685220] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SKY took 0.8s. Estimated remaining: 2m 24s. Rate: 184.0 symbols/min [2025-09-28T02:56:40.742022] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:41.081707] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:41.196966] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:41.221147] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:41.246094] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-09-28T02:56:41.247085] [INFO ] [MAIN ] SLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:41.247256] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLB took 0.9s. Estimated remaining: 2m 24s. Rate: 184.0 symbols/min [2025-09-28T02:56:41.419458] [DEBUG] [LOCAL ] SLF: Loaded 39426 existing records from primary storage. [2025-09-28T02:56:41.483093] [DEBUG] [LOCAL ] SLGN: Loaded 41039 existing records from primary storage. [2025-09-28T02:56:41.475307] [INFO ] [MAIN ] SLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:41.521593] [INFO ] [MAIN ] SLGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:41.525874] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:41.527115] [DEBUG] [LOCAL ] SLG: Loaded 46130 existing records from primary storage. [2025-09-28T02:56:41.521817] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLF took 1.0s. Estimated remaining: 2m 23s. Rate: 184.0 symbols/min [2025-09-28T02:56:41.528079] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-28T02:56:41.528186] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-28T02:56:41.533529] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLGN took 0.8s. Estimated remaining: 2m 23s. Rate: 184.1 symbols/min [2025-09-28T02:56:41.533704] [INFO ] [MAIN ] SLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:41.591876] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-28T02:56:41.602423] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLG took 0.9s. Estimated remaining: 2m 22s. Rate: 184.1 symbols/min [2025-09-28T02:56:41.614263] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-28T02:56:41.658043] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-28T02:56:41.674149] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-28T02:56:42.318519] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:42.322543] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:42.394495] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:42.650718] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:56:42.647183] [DEBUG] [LOCAL ] SLVM: Loaded 28332 existing records from primary storage. [2025-09-28T02:56:42.663822] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-28T02:56:42.665977] [INFO ] [MAIN ] SLVM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:42.666838] [DEBUG] [LOCAL ] SLQT: Loaded 44370 existing records from primary storage. [2025-09-28T02:56:42.681742] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 22s. Rate: 183.9 symbols/min [2025-09-28T02:56:42.682290] [INFO ] [MAIN ] SLQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:42.713289] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 22s. Rate: 184.0 symbols/min [2025-09-28T02:56:42.965129] [DEBUG] [LOCAL ] SM: Loaded 53080 existing records from primary storage. [2025-09-28T02:56:43.001342] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-28T02:56:43.000624] [INFO ] [MAIN ] SM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:43.000508] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:43.007054] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SM took 1.4s. Estimated remaining: 2m 22s. Rate: 184.0 symbols/min [2025-09-28T02:56:43.013522] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-28T02:56:43.023987] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-28T02:56:43.073368] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-28T02:56:43.160907] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:43.191550] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-28T02:56:43.205107] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-28T02:56:43.211018] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-28T02:56:43.211157] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-28T02:56:43.362610] [DEBUG] [LOCAL ] SMBK: Loaded 8332 existing records from primary storage. [2025-09-28T02:56:43.383130] [INFO ] [MAIN ] SMBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:43.399227] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SMBK took 0.6s. Estimated remaining: 2m 21s. Rate: 184.0 symbols/min [2025-09-28T02:56:43.369487] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:43.399029] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-28T02:56:43.458366] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-28T02:56:43.691006] [DEBUG] [LOCAL ] SMC: Loaded 11630 existing records from primary storage. [2025-09-28T02:56:43.720705] [INFO ] [MAIN ] SMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:43.765198] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:43.773708] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SMC took 0.8s. Estimated remaining: 2m 21s. Rate: 184.0 symbols/min [2025-09-28T02:56:43.773480] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-28T02:56:43.834512] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-28T02:56:44.043533] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:56:44.099724] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-28T02:56:44.123743] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:44.140476] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-28T02:56:44.141609] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-28T02:56:44.167613] [DEBUG] [LOCAL ] SMFG: Loaded 48771 existing records from primary storage. [2025-09-28T02:56:44.168092] [INFO ] [MAIN ] SMFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:44.168197] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SMFG took 0.8s. Estimated remaining: 2m 21s. Rate: 184.0 symbols/min [2025-09-28T02:56:44.279171] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:56:44.344508] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-28T02:56:44.370706] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:56:44.370281] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:44.374035] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-09-28T02:56:44.373869] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-28T02:56:44.375913] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-28T02:56:44.391010] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:56:44.391625] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-28T02:56:44.394379] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-28T02:56:44.394702] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-28T02:56:44.394880] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-28T02:56:44.394988] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMA took 1.7s. Estimated remaining: 2m 20s. Rate: 184.0 symbols/min [2025-09-28T02:56:44.403008] [DEBUG] [LOCAL ] SMG: Loaded 44546 existing records from primary storage. [2025-09-28T02:56:44.420877] [INFO ] [MAIN ] SMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:44.453253] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMG took 0.7s. Estimated remaining: 2m 20s. Rate: 184.1 symbols/min [2025-09-28T02:56:44.557704] [DEBUG] [LOCAL ] SMHI: Loaded 13885 existing records from primary storage. [2025-09-28T02:56:44.624242] [INFO ] [MAIN ] SMHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:44.682232] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMHI took 0.5s. Estimated remaining: 2m 19s. Rate: 184.1 symbols/min [2025-09-28T02:56:44.671355] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-28T02:56:44.706993] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-28T02:56:44.855465] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:44.905361] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:45.039080] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:45.039839] [DEBUG] [LOCAL ] SMP: Loaded 19999 existing records from primary storage. [2025-09-28T02:56:45.042592] [INFO ] [MAIN ] SMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:45.042736] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMP took 0.6s. Estimated remaining: 2m 19s. Rate: 184.1 symbols/min [2025-09-28T02:56:45.085153] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-28T02:56:45.098880] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-28T02:56:45.278153] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:45.306632] [DEBUG] [LOCAL ] SMR: Loaded 54577 existing records from primary storage. [2025-09-28T02:56:45.307142] [INFO ] [MAIN ] SMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:45.307249] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMR took 0.8s. Estimated remaining: 2m 19s. Rate: 184.1 symbols/min [2025-09-28T02:56:45.438906] [DEBUG] [LOCAL ] SMRT: Loaded 44707 existing records from primary storage. [2025-09-28T02:56:45.433352] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-28T02:56:45.445485] [INFO ] [MAIN ] SMRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:45.454512] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMRT took 0.7s. Estimated remaining: 2m 18s. Rate: 184.2 symbols/min [2025-09-28T02:56:45.518222] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-28T02:56:45.639823] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:45.668722] [DEBUG] [LOCAL ] SMWB: Loaded 33137 existing records from primary storage. [2025-09-28T02:56:45.704068] [INFO ] [MAIN ] SMWB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:45.705692] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMWB took 0.7s. Estimated remaining: 2m 18s. Rate: 184.2 symbols/min [2025-09-28T02:56:45.766195] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:45.814322] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-28T02:56:45.951231] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:45.982120] [DEBUG] [LOCAL ] SN: Loaded 50487 existing records from primary storage. [2025-09-28T02:56:45.982921] [INFO ] [MAIN ] SN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:45.983911] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SN took 0.7s. Estimated remaining: 2m 18s. Rate: 184.2 symbols/min [2025-09-28T02:56:46.106998] [DEBUG] [LOCAL ] SNA: Loaded 26608 existing records from primary storage. [2025-09-28T02:56:46.196187] [INFO ] [MAIN ] SNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:46.199973] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:46.200426] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SNA took 0.7s. Estimated remaining: 2m 17s. Rate: 184.2 symbols/min [2025-09-28T02:56:46.315801] [DEBUG] [LOCAL ] SNDA: Loaded 4732 existing records from primary storage. [2025-09-28T02:56:46.315927] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-28T02:56:46.335036] [INFO ] [MAIN ] SNDA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:46.343785] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-09-28T02:56:46.359370] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SNDA took 0.4s. Estimated remaining: 2m 17s. Rate: 184.3 symbols/min [2025-09-28T02:56:46.386613] [INFO ] [MAIN ] SNAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:46.420410] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNAP took 0.7s. Estimated remaining: 2m 17s. Rate: 184.4 symbols/min [2025-09-28T02:56:46.414742] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:46.661723] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-28T02:56:46.720709] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1060 records). [2025-09-28T02:56:46.762300] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-28T02:56:46.766438] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:46.815593] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:46.961224] [DEBUG] [LOCAL ] SNDR: Loaded 41368 existing records from primary storage. [2025-09-28T02:56:46.988327] [INFO ] [MAIN ] SNDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:47.011177] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNDR took 0.8s. Estimated remaining: 2m 16s. Rate: 184.3 symbols/min [2025-09-28T02:56:47.063666] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:56:47.090089] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:56:47.131921] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:56:47.156239] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-28T02:56:47.200344] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-28T02:56:47.202189] [DEBUG] [LOCAL ] SNN: Loaded 45037 existing records from primary storage. [2025-09-28T02:56:47.200553] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-28T02:56:47.208743] [INFO ] [MAIN ] SNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:47.214137] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-28T02:56:47.219415] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNN took 0.8s. Estimated remaining: 2m 16s. Rate: 184.3 symbols/min [2025-09-28T02:56:47.230183] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SLNZ took 6.0s. Estimated remaining: 2m 16s. Rate: 184.4 symbols/min [2025-09-28T02:56:47.324404] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:47.482293] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-09-28T02:56:47.503769] [INFO ] [MAIN ] SNOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:47.568434] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNOW took 1.1s. Estimated remaining: 2m 15s. Rate: 184.4 symbols/min [2025-09-28T02:56:47.614323] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:47.746002] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:47.899146] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:47.923834] [DEBUG] [LOCAL ] SNV: Loaded 49633 existing records from primary storage. [2025-09-28T02:56:47.924578] [INFO ] [MAIN ] SNV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:47.924712] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNV took 0.9s. Estimated remaining: 2m 15s. Rate: 184.4 symbols/min [2025-09-28T02:56:48.023250] [DEBUG] [LOCAL ] SNX: Loaded 40540 existing records from primary storage. [2025-09-28T02:56:48.080578] [INFO ] [MAIN ] SNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:48.134172] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SNX took 0.9s. Estimated remaining: 2m 15s. Rate: 184.4 symbols/min [2025-09-28T02:56:48.170707] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:48.191790] [DEBUG] [LOCAL ] SO: Loaded 54383 existing records from primary storage. [2025-09-28T02:56:48.203905] [INFO ] [MAIN ] SO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:48.204264] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SO took 0.9s. Estimated remaining: 2m 14s. Rate: 184.5 symbols/min [2025-09-28T02:56:48.205902] [DEBUG] [LOCAL ] SOBO: Loaded 40211 existing records from primary storage. [2025-09-28T02:56:48.206594] [INFO ] [MAIN ] SOBO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:48.207188] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SOBO took 0.6s. Estimated remaining: 2m 14s. Rate: 184.6 symbols/min [2025-09-28T02:56:48.260421] [DEBUG] [LOCAL ] SOC: Loaded 51041 existing records from primary storage. [2025-09-28T02:56:48.260880] [INFO ] [MAIN ] SOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:48.261859] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 0.3s. Estimated remaining: 2m 14s. Rate: 184.7 symbols/min [2025-09-28T02:56:48.994310] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:48.971872] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:49.007472] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:49.057071] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:49.057188] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-28T02:56:49.057682] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-28T02:56:49.057994] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-28T02:56:49.058194] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-28T02:56:49.059841] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-28T02:56:49.059917] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-28T02:56:49.189323] [DEBUG] [LOCAL ] SOJE: Loaded 9408 existing records from primary storage. [2025-09-28T02:56:49.195167] [DEBUG] [LOCAL ] SOJC: Loaded 5120 existing records from primary storage. [2025-09-28T02:56:49.212693] [DEBUG] [LOCAL ] SOJD: Loaded 13180 existing records from primary storage. [2025-09-28T02:56:49.211927] [INFO ] [MAIN ] SOJC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:49.218095] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJC took 1.0s. Estimated remaining: 2m 13s. Rate: 184.5 symbols/min [2025-09-28T02:56:49.196100] [INFO ] [MAIN ] SOJE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:49.238333] [INFO ] [MAIN ] SOJD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:49.248971] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOJE took 1.0s. Estimated remaining: 2m 13s. Rate: 184.6 symbols/min [2025-09-28T02:56:49.303472] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJD took 1.0s. Estimated remaining: 2m 13s. Rate: 184.6 symbols/min [2025-09-28T02:56:49.971299] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:49.953036] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:50.070041] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:56:50.091334] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:50.091632] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-28T02:56:50.107489] [DEBUG] [LOCAL ] SOL: Loaded 13694 existing records from primary storage. [2025-09-28T02:56:50.107957] [INFO ] [MAIN ] SOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:50.108163] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOL took 0.9s. Estimated remaining: 2m 12s. Rate: 184.5 symbols/min [2025-09-28T02:56:50.245235] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:56:50.336436] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:50.301871] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-28T02:56:50.338106] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:56:50.353219] [DEBUG] [LOCAL ] SON: Loaded 43596 existing records from primary storage. [2025-09-28T02:56:50.353518] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-09-28T02:56:50.353998] [INFO ] [MAIN ] SON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:50.355356] [DEBUG] [LOCAL ] SOLV: Loaded 44791 existing records from primary storage. [2025-09-28T02:56:50.354113] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:56:50.355931] [INFO ] [MAIN ] SOLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:50.356090] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOLV took 1.1s. Estimated remaining: 2m 12s. Rate: 184.5 symbols/min [2025-09-28T02:56:50.356184] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-28T02:56:50.361775] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SON took 1.0s. Estimated remaining: 2m 12s. Rate: 184.6 symbols/min [2025-09-28T02:56:50.378029] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-28T02:56:50.445903] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-28T02:56:50.527515] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-28T02:56:50.573498] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SOJF took 2.3s. Estimated remaining: 2m 11s. Rate: 184.7 symbols/min [2025-09-28T02:56:50.788445] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:50.900807] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:50.908738] [DEBUG] [LOCAL ] SONY: Loaded 54136 existing records from primary storage. [2025-09-28T02:56:50.964679] [INFO ] [MAIN ] SONY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:50.934504] [DEBUG] [LOCAL ] SOR: Loaded 2947 existing records from primary storage. [2025-09-28T02:56:50.965402] [INFO ] [MAIN ] SOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:50.965549] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SONY took 0.9s. Estimated remaining: 2m 11s. Rate: 184.6 symbols/min [2025-09-28T02:56:51.005407] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:51.004270] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SOR took 0.6s. Estimated remaining: 2m 11s. Rate: 184.7 symbols/min [2025-09-28T02:56:51.067996] [DEBUG] [LOCAL ] SOS: Loaded 8266 existing records from primary storage. [2025-09-28T02:56:51.107743] [INFO ] [MAIN ] SOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:51.138172] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SOS took 0.8s. Estimated remaining: 2m 10s. Rate: 184.8 symbols/min [2025-09-28T02:56:51.383998] [DEBUG] [LOCAL ] SPB: Loaded 34677 existing records from primary storage. [2025-09-28T02:56:51.642679] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:51.671736] [INFO ] [MAIN ] SPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:51.696264] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPB took 1.1s. Estimated remaining: 2m 10s. Rate: 184.7 symbols/min [2025-09-28T02:56:51.788867] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:52.038710] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:52.029825] [DEBUG] [LOCAL ] SPE: Loaded 6441 existing records from primary storage. [2025-09-28T02:56:52.052211] [INFO ] [MAIN ] SPE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:52.115765] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPE took 1.1s. Estimated remaining: 2m 10s. Rate: 184.7 symbols/min [2025-09-28T02:56:52.140264] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:52.178541] [DEBUG] [LOCAL ] SPCE: Loaded 50615 existing records from primary storage. [2025-09-28T02:56:52.196500] [INFO ] [MAIN ] SPCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:52.230847] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 9s. Rate: 184.7 symbols/min [2025-09-28T02:56:52.404547] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:52.616838] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:52.627330] [DEBUG] [LOCAL ] SPG: Loaded 51134 existing records from primary storage. [2025-09-28T02:56:52.628583] [INFO ] [MAIN ] SPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:52.629454] [DEBUG] [LOCAL ] SPGI: Loaded 46562 existing records from primary storage. [2025-09-28T02:56:52.628032] [DEBUG] [LOCAL ] SPH: Loaded 18213 existing records from primary storage. [2025-09-28T02:56:52.630147] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPG took 1.4s. Estimated remaining: 2m 9s. Rate: 184.7 symbols/min [2025-09-28T02:56:52.630720] [INFO ] [MAIN ] SPGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:52.642978] [INFO ] [MAIN ] SPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:52.643131] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPGI took 0.9s. Estimated remaining: 2m 9s. Rate: 184.8 symbols/min [2025-09-28T02:56:52.700892] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPH took 0.5s. Estimated remaining: 2m 8s. Rate: 184.9 symbols/min [2025-09-28T02:56:53.104291] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:53.112952] [DEBUG] [LOCAL ] SPHR: Loaded 40745 existing records from primary storage. [2025-09-28T02:56:53.134598] [INFO ] [MAIN ] SPHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:53.206267] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPHR took 0.9s. Estimated remaining: 2m 8s. Rate: 184.8 symbols/min [2025-09-28T02:56:53.267984] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:53.266461] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:53.282306] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-28T02:56:53.306111] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-28T02:56:53.333167] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-28T02:56:53.369603] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-28T02:56:53.385661] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-28T02:56:53.389170] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-28T02:56:53.389917] [DEBUG] [LOCAL ] SPMC: Loaded 5613 existing records from primary storage. [2025-09-28T02:56:53.412539] [INFO ] [MAIN ] SPMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:53.417695] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPMC took 0.7s. Estimated remaining: 2m 8s. Rate: 184.9 symbols/min [2025-09-28T02:56:53.697435] [DEBUG] [LOCAL ] SPIR: Loaded 37871 existing records from primary storage. [2025-09-28T02:56:53.695804] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:53.754191] [INFO ] [MAIN ] SPIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:53.825714] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPIR took 1.2s. Estimated remaining: 2m 7s. Rate: 184.8 symbols/min [2025-09-28T02:56:54.023496] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:54.168231] [DEBUG] [LOCAL ] SPNT: Loaded 35342 existing records from primary storage. [2025-09-28T02:56:54.195394] [INFO ] [MAIN ] SPNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:54.221563] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPNT took 1.0s. Estimated remaining: 2m 7s. Rate: 184.8 symbols/min [2025-09-28T02:56:54.375140] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:54.438872] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:56:54.474243] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-28T02:56:54.574459] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:54.576746] [DEBUG] [LOCAL ] SPOT: Loaded 51481 existing records from primary storage. [2025-09-28T02:56:54.577448] [INFO ] [MAIN ] SPOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:54.577577] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPOT took 1.1s. Estimated remaining: 2m 7s. Rate: 184.8 symbols/min [2025-09-28T02:56:54.718258] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:56:54.712794] [DEBUG] [LOCAL ] SPRU: Loaded 8714 existing records from primary storage. [2025-09-28T02:56:54.724130] [INFO ] [MAIN ] SPRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:54.725030] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPRU took 0.5s. Estimated remaining: 2m 6s. Rate: 184.9 symbols/min [2025-09-28T02:56:54.725222] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-28T02:56:54.730885] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:56:54.810970] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-09-28T02:56:54.847043] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:56:54.865509] [DEBUG] [LOCAL ] SPR: Loaded 41867 existing records from primary storage. [2025-09-28T02:56:54.864144] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:54.876083] [INFO ] [MAIN ] SPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:54.865616] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-28T02:56:54.897859] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-28T02:56:54.897732] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPR took 1.1s. Estimated remaining: 2m 6s. Rate: 184.9 symbols/min [2025-09-28T02:56:54.925259] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-28T02:56:54.960061] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-28T02:56:55.094676] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:55.053554] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPME took 2.3s. Estimated remaining: 2m 6s. Rate: 185.0 symbols/min [2025-09-28T02:56:55.203039] [DEBUG] [LOCAL ] SPXC: Loaded 23666 existing records from primary storage. [2025-09-28T02:56:55.280695] [INFO ] [MAIN ] SPXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:55.321432] [DEBUG] [LOCAL ] SPXX: Loaded 9166 existing records from primary storage. [2025-09-28T02:56:55.359340] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:55.381114] [INFO ] [MAIN ] SPXX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:55.344778] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXC took 0.8s. Estimated remaining: 2m 5s. Rate: 185.0 symbols/min [2025-09-28T02:56:55.396327] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SPXX took 0.7s. Estimated remaining: 2m 5s. Rate: 185.0 symbols/min [2025-09-28T02:56:55.432776] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:55.778430] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:55.802976] [DEBUG] [LOCAL ] SQNS: Loaded 26307 existing records from primary storage. [2025-09-28T02:56:55.837060] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:55.837256] [INFO ] [MAIN ] SQNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:55.852369] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQNS took 0.8s. Estimated remaining: 2m 5s. Rate: 185.0 symbols/min [2025-09-28T02:56:55.861017] [DEBUG] [LOCAL ] SQM: Loaded 49278 existing records from primary storage. [2025-09-28T02:56:55.883473] [INFO ] [MAIN ] SQM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:55.914336] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SQM took 1.0s. Estimated remaining: 2m 4s. Rate: 185.1 symbols/min [2025-09-28T02:56:56.199046] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:56.216923] [DEBUG] [LOCAL ] SR: Loaded 33411 existing records from primary storage. [2025-09-28T02:56:56.274207] [INFO ] [MAIN ] SR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:56.297255] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:56.298629] [DEBUG] [LOCAL ] SRE: Loaded 54202 existing records from primary storage. [2025-09-28T02:56:56.299325] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SR took 0.9s. Estimated remaining: 2m 4s. Rate: 185.1 symbols/min [2025-09-28T02:56:56.300792] [INFO ] [MAIN ] SRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:56.318736] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SRE took 0.9s. Estimated remaining: 2m 3s. Rate: 185.2 symbols/min [2025-09-28T02:56:56.524376] [DEBUG] [LOCAL ] SREA: Loaded 10561 existing records from primary storage. [2025-09-28T02:56:56.612417] [DEBUG] [LOCAL ] SRFM: Loaded 36431 existing records from primary storage. [2025-09-28T02:56:56.600773] [INFO ] [MAIN ] SREA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:56.634530] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SREA took 0.8s. Estimated remaining: 2m 3s. Rate: 185.2 symbols/min [2025-09-28T02:56:56.649271] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:56.687089] [INFO ] [MAIN ] SRFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:56.749804] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRFM took 0.8s. Estimated remaining: 2m 3s. Rate: 185.2 symbols/min [2025-09-28T02:56:56.792255] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:56.845337] [DEBUG] [LOCAL ] SRG: Loaded 15859 existing records from primary storage. [2025-09-28T02:56:56.872411] [INFO ] [MAIN ] SRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:56.965408] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRG took 0.7s. Estimated remaining: 2m 2s. Rate: 185.2 symbols/min [2025-09-28T02:56:57.052542] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:57.125519] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-28T02:56:57.169045] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-28T02:56:57.214262] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-28T02:56:57.246291] [DEBUG] [LOCAL ] SRI: Loaded 27810 existing records from primary storage. [2025-09-28T02:56:57.232251] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-28T02:56:57.248449] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:57.253935] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-28T02:56:57.259213] [INFO ] [MAIN ] SRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:57.264930] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-28T02:56:57.266216] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRI took 0.9s. Estimated remaining: 2m 2s. Rate: 185.3 symbols/min [2025-09-28T02:56:57.416551] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:57.518288] [DEBUG] [LOCAL ] SRV: Loaded 7631 existing records from primary storage. [2025-09-28T02:56:57.568215] [INFO ] [MAIN ] SRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:57.599247] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRV took 0.8s. Estimated remaining: 2m 2s. Rate: 185.2 symbols/min [2025-09-28T02:56:57.806372] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:58.041365] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:58.128051] [DEBUG] [LOCAL ] SSB: Loaded 43377 existing records from primary storage. [2025-09-28T02:56:58.152711] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:56:58.159878] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-28T02:56:58.161203] [INFO ] [MAIN ] SSB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:58.161373] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SSB took 1.1s. Estimated remaining: 2m 2s. Rate: 185.2 symbols/min [2025-09-28T02:56:58.168816] [DEBUG] [LOCAL ] SSD: Loaded 22631 existing records from primary storage. [2025-09-28T02:56:58.219435] [INFO ] [MAIN ] SSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:58.278978] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSD took 1.0s. Estimated remaining: 2m 1s. Rate: 185.2 symbols/min [2025-09-28T02:56:58.382084] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:56:58.385989] [DEBUG] [LOCAL ] SSL: Loaded 41830 existing records from primary storage. [2025-09-28T02:56:58.386447] [INFO ] [MAIN ] SSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:58.386591] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSL took 0.8s. Estimated remaining: 2m 1s. Rate: 185.3 symbols/min [2025-09-28T02:56:58.401387] [DEBUG] [LOCAL ] SST: Loaded 12166 existing records from primary storage. [2025-09-28T02:56:58.401747] [INFO ] [MAIN ] SST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:56:58.401854] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SST took 0.2s. Estimated remaining: 2m 0s. Rate: 185.4 symbols/min [2025-09-28T02:56:58.572412] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-28T02:56:58.573940] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-28T02:56:58.875777] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-28T02:56:58.877127] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-28T02:56:59.104324] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-28T02:56:59.105453] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-28T02:56:59.328227] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-28T02:56:59.329338] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-28T02:56:59.549144] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-28T02:56:59.550268] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-28T02:56:59.697385] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.15 seconds). [2025-09-28T02:56:59.698514] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-28T02:56:59.843001] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.14 seconds). [2025-09-28T02:56:59.844167] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-28T02:57:00.058582] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-28T02:57:00.059687] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-28T02:57:00.229143] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.17 seconds). [2025-09-28T02:57:00.230589] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-28T02:57:00.637846] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-28T02:57:00.638766] [INFO ] [REMOTE ] SRL: Full fetch complete (1966 records). [2025-09-28T02:57:00.638859] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-28T02:57:00.824886] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-28T02:57:00.825106] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:57:00.825182] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:57:00.825258] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-28T02:57:00.825370] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-28T02:57:00.825457] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-28T02:57:00.825589] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-28T02:57:00.825720] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SRL took 4.2s. Estimated remaining: 2m 0s. Rate: 184.8 symbols/min [2025-09-28T02:57:01.357380] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:01.504826] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:01.508554] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:01.585211] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:01.607576] [DEBUG] [LOCAL ] STC: Loaded 17878 existing records from primary storage. [2025-09-28T02:57:01.608148] [INFO ] [MAIN ] STC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:01.608865] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STC took 0.8s. Estimated remaining: 2m 0s. Rate: 184.7 symbols/min [2025-09-28T02:57:01.815715] [DEBUG] [LOCAL ] SSTK: Loaded 26762 existing records from primary storage. [2025-09-28T02:57:01.804464] [DEBUG] [LOCAL ] ST: Loaded 50505 existing records from primary storage. [2025-09-28T02:57:01.816674] [INFO ] [MAIN ] SSTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:01.817033] [INFO ] [MAIN ] ST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:01.817858] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. SSTK took 1.0s. Estimated remaining: 1m 60s. Rate: 184.7 symbols/min [2025-09-28T02:57:01.877865] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:01.878544] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. ST took 1.0s. Estimated remaining: 1m 60s. Rate: 184.8 symbols/min [2025-09-28T02:57:02.008040] [DEBUG] [LOCAL ] STAG: Loaded 50799 existing records from primary storage. [2025-09-28T02:57:02.083405] [INFO ] [MAIN ] STAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:02.131562] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. STAG took 1.3s. Estimated remaining: 1m 59s. Rate: 184.8 symbols/min [2025-09-28T02:57:02.309175] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:02.386547] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:02.420068] [DEBUG] [LOCAL ] STE: Loaded 35822 existing records from primary storage. [2025-09-28T02:57:02.430429] [INFO ] [MAIN ] STE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:02.436022] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STE took 0.8s. Estimated remaining: 1m 59s. Rate: 184.8 symbols/min [2025-09-28T02:57:02.575764] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:02.648457] [DEBUG] [LOCAL ] STEL: Loaded 23823 existing records from primary storage. [2025-09-28T02:57:02.665784] [INFO ] [MAIN ] STEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:02.750110] [DEBUG] [LOCAL ] STEM: Loaded 40374 existing records from primary storage. [2025-09-28T02:57:02.748730] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:02.747632] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEL took 0.9s. Estimated remaining: 1m 59s. Rate: 184.8 symbols/min [2025-09-28T02:57:02.750951] [INFO ] [MAIN ] STEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:02.763623] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STEM took 0.9s. Estimated remaining: 1m 58s. Rate: 184.9 symbols/min [2025-09-28T02:57:02.751310] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-28T02:57:02.828781] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-28T02:57:02.821681] [DEBUG] [LOCAL ] STEW: Loaded 16354 existing records from primary storage. [2025-09-28T02:57:02.872456] [INFO ] [MAIN ] STEW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:02.862547] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-28T02:57:02.904506] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STEW took 0.8s. Estimated remaining: 1m 58s. Rate: 184.9 symbols/min [2025-09-28T02:57:02.904761] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-28T02:57:02.959937] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-28T02:57:02.972505] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-28T02:57:03.323686] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:03.386468] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:03.490839] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:03.560459] [DEBUG] [LOCAL ] STK: Loaded 9550 existing records from primary storage. [2025-09-28T02:57:03.577356] [INFO ] [MAIN ] STK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:03.577873] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STK took 0.8s. Estimated remaining: 1m 58s. Rate: 184.8 symbols/min [2025-09-28T02:57:03.977528] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:04.000924] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:04.017633] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-28T02:57:04.038130] [DEBUG] [LOCAL ] STM: Loaded 54362 existing records from primary storage. [2025-09-28T02:57:04.036738] [DEBUG] [LOCAL ] STLA: Loaded 54322 existing records from primary storage. [2025-09-28T02:57:04.038789] [INFO ] [MAIN ] STM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:04.038878] [INFO ] [MAIN ] STLA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:04.039865] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STM took 1.1s. Estimated remaining: 1m 57s. Rate: 184.8 symbols/min [2025-09-28T02:57:04.040355] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STLA took 1.2s. Estimated remaining: 1m 57s. Rate: 184.9 symbols/min [2025-09-28T02:57:04.286988] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-28T02:57:04.288760] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-28T02:57:04.321483] [DEBUG] [LOCAL ] STN: Loaded 23436 existing records from primary storage. [2025-09-28T02:57:04.377939] [INFO ] [MAIN ] STN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:04.437842] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:04.460148] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STN took 0.9s. Estimated remaining: 1m 57s. Rate: 184.9 symbols/min [2025-09-28T02:57:04.464308] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:04.598613] [DEBUG] [LOCAL ] STRV: Loaded 11754 existing records from primary storage. [2025-09-28T02:57:04.599394] [INFO ] [MAIN ] STRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:04.599616] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STRV took 0.5s. Estimated remaining: 1m 56s. Rate: 184.9 symbols/min [2025-09-28T02:57:04.728043] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:04.790178] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-28T02:57:04.823225] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-28T02:57:04.849007] [DEBUG] [LOCAL ] STNG: Loaded 44620 existing records from primary storage. [2025-09-28T02:57:04.870549] [INFO ] [MAIN ] STNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:04.910244] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STNG took 0.9s. Estimated remaining: 1m 56s. Rate: 184.9 symbols/min [2025-09-28T02:57:04.992819] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:05.047064] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-28T02:57:05.074139] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-28T02:57:05.105067] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-28T02:57:05.105592] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-28T02:57:05.106807] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-28T02:57:05.107573] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-28T02:57:05.163674] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-28T02:57:05.193512] [DEBUG] [LOCAL ] STT: Loaded 51793 existing records from primary storage. [2025-09-28T02:57:05.201424] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-28T02:57:05.222154] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:05.222785] [INFO ] [MAIN ] STT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:05.236822] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STT took 0.8s. Estimated remaining: 1m 56s. Rate: 184.9 symbols/min [2025-09-28T02:57:05.438404] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-28T02:57:05.456264] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-28T02:57:05.649382] [DEBUG] [LOCAL ] STVN: Loaded 26677 existing records from primary storage. [2025-09-28T02:57:05.699496] [INFO ] [MAIN ] STVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:05.776189] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:05.780926] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STVN took 0.9s. Estimated remaining: 1m 55s. Rate: 184.9 symbols/min [2025-09-28T02:57:05.805688] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-28T02:57:05.841860] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-28T02:57:05.985801] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:06.001306] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-28T02:57:06.081498] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:06.087112] [DEBUG] [LOCAL ] STXD: Loaded 1341 existing records from primary storage. [2025-09-28T02:57:06.101843] [INFO ] [MAIN ] STXD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:06.101973] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STXD took 0.3s. Estimated remaining: 1m 55s. Rate: 184.9 symbols/min [2025-09-28T02:57:06.201721] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:57:06.289127] [DEBUG] [LOCAL ] STWD: Loaded 52643 existing records from primary storage. [2025-09-28T02:57:06.224974] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-28T02:57:06.309109] [INFO ] [MAIN ] STWD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:06.310729] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:57:06.310351] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:06.310847] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-09-28T02:57:06.311563] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:57:06.311984] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-28T02:57:06.311481] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STWD took 1.0s. Estimated remaining: 1m 55s. Rate: 184.9 symbols/min [2025-09-28T02:57:06.361931] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-28T02:57:06.332579] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-28T02:57:06.379464] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-28T02:57:06.380475] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-28T02:57:06.407026] [DEBUG] [LOCAL ] STXE: Loaded 2234 existing records from primary storage. [2025-09-28T02:57:06.428795] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-28T02:57:06.434287] [INFO ] [MAIN ] STXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:06.435040] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STUB took 1.8s. Estimated remaining: 1m 54s. Rate: 184.9 symbols/min [2025-09-28T02:57:06.461175] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STXE took 0.4s. Estimated remaining: 1m 54s. Rate: 185.0 symbols/min [2025-09-28T02:57:06.633100] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:06.694265] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-28T02:57:06.715508] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-28T02:57:06.854186] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:06.879002] [DEBUG] [LOCAL ] STXG: Loaded 2612 existing records from primary storage. [2025-09-28T02:57:06.903593] [INFO ] [MAIN ] STXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:06.904452] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STXG took 0.6s. Estimated remaining: 1m 54s. Rate: 185.0 symbols/min [2025-09-28T02:57:06.928788] [DEBUG] [LOCAL ] STXK: Loaded 1535 existing records from primary storage. [2025-09-28T02:57:07.043769] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:07.015054] [INFO ] [MAIN ] STXK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:07.057358] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-28T02:57:07.062924] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXK took 0.6s. Estimated remaining: 1m 53s. Rate: 185.0 symbols/min [2025-09-28T02:57:07.069227] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-28T02:57:07.088539] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-28T02:57:07.132431] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-28T02:57:07.178363] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-28T02:57:07.188865] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-28T02:57:07.456379] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-28T02:57:07.457394] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:07.484876] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-28T02:57:07.546068] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:07.612883] [DEBUG] [LOCAL ] STXT: Loaded 2592 existing records from primary storage. [2025-09-28T02:57:07.632153] [DEBUG] [LOCAL ] STXV: Loaded 1648 existing records from primary storage. [2025-09-28T02:57:07.641180] [INFO ] [MAIN ] STXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:07.660598] [INFO ] [MAIN ] STXV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:07.660780] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXT took 0.8s. Estimated remaining: 1m 53s. Rate: 185.0 symbols/min [2025-09-28T02:57:07.741634] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXV took 0.6s. Estimated remaining: 1m 53s. Rate: 185.0 symbols/min [2025-09-28T02:57:08.017062] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-28T02:57:08.082983] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-28T02:57:08.110531] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:08.153680] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-28T02:57:08.181732] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:08.259074] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:08.358114] [DEBUG] [LOCAL ] STZ: Loaded 53035 existing records from primary storage. [2025-09-28T02:57:08.359396] [DEBUG] [LOCAL ] SU: Loaded 54234 existing records from primary storage. [2025-09-28T02:57:08.359991] [INFO ] [MAIN ] STZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:08.360272] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STZ took 0.6s. Estimated remaining: 1m 52s. Rate: 185.0 symbols/min [2025-09-28T02:57:08.360436] [INFO ] [MAIN ] SU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:08.367842] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. SU took 0.6s. Estimated remaining: 1m 52s. Rate: 185.0 symbols/min [2025-09-28T02:57:08.521079] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-28T02:57:08.570220] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-28T02:57:08.572351] [INFO ] [REMOTE ] STG: Full fetch complete (2496 records). [2025-09-28T02:57:08.608815] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-28T02:57:08.620981] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-28T02:57:08.781529] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:08.885901] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:08.977157] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-28T02:57:08.977563] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:57:08.977677] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:57:08.977773] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-28T02:57:08.977915] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-28T02:57:08.980415] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-28T02:57:08.980524] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-28T02:57:08.980737] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. STG took 6.5s. Estimated remaining: 1m 52s. Rate: 185.0 symbols/min [2025-09-28T02:57:09.181394] [DEBUG] [LOCAL ] SUI: Loaded 42505 existing records from primary storage. [2025-09-28T02:57:09.197859] [DEBUG] [LOCAL ] SUN: Loaded 37928 existing records from primary storage. [2025-09-28T02:57:09.181742] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-28T02:57:09.214448] [INFO ] [MAIN ] SUI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:09.216334] [INFO ] [MAIN ] SUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:09.216160] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-28T02:57:09.221849] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. SUN took 0.8s. Estimated remaining: 1m 51s. Rate: 185.0 symbols/min [2025-09-28T02:57:09.223564] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:09.235698] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUI took 0.9s. Estimated remaining: 1m 51s. Rate: 185.1 symbols/min [2025-09-28T02:57:09.611582] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:09.616209] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:09.620015] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-28T02:57:09.635307] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-28T02:57:09.639247] [DEBUG] [LOCAL ] SUPV: Loaded 47961 existing records from primary storage. [2025-09-28T02:57:09.640093] [INFO ] [MAIN ] SUPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:09.640577] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SUPV took 0.7s. Estimated remaining: 1m 51s. Rate: 185.1 symbols/min [2025-09-28T02:57:09.849687] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:09.902447] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-28T02:57:09.904277] [DEBUG] [LOCAL ] SVV: Loaded 40221 existing records from primary storage. [2025-09-28T02:57:09.906827] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-28T02:57:09.909903] [DEBUG] [LOCAL ] SUZ: Loaded 46428 existing records from primary storage. [2025-09-28T02:57:09.908877] [INFO ] [MAIN ] SVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:09.910378] [INFO ] [MAIN ] SUZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:09.910862] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SVV took 0.7s. Estimated remaining: 1m 50s. Rate: 185.1 symbols/min [2025-09-28T02:57:09.911312] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SUZ took 0.7s. Estimated remaining: 1m 50s. Rate: 185.2 symbols/min [2025-09-28T02:57:10.186161] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-28T02:57:10.228192] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-28T02:57:10.366736] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:10.370833] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:10.372831] [DEBUG] [LOCAL ] SW: Loaded 53939 existing records from primary storage. [2025-09-28T02:57:10.374049] [INFO ] [MAIN ] SW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:10.374163] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SW took 0.7s. Estimated remaining: 1m 50s. Rate: 185.1 symbols/min [2025-09-28T02:57:10.602323] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-28T02:57:10.621524] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-28T02:57:10.623944] [DEBUG] [LOCAL ] SWX: Loaded 31735 existing records from primary storage. [2025-09-28T02:57:10.605726] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:10.624707] [INFO ] [MAIN ] SWX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:10.625367] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SWX took 0.7s. Estimated remaining: 1m 49s. Rate: 185.1 symbols/min [2025-09-28T02:57:10.758225] [DEBUG] [LOCAL ] SWK: Loaded 53178 existing records from primary storage. [2025-09-28T02:57:10.748573] [DEBUG] [LOCAL ] SWZ: Loaded 6074 existing records from primary storage. [2025-09-28T02:57:10.763621] [INFO ] [MAIN ] SWZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:10.764465] [INFO ] [MAIN ] SWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:10.780604] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SWZ took 0.4s. Estimated remaining: 1m 49s. Rate: 185.2 symbols/min [2025-09-28T02:57:10.814360] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SWK took 0.9s. Estimated remaining: 1m 48s. Rate: 185.3 symbols/min [2025-09-28T02:57:10.921762] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-28T02:57:10.929154] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:11.125808] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-28T02:57:11.255905] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:11.260194] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:11.277957] [DEBUG] [LOCAL ] SXC: Loaded 42142 existing records from primary storage. [2025-09-28T02:57:11.278521] [INFO ] [MAIN ] SXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:11.278630] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SXC took 0.7s. Estimated remaining: 1m 48s. Rate: 185.2 symbols/min [2025-09-28T02:57:11.294962] [DEBUG] [LOCAL ] SXI: Loaded 11685 existing records from primary storage. [2025-09-28T02:57:11.295253] [INFO ] [MAIN ] SXI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:11.295368] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXI took 0.5s. Estimated remaining: 1m 48s. Rate: 185.3 symbols/min [2025-09-28T02:57:11.320294] [DEBUG] [LOCAL ] SXT: Loaded 29557 existing records from primary storage. [2025-09-28T02:57:11.320708] [INFO ] [MAIN ] SXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:11.321862] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXT took 0.5s. Estimated remaining: 1m 47s. Rate: 185.4 symbols/min [2025-09-28T02:57:11.490679] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-28T02:57:11.910742] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-28T02:57:12.131429] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-28T02:57:12.710750] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-28T02:57:12.940487] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-28T02:57:12.941328] [INFO ] [REMOTE ] STXM: Full fetch complete (1431 records). [2025-09-28T02:57:12.941440] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-28T02:57:13.137688] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-28T02:57:13.137902] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:57:13.137997] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:57:13.138075] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-28T02:57:13.138174] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-28T02:57:13.138252] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-28T02:57:13.138360] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-28T02:57:13.138493] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. STXM took 6.6s. Estimated remaining: 1m 47s. Rate: 185.0 symbols/min [2025-09-28T02:57:13.742252] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:13.838250] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:13.892424] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:13.896799] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:13.996927] [DEBUG] [LOCAL ] SYF: Loaded 54222 existing records from primary storage. [2025-09-28T02:57:13.997438] [INFO ] [MAIN ] SYF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:13.997575] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. SYF took 0.9s. Estimated remaining: 1m 47s. Rate: 184.8 symbols/min [2025-09-28T02:57:14.163629] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-09-28T02:57:14.162296] [DEBUG] [LOCAL ] SYK: Loaded 47699 existing records from primary storage. [2025-09-28T02:57:14.164676] [DEBUG] [LOCAL ] SYY: Loaded 54009 existing records from primary storage. [2025-09-28T02:57:14.165615] [INFO ] [MAIN ] SYK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:14.181527] [INFO ] [MAIN ] T: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:14.181737] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYK took 1.0s. Estimated remaining: 1m 47s. Rate: 184.9 symbols/min [2025-09-28T02:57:14.206556] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. T took 1.1s. Estimated remaining: 1m 46s. Rate: 185.0 symbols/min [2025-09-28T02:57:14.220383] [INFO ] [MAIN ] SYY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:14.290607] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:14.348244] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. SYY took 1.2s. Estimated remaining: 1m 46s. Rate: 185.0 symbols/min [2025-09-28T02:57:14.746343] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:14.850242] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:14.829940] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:14.871169] [DEBUG] [LOCAL ] TAC: Loaded 43441 existing records from primary storage. [2025-09-28T02:57:14.872099] [INFO ] [MAIN ] TAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:14.872261] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAC took 0.9s. Estimated remaining: 1m 46s. Rate: 184.9 symbols/min [2025-09-28T02:57:15.129865] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:15.171576] [DEBUG] [LOCAL ] TAL: Loaded 52783 existing records from primary storage. [2025-09-28T02:57:15.172810] [DEBUG] [LOCAL ] TAK: Loaded 50538 existing records from primary storage. [2025-09-28T02:57:15.188686] [INFO ] [MAIN ] TAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:15.189173] [INFO ] [MAIN ] TAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:15.190133] [DEBUG] [LOCAL ] TALO: Loaded 51575 existing records from primary storage. [2025-09-28T02:57:15.191674] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TAL took 0.9s. Estimated remaining: 1m 45s. Rate: 184.9 symbols/min [2025-09-28T02:57:15.192523] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TAK took 1.0s. Estimated remaining: 1m 45s. Rate: 185.0 symbols/min [2025-09-28T02:57:15.192708] [INFO ] [MAIN ] TALO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:15.222689] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TALO took 0.8s. Estimated remaining: 1m 45s. Rate: 185.1 symbols/min [2025-09-28T02:57:15.706550] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:15.727910] [DEBUG] [LOCAL ] TAP: Loaded 53648 existing records from primary storage. [2025-09-28T02:57:15.743963] [INFO ] [MAIN ] TAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:15.789803] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:15.809315] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:15.805722] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TAP took 0.9s. Estimated remaining: 1m 44s. Rate: 185.0 symbols/min [2025-09-28T02:57:15.921250] [DEBUG] [LOCAL ] TBB: Loaded 11828 existing records from primary storage. [2025-09-28T02:57:15.928221] [INFO ] [MAIN ] TBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:15.928355] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBB took 0.7s. Estimated remaining: 1m 44s. Rate: 185.1 symbols/min [2025-09-28T02:57:16.126410] [DEBUG] [LOCAL ] TBI: Loaded 22937 existing records from primary storage. [2025-09-28T02:57:16.162964] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:16.184697] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-28T02:57:16.223926] [DEBUG] [LOCAL ] TBBB: Loaded 36262 existing records from primary storage. [2025-09-28T02:57:16.251186] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-28T02:57:16.252986] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:16.184963] [INFO ] [MAIN ] TBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:16.254227] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-28T02:57:16.254478] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBI took 1.0s. Estimated remaining: 1m 44s. Rate: 185.1 symbols/min [2025-09-28T02:57:16.253924] [INFO ] [MAIN ] TBBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:16.271271] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-28T02:57:16.271437] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TBBB took 1.1s. Estimated remaining: 1m 43s. Rate: 185.2 symbols/min [2025-09-28T02:57:16.308418] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-28T02:57:16.352521] [DEBUG] [LOCAL ] TBN: Loaded 3044 existing records from primary storage. [2025-09-28T02:57:16.363848] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-28T02:57:16.406793] [INFO ] [MAIN ] TBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:16.449151] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TBN took 0.5s. Estimated remaining: 1m 43s. Rate: 185.2 symbols/min [2025-09-28T02:57:16.751710] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:16.836070] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-28T02:57:16.853272] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-28T02:57:16.872233] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:16.888144] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-28T02:57:16.929135] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-28T02:57:16.971365] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-28T02:57:17.023941] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-28T02:57:17.209487] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:17.381006] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:17.395300] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-28T02:57:17.548423] [DEBUG] [LOCAL ] TD: Loaded 53036 existing records from primary storage. [2025-09-28T02:57:17.566405] [INFO ] [MAIN ] TD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:17.612040] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TD took 1.3s. Estimated remaining: 1m 43s. Rate: 185.0 symbols/min [2025-09-28T02:57:17.704746] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-28T02:57:17.778812] [DEBUG] [LOCAL ] TDC: Loaded 47501 existing records from primary storage. [2025-09-28T02:57:17.882399] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:17.795539] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-28T02:57:17.883231] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-28T02:57:17.882854] [INFO ] [MAIN ] TDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:17.900673] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TDC took 1.4s. Estimated remaining: 1m 42s. Rate: 185.0 symbols/min [2025-09-28T02:57:18.073025] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:18.078376] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:57:18.116001] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-28T02:57:18.159214] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:57:18.178075] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:18.178326] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-09-28T02:57:18.178731] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:57:18.178962] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-28T02:57:18.183884] [DEBUG] [LOCAL ] TDF: Loaded 6595 existing records from primary storage. [2025-09-28T02:57:18.184079] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-28T02:57:18.184911] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-28T02:57:18.184747] [INFO ] [MAIN ] TDF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:18.185320] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-28T02:57:18.185513] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TCAI took 1.9s. Estimated remaining: 1m 42s. Rate: 185.0 symbols/min [2025-09-28T02:57:18.185847] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TDF took 0.5s. Estimated remaining: 1m 42s. Rate: 185.1 symbols/min [2025-09-28T02:57:18.315071] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-28T02:57:18.388316] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-28T02:57:18.488756] [DEBUG] [LOCAL ] TDG: Loaded 22314 existing records from primary storage. [2025-09-28T02:57:18.513606] [INFO ] [MAIN ] TDG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:18.514375] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDG took 0.6s. Estimated remaining: 1m 41s. Rate: 185.1 symbols/min [2025-09-28T02:57:18.565664] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:18.592140] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:18.786033] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:18.835147] [DEBUG] [LOCAL ] TDS: Loaded 43435 existing records from primary storage. [2025-09-28T02:57:18.838027] [INFO ] [MAIN ] TDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:18.853799] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDS took 0.7s. Estimated remaining: 1m 41s. Rate: 185.1 symbols/min [2025-09-28T02:57:18.867358] [DEBUG] [LOCAL ] TDOC: Loaded 54125 existing records from primary storage. [2025-09-28T02:57:18.881988] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-28T02:57:18.895844] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-28T02:57:18.881841] [INFO ] [MAIN ] TDOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:18.897052] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDOC took 0.7s. Estimated remaining: 1m 41s. Rate: 185.2 symbols/min [2025-09-28T02:57:19.182495] [DEBUG] [LOCAL ] TDW: Loaded 46091 existing records from primary storage. [2025-09-28T02:57:19.209851] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-28T02:57:19.213603] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-28T02:57:19.219093] [INFO ] [MAIN ] TDW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:19.234730] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TDW took 0.7s. Estimated remaining: 1m 40s. Rate: 185.2 symbols/min [2025-09-28T02:57:19.211631] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:19.360133] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:19.379412] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-28T02:57:19.398353] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-28T02:57:19.402070] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-28T02:57:19.402174] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-28T02:57:19.402741] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-28T02:57:19.402837] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-28T02:57:19.541600] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:19.577499] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-28T02:57:19.608280] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-28T02:57:19.614110] [DEBUG] [LOCAL ] TDY: Loaded 22979 existing records from primary storage. [2025-09-28T02:57:19.673887] [INFO ] [MAIN ] TDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:19.701289] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDY took 0.8s. Estimated remaining: 1m 40s. Rate: 185.1 symbols/min [2025-09-28T02:57:19.758262] [DEBUG] [LOCAL ] TEAF: Loaded 7529 existing records from primary storage. [2025-09-28T02:57:19.787314] [INFO ] [MAIN ] TEAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:19.805413] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TEAF took 0.6s. Estimated remaining: 1m 40s. Rate: 185.2 symbols/min [2025-09-28T02:57:19.970487] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-28T02:57:20.074330] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-28T02:57:20.124038] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:20.206290] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:20.249328] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-28T02:57:20.288252] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:20.357443] [DEBUG] [LOCAL ] TECK: Loaded 54216 existing records from primary storage. [2025-09-28T02:57:20.359404] [INFO ] [MAIN ] TECK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:20.370246] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TECK took 0.7s. Estimated remaining: 1m 39s. Rate: 185.1 symbols/min [2025-09-28T02:57:20.416489] [DEBUG] [LOCAL ] TEF: Loaded 37944 existing records from primary storage. [2025-09-28T02:57:20.449743] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-28T02:57:20.455347] [INFO ] [MAIN ] TEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:20.429943] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:57:20.461802] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEF took 0.6s. Estimated remaining: 1m 39s. Rate: 185.2 symbols/min [2025-09-28T02:57:20.495160] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-28T02:57:20.522352] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:57:20.522671] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-09-28T02:57:20.527921] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:57:20.559145] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-28T02:57:20.620245] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-28T02:57:20.630152] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-28T02:57:20.657385] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:20.670522] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-28T02:57:20.676885] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TE took 1.8s. Estimated remaining: 1m 39s. Rate: 185.2 symbols/min [2025-09-28T02:57:20.713725] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-28T02:57:20.824396] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:20.941314] [DEBUG] [LOCAL ] TEI: Loaded 20910 existing records from primary storage. [2025-09-28T02:57:20.964391] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:20.965372] [INFO ] [MAIN ] TEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:20.966474] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TEI took 0.6s. Estimated remaining: 1m 38s. Rate: 185.2 symbols/min [2025-09-28T02:57:21.085717] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-28T02:57:21.231982] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:21.260588] [DEBUG] [LOCAL ] TEN: Loaded 31383 existing records from primary storage. [2025-09-28T02:57:21.262862] [DEBUG] [LOCAL ] TEL: Loaded 51898 existing records from primary storage. [2025-09-28T02:57:21.263110] [INFO ] [MAIN ] TEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:21.263707] [INFO ] [MAIN ] TEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:21.263584] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TEN took 0.6s. Estimated remaining: 1m 38s. Rate: 185.2 symbols/min [2025-09-28T02:57:21.275988] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEL took 0.8s. Estimated remaining: 1m 38s. Rate: 185.3 symbols/min [2025-09-28T02:57:21.489542] [DEBUG] [LOCAL ] TEO: Loaded 22345 existing records from primary storage. [2025-09-28T02:57:21.515607] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-28T02:57:21.531448] [INFO ] [MAIN ] TEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:21.570940] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEO took 0.6s. Estimated remaining: 1m 37s. Rate: 185.3 symbols/min [2025-09-28T02:57:21.617261] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:21.746815] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:21.865725] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:21.869598] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-28T02:57:21.942273] [DEBUG] [LOCAL ] TEX: Loaded 45170 existing records from primary storage. [2025-09-28T02:57:21.944063] [INFO ] [MAIN ] TEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:21.944749] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEX took 0.6s. Estimated remaining: 1m 37s. Rate: 185.3 symbols/min [2025-09-28T02:57:21.945890] [DEBUG] [LOCAL ] TEVA: Loaded 54413 existing records from primary storage. [2025-09-28T02:57:21.993382] [INFO ] [MAIN ] TEVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:22.020631] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEVA took 0.8s. Estimated remaining: 1m 37s. Rate: 185.4 symbols/min [2025-09-28T02:57:22.274576] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-09-28T02:57:22.311198] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-28T02:57:22.358937] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:22.359227] [INFO ] [MAIN ] TFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:22.360705] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TFC took 0.7s. Estimated remaining: 1m 36s. Rate: 185.4 symbols/min [2025-09-28T02:57:22.436681] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:22.655300] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:22.655561] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-28T02:57:22.656597] [DEBUG] [LOCAL ] TFIN: Loaded 23896 existing records from primary storage. [2025-09-28T02:57:22.658380] [DEBUG] [LOCAL ] TFII: Loaded 34733 existing records from primary storage. [2025-09-28T02:57:22.659348] [INFO ] [MAIN ] TFII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:22.659725] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFII took 0.7s. Estimated remaining: 1m 36s. Rate: 185.4 symbols/min [2025-09-28T02:57:22.659600] [INFO ] [MAIN ] TFIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:22.666718] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFIN took 0.6s. Estimated remaining: 1m 36s. Rate: 185.5 symbols/min [2025-09-28T02:57:22.660810] [INFO ] [REMOTE ] TBLU: Full fetch complete (1172 records). [2025-09-28T02:57:22.699948] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-28T02:57:23.160977] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:23.207561] [DEBUG] [LOCAL ] TFPM: Loaded 37997 existing records from primary storage. [2025-09-28T02:57:23.227450] [INFO ] [MAIN ] TFPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:23.243607] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:23.255521] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFPM took 0.9s. Estimated remaining: 1m 35s. Rate: 185.4 symbols/min [2025-09-28T02:57:23.294853] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:57:23.331931] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:57:23.349727] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:57:23.363584] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-28T02:57:23.380041] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-28T02:57:23.394212] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-28T02:57:23.398677] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-28T02:57:23.414199] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TBLU took 7.6s. Estimated remaining: 1m 35s. Rate: 185.5 symbols/min [2025-09-28T02:57:23.414024] [DEBUG] [LOCAL ] TG: Loaded 10581 existing records from primary storage. [2025-09-28T02:57:23.456375] [INFO ] [MAIN ] TG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:23.472999] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TG took 0.8s. Estimated remaining: 1m 35s. Rate: 185.5 symbols/min [2025-09-28T02:57:23.506112] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:23.508231] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-28T02:57:23.508351] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-28T02:57:23.509770] [DEBUG] [LOCAL ] TFX: Loaded 37936 existing records from primary storage. [2025-09-28T02:57:23.509873] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-28T02:57:23.510069] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-28T02:57:23.510360] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-28T02:57:23.510212] [INFO ] [MAIN ] TFX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:23.510499] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-28T02:57:23.510932] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TFX took 0.8s. Estimated remaining: 1m 34s. Rate: 185.6 symbols/min [2025-09-28T02:57:23.904944] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:23.905307] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-28T02:57:24.204392] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:57:24.204852] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-28T02:57:24.204972] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:57:24.205094] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-09-28T02:57:24.205187] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:57:24.205327] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-28T02:57:24.205459] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-28T02:57:24.205554] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-28T02:57:24.205709] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-28T02:57:24.205818] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TGE took 0.9s. Estimated remaining: 1m 34s. Rate: 185.5 symbols/min [2025-09-28T02:57:24.856215] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:24.916368] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:24.950594] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:24.974421] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:25.063865] [DEBUG] [LOCAL ] TGLS: Loaded 28709 existing records from primary storage. [2025-09-28T02:57:25.066047] [DEBUG] [LOCAL ] TGS: Loaded 33072 existing records from primary storage. [2025-09-28T02:57:25.066207] [INFO ] [MAIN ] TGLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:25.066444] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGLS took 0.9s. Estimated remaining: 1m 34s. Rate: 185.4 symbols/min [2025-09-28T02:57:25.066527] [INFO ] [MAIN ] TGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:25.074162] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGS took 0.8s. Estimated remaining: 1m 34s. Rate: 185.4 symbols/min [2025-09-28T02:57:25.165352] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-09-28T02:57:25.256678] [DEBUG] [LOCAL ] TGNA: Loaded 49444 existing records from primary storage. [2025-09-28T02:57:25.279015] [INFO ] [MAIN ] TGNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:25.278799] [INFO ] [MAIN ] TGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:25.279629] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 33s. Rate: 185.5 symbols/min [2025-09-28T02:57:25.341238] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 1.1s. Estimated remaining: 1m 33s. Rate: 185.5 symbols/min [2025-09-28T02:57:25.423996] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:25.699467] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:25.768603] [DEBUG] [LOCAL ] THG: Loaded 22081 existing records from primary storage. [2025-09-28T02:57:25.847137] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:25.872277] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:25.872754] [INFO ] [MAIN ] THG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:25.874815] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THG took 0.8s. Estimated remaining: 1m 33s. Rate: 185.5 symbols/min [2025-09-28T02:57:25.913824] [DEBUG] [LOCAL ] THIR: Loaded 2238 existing records from primary storage. [2025-09-28T02:57:25.929395] [INFO ] [MAIN ] THIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:25.916803] [DEBUG] [LOCAL ] THLV: Loaded 1614 existing records from primary storage. [2025-09-28T02:57:25.951254] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THIR took 0.6s. Estimated remaining: 1m 32s. Rate: 185.6 symbols/min [2025-09-28T02:57:25.962029] [INFO ] [MAIN ] THLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:25.994063] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THLV took 0.6s. Estimated remaining: 1m 32s. Rate: 185.6 symbols/min [2025-09-28T02:57:26.358714] [DEBUG] [LOCAL ] THC: Loaded 48617 existing records from primary storage. [2025-09-28T02:57:26.411006] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:26.416580] [INFO ] [MAIN ] THC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:26.465758] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:26.488245] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THC took 1.4s. Estimated remaining: 1m 31s. Rate: 185.6 symbols/min [2025-09-28T02:57:26.524020] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:26.768779] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:26.770003] [DEBUG] [LOCAL ] THR: Loaded 20218 existing records from primary storage. [2025-09-28T02:57:26.772894] [INFO ] [MAIN ] THR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:26.786178] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THR took 0.7s. Estimated remaining: 1m 31s. Rate: 185.6 symbols/min [2025-09-28T02:57:26.773390] [DEBUG] [LOCAL ] THQ: Loaded 24879 existing records from primary storage. [2025-09-28T02:57:26.809498] [DEBUG] [LOCAL ] THO: Loaded 42957 existing records from primary storage. [2025-09-28T02:57:26.824784] [INFO ] [MAIN ] THQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:26.824431] [INFO ] [MAIN ] THO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:26.830880] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THQ took 0.9s. Estimated remaining: 1m 31s. Rate: 185.7 symbols/min [2025-09-28T02:57:26.842290] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. THO took 1.0s. Estimated remaining: 1m 30s. Rate: 185.8 symbols/min [2025-09-28T02:57:27.279785] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:27.364425] [DEBUG] [LOCAL ] THS: Loaded 38565 existing records from primary storage. [2025-09-28T02:57:27.361539] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:27.386881] [INFO ] [MAIN ] THS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:27.388157] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:27.387064] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-28T02:57:27.388254] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. THS took 0.9s. Estimated remaining: 1m 30s. Rate: 185.7 symbols/min [2025-09-28T02:57:27.395076] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-28T02:57:27.395461] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-28T02:57:27.415501] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-28T02:57:27.442621] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-28T02:57:27.493983] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-28T02:57:27.622013] [DEBUG] [LOCAL ] THW: Loaded 19392 existing records from primary storage. [2025-09-28T02:57:27.764715] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:27.688224] [INFO ] [MAIN ] THW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:27.785794] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THW took 1.0s. Estimated remaining: 1m 30s. Rate: 185.7 symbols/min [2025-09-28T02:57:27.802031] [DEBUG] [LOCAL ] TIMB: Loaded 36983 existing records from primary storage. [2025-09-28T02:57:27.828778] [INFO ] [MAIN ] TIMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:27.908911] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. TIMB took 1.0s. Estimated remaining: 1m 29s. Rate: 185.7 symbols/min [2025-09-28T02:57:27.992034] [DEBUG] [LOCAL ] TISI: Loaded 3805 existing records from primary storage. [2025-09-28T02:57:28.115887] [INFO ] [MAIN ] TISI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:28.156024] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TISI took 0.8s. Estimated remaining: 1m 29s. Rate: 185.8 symbols/min [2025-09-28T02:57:28.317682] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:28.512899] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:28.564600] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-28T02:57:28.564304] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:28.639676] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:28.655272] [DEBUG] [LOCAL ] TIXT: Loaded 31824 existing records from primary storage. [2025-09-28T02:57:28.656100] [INFO ] [MAIN ] TIXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:28.656245] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TIXT took 0.8s. Estimated remaining: 1m 29s. Rate: 185.7 symbols/min [2025-09-28T02:57:28.779504] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:57:28.803520] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-28T02:57:28.893097] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:28.893263] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:57:28.857858] [DEBUG] [LOCAL ] TK: Loaded 40151 existing records from primary storage. [2025-09-28T02:57:28.893994] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-09-28T02:57:28.911132] [INFO ] [MAIN ] TK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:28.910864] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:57:28.911277] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TK took 0.7s. Estimated remaining: 1m 29s. Rate: 185.7 symbols/min [2025-09-28T02:57:28.911359] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-28T02:57:28.933636] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-28T02:57:28.948485] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-28T02:57:28.980942] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-28T02:57:28.992037] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TIC took 2.2s. Estimated remaining: 1m 28s. Rate: 185.8 symbols/min [2025-09-28T02:57:29.098615] [DEBUG] [LOCAL ] TJX: Loaded 54449 existing records from primary storage. [2025-09-28T02:57:29.217634] [INFO ] [MAIN ] TJX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:29.242079] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:29.257969] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TJX took 1.3s. Estimated remaining: 1m 28s. Rate: 185.8 symbols/min [2025-09-28T02:57:29.317321] [DEBUG] [LOCAL ] TKC: Loaded 39062 existing records from primary storage. [2025-09-28T02:57:29.340741] [INFO ] [MAIN ] TKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:29.376222] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:29.376400] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TKC took 0.7s. Estimated remaining: 1m 27s. Rate: 185.9 symbols/min [2025-09-28T02:57:29.668998] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:29.755403] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:29.758082] [DEBUG] [LOCAL ] TKO: Loaded 44814 existing records from primary storage. [2025-09-28T02:57:29.758941] [INFO ] [MAIN ] TKO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:29.759046] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKO took 0.8s. Estimated remaining: 1m 27s. Rate: 185.8 symbols/min [2025-09-28T02:57:29.899004] [DEBUG] [LOCAL ] TKR: Loaded 40832 existing records from primary storage. [2025-09-28T02:57:29.901321] [INFO ] [MAIN ] TKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:29.919078] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKR took 0.9s. Estimated remaining: 1m 27s. Rate: 185.9 symbols/min [2025-09-28T02:57:29.965887] [DEBUG] [LOCAL ] TLYS: Loaded 17064 existing records from primary storage. [2025-09-28T02:57:30.032272] [INFO ] [MAIN ] TLYS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:30.047960] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLYS took 0.7s. Estimated remaining: 1m 26s. Rate: 185.9 symbols/min [2025-09-28T02:57:30.021453] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:30.142320] [DEBUG] [LOCAL ] TLK: Loaded 39925 existing records from primary storage. [2025-09-28T02:57:30.222185] [INFO ] [MAIN ] TLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:30.276685] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TLK took 1.0s. Estimated remaining: 1m 26s. Rate: 186.0 symbols/min [2025-09-28T02:57:30.377007] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:30.556963] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:30.551945] [DEBUG] [LOCAL ] TM: Loaded 36992 existing records from primary storage. [2025-09-28T02:57:30.557949] [INFO ] [MAIN ] TM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:30.568980] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TM took 0.8s. Estimated remaining: 1m 26s. Rate: 186.0 symbols/min [2025-09-28T02:57:30.649323] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:30.855688] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:30.876922] [DEBUG] [LOCAL ] TME: Loaded 53979 existing records from primary storage. [2025-09-28T02:57:30.889971] [INFO ] [MAIN ] TME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:30.891736] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TME took 0.9s. Estimated remaining: 1m 25s. Rate: 186.0 symbols/min [2025-09-28T02:57:30.892714] [DEBUG] [LOCAL ] TMHC: Loaded 46274 existing records from primary storage. [2025-09-28T02:57:30.898359] [INFO ] [MAIN ] TMHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:30.909967] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TMHC took 0.9s. Estimated remaining: 1m 25s. Rate: 186.1 symbols/min [2025-09-28T02:57:31.012807] [DEBUG] [LOCAL ] TNC: Loaded 15334 existing records from primary storage. [2025-09-28T02:57:31.066405] [INFO ] [MAIN ] TNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:31.079463] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TNC took 0.5s. Estimated remaining: 1m 25s. Rate: 186.1 symbols/min [2025-09-28T02:57:31.294361] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:31.348301] [DEBUG] [LOCAL ] TMO: Loaded 53089 existing records from primary storage. [2025-09-28T02:57:31.415782] [INFO ] [MAIN ] TMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:31.453195] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:31.480797] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TMO took 1.2s. Estimated remaining: 1m 24s. Rate: 186.1 symbols/min [2025-09-28T02:57:31.509792] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:31.515376] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-28T02:57:31.515632] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-28T02:57:31.552387] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-28T02:57:31.602228] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-28T02:57:31.647902] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-28T02:57:31.654511] [DEBUG] [LOCAL ] TNET: Loaded 29247 existing records from primary storage. [2025-09-28T02:57:31.676538] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-28T02:57:31.693157] [INFO ] [MAIN ] TNET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:31.779467] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNET took 0.9s. Estimated remaining: 1m 24s. Rate: 186.1 symbols/min [2025-09-28T02:57:31.824129] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:32.058362] [DEBUG] [LOCAL ] TNK: Loaded 35701 existing records from primary storage. [2025-09-28T02:57:32.127117] [INFO ] [MAIN ] TNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:32.228994] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:32.194798] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNK took 1.1s. Estimated remaining: 1m 24s. Rate: 186.1 symbols/min [2025-09-28T02:57:32.487719] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:32.491972] [DEBUG] [LOCAL ] TNL: Loaded 42474 existing records from primary storage. [2025-09-28T02:57:32.494184] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-28T02:57:32.517493] [INFO ] [MAIN ] TNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:32.572493] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNL took 1.1s. Estimated remaining: 1m 24s. Rate: 186.0 symbols/min [2025-09-28T02:57:32.571816] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:32.698942] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:57:32.720257] [DEBUG] [LOCAL ] TOL: Loaded 51738 existing records from primary storage. [2025-09-28T02:57:32.719088] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-28T02:57:32.746554] [INFO ] [MAIN ] TOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:32.761945] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:57:32.776172] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TOL took 0.9s. Estimated remaining: 1m 23s. Rate: 186.1 symbols/min [2025-09-28T02:57:32.776007] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-09-28T02:57:32.798387] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:57:32.810248] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-28T02:57:32.822140] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-28T02:57:32.846346] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-28T02:57:32.867029] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:32.890364] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-28T02:57:32.907471] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TNGY took 1.9s. Estimated remaining: 1m 23s. Rate: 186.1 symbols/min [2025-09-28T02:57:33.100022] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:33.174302] [DEBUG] [LOCAL ] TPB: Loaded 25409 existing records from primary storage. [2025-09-28T02:57:33.173697] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-09-28T02:57:33.212810] [INFO ] [MAIN ] TOST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:33.211742] [INFO ] [MAIN ] TPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:33.233073] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:33.233457] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TOST took 1.0s. Estimated remaining: 1m 23s. Rate: 186.1 symbols/min [2025-09-28T02:57:33.239713] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TPB took 0.7s. Estimated remaining: 1m 22s. Rate: 186.2 symbols/min [2025-09-28T02:57:33.528394] [DEBUG] [LOCAL ] TPC: Loaded 39311 existing records from primary storage. [2025-09-28T02:57:33.658024] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:33.631337] [INFO ] [MAIN ] TPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:33.652634] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:33.659810] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPC took 0.9s. Estimated remaining: 1m 22s. Rate: 186.2 symbols/min [2025-09-28T02:57:33.676291] [DEBUG] [LOCAL ] TPH: Loaded 45821 existing records from primary storage. [2025-09-28T02:57:33.676771] [INFO ] [MAIN ] TPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:33.676874] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPH took 0.8s. Estimated remaining: 1m 21s. Rate: 186.3 symbols/min [2025-09-28T02:57:33.689182] [DEBUG] [LOCAL ] TPL: Loaded 12533 existing records from primary storage. [2025-09-28T02:57:33.689515] [INFO ] [MAIN ] TPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:33.689640] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPL took 0.5s. Estimated remaining: 1m 21s. Rate: 186.4 symbols/min [2025-09-28T02:57:33.737370] [DEBUG] [LOCAL ] TPR: Loaded 54252 existing records from primary storage. [2025-09-28T02:57:33.737791] [INFO ] [MAIN ] TPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:33.737893] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 0.5s. Estimated remaining: 1m 21s. Rate: 186.4 symbols/min [2025-09-28T02:57:34.335282] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:34.459413] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:34.479776] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:34.484533] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:34.498125] [DEBUG] [LOCAL ] TPZ: Loaded 5095 existing records from primary storage. [2025-09-28T02:57:34.498702] [INFO ] [MAIN ] TPZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:34.498835] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPZ took 0.7s. Estimated remaining: 1m 21s. Rate: 186.3 symbols/min [2025-09-28T02:57:34.529941] [DEBUG] [LOCAL ] TPYP: Loaded 8039 existing records from primary storage. [2025-09-28T02:57:34.530336] [INFO ] [MAIN ] TPYP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:34.530468] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TPYP took 0.8s. Estimated remaining: 1m 20s. Rate: 186.4 symbols/min [2025-09-28T02:57:34.677367] [DEBUG] [LOCAL ] TR: Loaded 18494 existing records from primary storage. [2025-09-28T02:57:34.746559] [DEBUG] [LOCAL ] TPVG: Loaded 27400 existing records from primary storage. [2025-09-28T02:57:34.740608] [INFO ] [MAIN ] TR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:34.761513] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TR took 1.0s. Estimated remaining: 1m 20s. Rate: 186.4 symbols/min [2025-09-28T02:57:34.767229] [INFO ] [MAIN ] TPVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:34.848997] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 19s. Rate: 186.5 symbols/min [2025-09-28T02:57:34.975822] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:35.065268] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:35.246618] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:35.244896] [DEBUG] [LOCAL ] TRAK: Loaded 9383 existing records from primary storage. [2025-09-28T02:57:35.299422] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:35.302341] [DEBUG] [LOCAL ] TRC: Loaded 16189 existing records from primary storage. [2025-09-28T02:57:35.303003] [INFO ] [MAIN ] TRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:35.299634] [INFO ] [MAIN ] TRAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:35.303162] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRC took 0.8s. Estimated remaining: 1m 19s. Rate: 186.4 symbols/min [2025-09-28T02:57:35.309241] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRAK took 0.8s. Estimated remaining: 1m 19s. Rate: 186.5 symbols/min [2025-09-28T02:57:35.790836] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:35.789140] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:35.792932] [DEBUG] [LOCAL ] TREX: Loaded 50733 existing records from primary storage. [2025-09-28T02:57:35.809772] [INFO ] [MAIN ] TREX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:35.810767] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TREX took 1.0s. Estimated remaining: 1m 19s. Rate: 186.5 symbols/min [2025-09-28T02:57:35.823372] [DEBUG] [LOCAL ] TRGP: Loaded 51504 existing records from primary storage. [2025-09-28T02:57:35.840095] [INFO ] [MAIN ] TRGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:35.862166] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRGP took 1.0s. Estimated remaining: 1m 18s. Rate: 186.6 symbols/min [2025-09-28T02:57:36.097292] [DEBUG] [LOCAL ] TRN: Loaded 37786 existing records from primary storage. [2025-09-28T02:57:36.194723] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:36.156060] [INFO ] [MAIN ] TRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:36.233919] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:36.234506] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRN took 0.9s. Estimated remaining: 1m 18s. Rate: 186.5 symbols/min [2025-09-28T02:57:36.252730] [DEBUG] [LOCAL ] TRNO: Loaded 44598 existing records from primary storage. [2025-09-28T02:57:36.299789] [INFO ] [MAIN ] TRNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:36.300062] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRNO took 1.0s. Estimated remaining: 1m 17s. Rate: 186.6 symbols/min [2025-09-28T02:57:36.696335] [DEBUG] [LOCAL ] TROX: Loaded 52550 existing records from primary storage. [2025-09-28T02:57:36.734157] [INFO ] [MAIN ] TROX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:36.746916] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TROX took 0.9s. Estimated remaining: 1m 17s. Rate: 186.6 symbols/min [2025-09-28T02:57:36.780712] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:36.746234] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:36.784321] [DEBUG] [LOCAL ] TRP: Loaded 52891 existing records from primary storage. [2025-09-28T02:57:36.785248] [INFO ] [MAIN ] TRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:36.785613] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TRP took 0.9s. Estimated remaining: 1m 17s. Rate: 186.7 symbols/min [2025-09-28T02:57:37.131130] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:37.212188] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:37.208120] [DEBUG] [LOCAL ] TRTX: Loaded 38058 existing records from primary storage. [2025-09-28T02:57:37.216325] [INFO ] [MAIN ] TRTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:37.216591] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRTX took 1.0s. Estimated remaining: 1m 17s. Rate: 186.6 symbols/min [2025-09-28T02:57:37.232525] [DEBUG] [LOCAL ] TRU: Loaded 51965 existing records from primary storage. [2025-09-28T02:57:37.272732] [INFO ] [MAIN ] TRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:37.272909] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 1.0s. Estimated remaining: 1m 16s. Rate: 186.7 symbols/min [2025-09-28T02:57:37.574891] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:37.658906] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:37.665679] [DEBUG] [LOCAL ] TS: Loaded 52425 existing records from primary storage. [2025-09-28T02:57:37.674017] [INFO ] [MAIN ] TS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:37.674475] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TS took 0.9s. Estimated remaining: 1m 16s. Rate: 186.7 symbols/min [2025-09-28T02:57:37.717594] [DEBUG] [LOCAL ] TRV: Loaded 48744 existing records from primary storage. [2025-09-28T02:57:37.718594] [INFO ] [MAIN ] TRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:37.718275] [DEBUG] [LOCAL ] TSI: Loaded 8090 existing records from primary storage. [2025-09-28T02:57:37.795417] [INFO ] [MAIN ] TSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:37.795564] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TRV took 1.0s. Estimated remaining: 1m 16s. Rate: 186.7 symbols/min [2025-09-28T02:57:37.823612] [DEBUG] [LOCAL ] TSE: Loaded 29074 existing records from primary storage. [2025-09-28T02:57:37.835163] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TSI took 0.6s. Estimated remaining: 1m 15s. Rate: 186.8 symbols/min [2025-09-28T02:57:37.841394] [INFO ] [MAIN ] TSE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:37.887904] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TSE took 0.7s. Estimated remaining: 1m 15s. Rate: 186.9 symbols/min [2025-09-28T02:57:37.975813] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:38.316181] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:38.467572] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:38.486751] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:38.500957] [DEBUG] [LOCAL ] TSLX: Loaded 35752 existing records from primary storage. [2025-09-28T02:57:38.501684] [INFO ] [MAIN ] TSLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:38.502908] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSLX took 0.8s. Estimated remaining: 1m 15s. Rate: 186.8 symbols/min [2025-09-28T02:57:38.629304] [DEBUG] [LOCAL ] TSQ: Loaded 12195 existing records from primary storage. [2025-09-28T02:57:38.630771] [INFO ] [MAIN ] TSQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:38.673335] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSQ took 0.7s. Estimated remaining: 1m 14s. Rate: 186.8 symbols/min [2025-09-28T02:57:38.762889] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:38.862440] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-09-28T02:57:38.895875] [INFO ] [MAIN ] TSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:38.907863] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TSM took 1.1s. Estimated remaining: 1m 14s. Rate: 186.9 symbols/min [2025-09-28T02:57:38.919690] [DEBUG] [LOCAL ] TSN: Loaded 53638 existing records from primary storage. [2025-09-28T02:57:39.014690] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:39.001514] [INFO ] [MAIN ] TSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:39.020551] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-28T02:57:39.020803] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-28T02:57:39.060231] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-28T02:57:39.060464] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-28T02:57:39.020681] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSN took 1.1s. Estimated remaining: 1m 14s. Rate: 186.9 symbols/min [2025-09-28T02:57:39.081728] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-28T02:57:39.180627] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-28T02:57:39.326783] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:39.328460] [DEBUG] [LOCAL ] TT: Loaded 48538 existing records from primary storage. [2025-09-28T02:57:39.398775] [INFO ] [MAIN ] TT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:39.426987] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TT took 0.9s. Estimated remaining: 1m 13s. Rate: 186.9 symbols/min [2025-09-28T02:57:39.651416] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:39.913270] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:39.971964] [DEBUG] [LOCAL ] TTC: Loaded 43005 existing records from primary storage. [2025-09-28T02:57:40.006086] [INFO ] [MAIN ] TTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:40.011475] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TTC took 1.1s. Estimated remaining: 1m 13s. Rate: 186.8 symbols/min [2025-09-28T02:57:40.123008] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:40.210325] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-28T02:57:40.211977] [DEBUG] [LOCAL ] TTE: Loaded 52395 existing records from primary storage. [2025-09-28T02:57:40.224886] [INFO ] [MAIN ] TTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:40.230284] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTE took 1.2s. Estimated remaining: 1m 13s. Rate: 186.9 symbols/min [2025-09-28T02:57:40.323091] [DEBUG] [LOCAL ] TTI: Loaded 46112 existing records from primary storage. [2025-09-28T02:57:40.363379] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:40.381511] [INFO ] [MAIN ] TTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:40.381271] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:57:40.398600] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-28T02:57:40.424014] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTI took 1.0s. Estimated remaining: 1m 12s. Rate: 186.9 symbols/min [2025-09-28T02:57:40.422889] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:57:40.440083] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-09-28T02:57:40.456746] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:57:40.533698] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-28T02:57:40.581999] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:40.621135] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-28T02:57:40.632256] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-28T02:57:40.683618] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-28T02:57:40.712773] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTAM took 2.0s. Estimated remaining: 1m 12s. Rate: 186.9 symbols/min [2025-09-28T02:57:40.713907] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:40.817706] [DEBUG] [LOCAL ] TU: Loaded 50606 existing records from primary storage. [2025-09-28T02:57:40.845245] [INFO ] [MAIN ] TU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:40.880092] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TU took 0.8s. Estimated remaining: 1m 12s. Rate: 186.9 symbols/min [2025-09-28T02:57:40.985814] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:41.041612] [DEBUG] [LOCAL ] TUYA: Loaded 47185 existing records from primary storage. [2025-09-28T02:57:41.103879] [INFO ] [MAIN ] TUYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:41.104287] [DEBUG] [LOCAL ] TVC: Loaded 3466 existing records from primary storage. [2025-09-28T02:57:41.105395] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TUYA took 0.9s. Estimated remaining: 1m 11s. Rate: 187.0 symbols/min [2025-09-28T02:57:41.106446] [DEBUG] [LOCAL ] TV: Loaded 43514 existing records from primary storage. [2025-09-28T02:57:41.107346] [INFO ] [MAIN ] TV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:41.106800] [INFO ] [MAIN ] TVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:41.107611] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TV took 0.7s. Estimated remaining: 1m 11s. Rate: 187.0 symbols/min [2025-09-28T02:57:41.210461] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TVC took 0.4s. Estimated remaining: 1m 11s. Rate: 187.1 symbols/min [2025-09-28T02:57:41.332250] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:41.613756] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:41.616102] [DEBUG] [LOCAL ] TVE: Loaded 2795 existing records from primary storage. [2025-09-28T02:57:41.662560] [INFO ] [MAIN ] TVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:41.683385] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TVE took 0.8s. Estimated remaining: 1m 10s. Rate: 187.1 symbols/min [2025-09-28T02:57:41.712530] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:41.790929] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:41.929010] [DEBUG] [LOCAL ] TWN: Loaded 3250 existing records from primary storage. [2025-09-28T02:57:41.937311] [INFO ] [MAIN ] TWN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:41.971758] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:41.973326] [DEBUG] [LOCAL ] TWI: Loaded 34981 existing records from primary storage. [2025-09-28T02:57:41.971946] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWN took 0.7s. Estimated remaining: 1m 10s. Rate: 187.1 symbols/min [2025-09-28T02:57:41.974173] [INFO ] [MAIN ] TWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:41.974435] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWI took 0.9s. Estimated remaining: 1m 10s. Rate: 187.2 symbols/min [2025-09-28T02:57:42.313996] [DEBUG] [LOCAL ] TWLO: Loaded 53501 existing records from primary storage. [2025-09-28T02:57:42.355587] [INFO ] [MAIN ] TWLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:42.438721] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:42.442511] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:42.442684] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWLO took 1.3s. Estimated remaining: 1m 9s. Rate: 187.1 symbols/min [2025-09-28T02:57:42.443864] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-28T02:57:42.449975] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-28T02:57:42.466504] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-28T02:57:42.466668] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-28T02:57:42.493430] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-28T02:57:42.518243] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-28T02:57:42.630113] [DEBUG] [LOCAL ] TWO: Loaded 49002 existing records from primary storage. [2025-09-28T02:57:42.708802] [INFO ] [MAIN ] TWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:42.717288] [DEBUG] [LOCAL ] TX: Loaded 23932 existing records from primary storage. [2025-09-28T02:57:42.737814] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWO took 1.0s. Estimated remaining: 1m 9s. Rate: 187.1 symbols/min [2025-09-28T02:57:42.738906] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:42.766047] [INFO ] [MAIN ] TX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:42.837370] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TX took 0.9s. Estimated remaining: 1m 9s. Rate: 187.2 symbols/min [2025-09-28T02:57:43.145274] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:43.298607] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:43.300739] [DEBUG] [LOCAL ] TXNM: Loaded 44463 existing records from primary storage. [2025-09-28T02:57:43.305407] [INFO ] [MAIN ] TXNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:43.307029] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TXNM took 0.9s. Estimated remaining: 1m 8s. Rate: 187.1 symbols/min [2025-09-28T02:57:43.305262] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-28T02:57:43.319189] [DEBUG] [LOCAL ] TXO: Loaded 19060 existing records from primary storage. [2025-09-28T02:57:43.319548] [INFO ] [MAIN ] TXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:43.319702] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TXO took 0.6s. Estimated remaining: 1m 8s. Rate: 187.2 symbols/min [2025-09-28T02:57:43.457299] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:57:43.457847] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-28T02:57:43.457965] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:57:43.458079] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-09-28T02:57:43.458180] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:57:43.458285] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-28T02:57:43.458438] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-28T02:57:43.458535] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-28T02:57:43.458731] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-28T02:57:43.458842] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TWOD took 1.5s. Estimated remaining: 1m 8s. Rate: 187.3 symbols/min [2025-09-28T02:57:44.300263] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:44.346545] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:44.387768] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:44.499436] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:44.529025] [DEBUG] [LOCAL ] TYL: Loaded 22582 existing records from primary storage. [2025-09-28T02:57:44.528039] [DEBUG] [LOCAL ] TYG: Loaded 14410 existing records from primary storage. [2025-09-28T02:57:44.529788] [INFO ] [MAIN ] TYG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:44.529880] [INFO ] [MAIN ] TYL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:44.530171] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TYG took 1.1s. Estimated remaining: 1m 7s. Rate: 187.1 symbols/min [2025-09-28T02:57:44.530464] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYL took 1.1s. Estimated remaining: 1m 7s. Rate: 187.2 symbols/min [2025-09-28T02:57:44.592985] [DEBUG] [LOCAL ] TY: Loaded 7756 existing records from primary storage. [2025-09-28T02:57:44.689372] [INFO ] [MAIN ] TY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:44.781713] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TY took 1.3s. Estimated remaining: 1m 7s. Rate: 187.2 symbols/min [2025-09-28T02:57:44.788259] [DEBUG] [LOCAL ] TXT: Loaded 50470 existing records from primary storage. [2025-09-28T02:57:44.911787] [INFO ] [MAIN ] TXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:45.039759] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TXT took 1.6s. Estimated remaining: 1m 6s. Rate: 187.2 symbols/min [2025-09-28T02:57:45.021108] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:45.073066] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:45.180793] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:45.340067] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:45.400009] [DEBUG] [LOCAL ] UAN: Loaded 5507 existing records from primary storage. [2025-09-28T02:57:45.400694] [INFO ] [MAIN ] UAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:45.400973] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. UAN took 0.3s. Estimated remaining: 1m 6s. Rate: 187.2 symbols/min [2025-09-28T02:57:45.445505] [DEBUG] [LOCAL ] UA: Loaded 51189 existing records from primary storage. [2025-09-28T02:57:45.521745] [INFO ] [MAIN ] UA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:45.543837] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-09-28T02:57:45.549192] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. UA took 1.0s. Estimated remaining: 1m 6s. Rate: 187.2 symbols/min [2025-09-28T02:57:45.565092] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-09-28T02:57:45.586807] [INFO ] [MAIN ] UAA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:45.570013] [INFO ] [MAIN ] U: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:45.606867] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. U took 1.1s. Estimated remaining: 1m 5s. Rate: 187.3 symbols/min [2025-09-28T02:57:45.739384] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UAA took 0.8s. Estimated remaining: 1m 5s. Rate: 187.4 symbols/min [2025-09-28T02:57:45.750820] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:45.984318] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:46.234276] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:46.245220] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:46.289535] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-09-28T02:57:46.290243] [INFO ] [MAIN ] UBER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:46.290414] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UBER took 0.9s. Estimated remaining: 1m 5s. Rate: 187.3 symbols/min [2025-09-28T02:57:46.456321] [DEBUG] [LOCAL ] UBS: Loaded 53187 existing records from primary storage. [2025-09-28T02:57:46.489297] [INFO ] [MAIN ] UBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:46.530467] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UBS took 1.0s. Estimated remaining: 1m 4s. Rate: 187.3 symbols/min [2025-09-28T02:57:46.554774] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:46.645483] [DEBUG] [LOCAL ] UCB: Loaded 38555 existing records from primary storage. [2025-09-28T02:57:46.679258] [DEBUG] [LOCAL ] UDR: Loaded 52555 existing records from primary storage. [2025-09-28T02:57:46.661829] [INFO ] [MAIN ] UCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:46.705003] [INFO ] [MAIN ] UDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:46.705502] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UCB took 1.0s. Estimated remaining: 1m 4s. Rate: 187.4 symbols/min [2025-09-28T02:57:46.733802] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UDR took 0.9s. Estimated remaining: 1m 4s. Rate: 187.4 symbols/min [2025-09-28T02:57:46.868853] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:47.047212] [DEBUG] [LOCAL ] UFI: Loaded 8229 existing records from primary storage. [2025-09-28T02:57:47.099076] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:47.117203] [INFO ] [MAIN ] UFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:47.176016] [DEBUG] [LOCAL ] UE: Loaded 43513 existing records from primary storage. [2025-09-28T02:57:47.139873] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UFI took 0.6s. Estimated remaining: 1m 3s. Rate: 187.4 symbols/min [2025-09-28T02:57:47.203894] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:47.204022] [INFO ] [MAIN ] UE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:47.242486] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UE took 1.0s. Estimated remaining: 1m 3s. Rate: 187.5 symbols/min [2025-09-28T02:57:47.579710] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:47.664277] [DEBUG] [LOCAL ] UGP: Loaded 43319 existing records from primary storage. [2025-09-28T02:57:47.649071] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:47.667214] [DEBUG] [LOCAL ] UGI: Loaded 51290 existing records from primary storage. [2025-09-28T02:57:47.667485] [INFO ] [MAIN ] UGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:47.667916] [INFO ] [MAIN ] UGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:47.668026] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UGP took 0.9s. Estimated remaining: 1m 3s. Rate: 187.4 symbols/min [2025-09-28T02:57:47.674295] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UGI took 0.9s. Estimated remaining: 1m 2s. Rate: 187.5 symbols/min [2025-09-28T02:57:47.821446] [DEBUG] [LOCAL ] UHAL: Loaded 16817 existing records from primary storage. [2025-09-28T02:57:47.876433] [INFO ] [MAIN ] UHAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:47.889826] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UHAL took 0.7s. Estimated remaining: 1m 2s. Rate: 187.6 symbols/min [2025-09-28T02:57:48.153960] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:48.211446] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:48.212819] [DEBUG] [LOCAL ] UHS: Loaded 41674 existing records from primary storage. [2025-09-28T02:57:48.289388] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:48.285035] [INFO ] [MAIN ] UHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:48.294163] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHS took 1.0s. Estimated remaining: 1m 2s. Rate: 187.5 symbols/min [2025-09-28T02:57:48.341092] [DEBUG] [LOCAL ] UHT: Loaded 10131 existing records from primary storage. [2025-09-28T02:57:48.377483] [DEBUG] [LOCAL ] UI: Loaded 13008 existing records from primary storage. [2025-09-28T02:57:48.389537] [INFO ] [MAIN ] UHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:48.422125] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHT took 0.8s. Estimated remaining: 1m 1s. Rate: 187.6 symbols/min [2025-09-28T02:57:48.445103] [INFO ] [MAIN ] UI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:48.487978] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UI took 0.8s. Estimated remaining: 1m 1s. Rate: 187.6 symbols/min [2025-09-28T02:57:48.620442] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:48.743211] [DEBUG] [LOCAL ] UIS: Loaded 37552 existing records from primary storage. [2025-09-28T02:57:48.785981] [INFO ] [MAIN ] UIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:48.835312] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 0.9s. Estimated remaining: 1m 1s. Rate: 187.6 symbols/min [2025-09-28T02:57:48.888695] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:48.995876] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:49.156948] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:49.158960] [DEBUG] [LOCAL ] UL: Loaded 53843 existing records from primary storage. [2025-09-28T02:57:49.160057] [INFO ] [MAIN ] UL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:49.160203] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. UL took 0.9s. Estimated remaining: 1m 0s. Rate: 187.6 symbols/min [2025-09-28T02:57:49.323099] [DEBUG] [LOCAL ] ULS: Loaded 39769 existing records from primary storage. [2025-09-28T02:57:49.353718] [INFO ] [MAIN ] ULS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:49.380730] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:49.354202] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. ULS took 0.9s. Estimated remaining: 1m 0s. Rate: 187.7 symbols/min [2025-09-28T02:57:49.523058] [DEBUG] [LOCAL ] UMC: Loaded 53490 existing records from primary storage. [2025-09-28T02:57:49.529057] [DEBUG] [LOCAL ] UMH: Loaded 34078 existing records from primary storage. [2025-09-28T02:57:49.554513] [INFO ] [MAIN ] UMH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:49.557846] [INFO ] [MAIN ] UMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:49.558169] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMH took 0.7s. Estimated remaining: 59.8s. Rate: 187.7 symbols/min [2025-09-28T02:57:49.625799] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UMC took 1.1s. Estimated remaining: 59.4s. Rate: 187.8 symbols/min [2025-09-28T02:57:49.626627] [DEBUG] [LOCAL ] UNF: Loaded 12048 existing records from primary storage. [2025-09-28T02:57:49.703226] [INFO ] [MAIN ] UNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:49.724264] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:49.717438] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UNF took 0.6s. Estimated remaining: 59.1s. Rate: 187.8 symbols/min [2025-09-28T02:57:50.186244] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:50.204907] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:50.277258] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:50.272383] [DEBUG] [LOCAL ] UNFI: Loaded 42528 existing records from primary storage. [2025-09-28T02:57:50.278171] [INFO ] [MAIN ] UNFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:50.278823] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNFI took 0.9s. Estimated remaining: 58.8s. Rate: 187.8 symbols/min [2025-09-28T02:57:50.369355] [DEBUG] [LOCAL ] UNMA: Loaded 3627 existing records from primary storage. [2025-09-28T02:57:50.386917] [INFO ] [MAIN ] UNMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:50.399697] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNMA took 0.6s. Estimated remaining: 58.5s. Rate: 187.8 symbols/min [2025-09-28T02:57:50.595576] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:50.653412] [DEBUG] [LOCAL ] UNH: Loaded 54574 existing records from primary storage. [2025-09-28T02:57:50.656042] [INFO ] [MAIN ] UNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:50.738125] [DEBUG] [LOCAL ] UNM: Loaded 49368 existing records from primary storage. [2025-09-28T02:57:50.751907] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNH took 1.2s. Estimated remaining: 58.1s. Rate: 187.8 symbols/min [2025-09-28T02:57:50.787031] [INFO ] [MAIN ] UNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:50.791733] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:50.792564] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNM took 1.1s. Estimated remaining: 57.8s. Rate: 187.9 symbols/min [2025-09-28T02:57:51.172139] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:51.239762] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:51.258680] [DEBUG] [LOCAL ] UP: Loaded 43857 existing records from primary storage. [2025-09-28T02:57:51.259345] [INFO ] [MAIN ] UP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:51.261546] [DEBUG] [LOCAL ] UNP: Loaded 54030 existing records from primary storage. [2025-09-28T02:57:51.262127] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UP took 0.9s. Estimated remaining: 57.5s. Rate: 187.8 symbols/min [2025-09-28T02:57:51.262813] [INFO ] [MAIN ] UNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:51.286878] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. UNP took 1.0s. Estimated remaining: 57.1s. Rate: 187.9 symbols/min [2025-09-28T02:57:51.657887] [DEBUG] [LOCAL ] URI: Loaded 36669 existing records from primary storage. [2025-09-28T02:57:51.670347] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:51.678751] [INFO ] [MAIN ] URI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:51.702362] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:51.697235] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. URI took 0.9s. Estimated remaining: 56.8s. Rate: 187.9 symbols/min [2025-09-28T02:57:51.815605] [DEBUG] [LOCAL ] UPS: Loaded 54490 existing records from primary storage. [2025-09-28T02:57:51.843835] [INFO ] [MAIN ] UPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:51.844232] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. UPS took 1.1s. Estimated remaining: 56.5s. Rate: 187.9 symbols/min [2025-09-28T02:57:51.983726] [DEBUG] [LOCAL ] USAC: Loaded 23060 existing records from primary storage. [2025-09-28T02:57:51.982854] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:52.014746] [INFO ] [MAIN ] USAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:52.035853] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. USAC took 0.7s. Estimated remaining: 56.2s. Rate: 188.0 symbols/min [2025-09-28T02:57:52.111307] [DEBUG] [LOCAL ] USA: Loaded 36524 existing records from primary storage. [2025-09-28T02:57:52.192241] [INFO ] [MAIN ] USA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:52.216191] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USA took 1.0s. Estimated remaining: 55.8s. Rate: 188.0 symbols/min [2025-09-28T02:57:52.241241] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:52.487081] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:52.551236] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:52.570394] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-09-28T02:57:52.571550] [INFO ] [MAIN ] USB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:52.571706] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USB took 0.9s. Estimated remaining: 55.5s. Rate: 188.0 symbols/min [2025-09-28T02:57:52.620753] [DEBUG] [LOCAL ] USFD: Loaded 51959 existing records from primary storage. [2025-09-28T02:57:52.621368] [INFO ] [MAIN ] USFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:52.622574] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USFD took 0.8s. Estimated remaining: 55.2s. Rate: 188.1 symbols/min [2025-09-28T02:57:52.636784] [DEBUG] [LOCAL ] USNA: Loaded 18368 existing records from primary storage. [2025-09-28T02:57:52.637620] [DEBUG] [LOCAL ] USPH: Loaded 16827 existing records from primary storage. [2025-09-28T02:57:52.637212] [INFO ] [MAIN ] USNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:52.637939] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USNA took 0.6s. Estimated remaining: 54.8s. Rate: 188.2 symbols/min [2025-09-28T02:57:52.638044] [INFO ] [MAIN ] USPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:52.638364] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USPH took 0.4s. Estimated remaining: 54.5s. Rate: 188.3 symbols/min [2025-09-28T02:57:53.261186] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:53.366265] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:53.385373] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:53.313035] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:53.403493] [DEBUG] [LOCAL ] UTL: Loaded 11273 existing records from primary storage. [2025-09-28T02:57:53.404078] [INFO ] [MAIN ] UTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:53.404270] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 0.8s. Estimated remaining: 54.2s. Rate: 188.1 symbols/min [2025-09-28T02:57:53.564737] [DEBUG] [LOCAL ] UTF: Loaded 29200 existing records from primary storage. [2025-09-28T02:57:53.623575] [INFO ] [MAIN ] UTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:53.678782] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTF took 1.0s. Estimated remaining: 53.9s. Rate: 188.1 symbols/min [2025-09-28T02:57:53.677457] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:53.702495] [DEBUG] [LOCAL ] UTZ: Loaded 45341 existing records from primary storage. [2025-09-28T02:57:53.712130] [INFO ] [MAIN ] UTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:53.691310] [DEBUG] [LOCAL ] UTI: Loaded 41146 existing records from primary storage. [2025-09-28T02:57:53.717823] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTZ took 1.1s. Estimated remaining: 53.6s. Rate: 188.2 symbols/min [2025-09-28T02:57:53.723827] [INFO ] [MAIN ] UTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:53.780633] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTI took 1.1s. Estimated remaining: 53.2s. Rate: 188.3 symbols/min [2025-09-28T02:57:54.061764] [DEBUG] [LOCAL ] UVE: Loaded 22124 existing records from primary storage. [2025-09-28T02:57:54.112582] [INFO ] [MAIN ] UVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:54.118621] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 0.7s. Estimated remaining: 52.9s. Rate: 188.3 symbols/min [2025-09-28T02:57:54.112381] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:54.300857] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:54.349236] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:54.454753] [DEBUG] [LOCAL ] UZD: Loaded 6455 existing records from primary storage. [2025-09-28T02:57:54.471937] [INFO ] [MAIN ] UZD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:54.491150] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:54.491586] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UZD took 0.7s. Estimated remaining: 52.6s. Rate: 188.3 symbols/min [2025-09-28T02:57:54.504972] [DEBUG] [LOCAL ] UVV: Loaded 22660 existing records from primary storage. [2025-09-28T02:57:54.572009] [INFO ] [MAIN ] UVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:54.593219] [DEBUG] [LOCAL ] UZE: Loaded 7528 existing records from primary storage. [2025-09-28T02:57:54.614541] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UVV took 0.9s. Estimated remaining: 52.3s. Rate: 188.3 symbols/min [2025-09-28T02:57:54.604092] [INFO ] [MAIN ] UZE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:54.666377] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZE took 0.5s. Estimated remaining: 51.9s. Rate: 188.4 symbols/min [2025-09-28T02:57:54.834350] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:54.946935] [DEBUG] [LOCAL ] UWMC: Loaded 53516 existing records from primary storage. [2025-09-28T02:57:55.002937] [INFO ] [MAIN ] UWMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:55.067850] [DEBUG] [LOCAL ] UZF: Loaded 6574 existing records from primary storage. [2025-09-28T02:57:55.093007] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:55.088916] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UWMC took 1.4s. Estimated remaining: 51.6s. Rate: 188.4 symbols/min [2025-09-28T02:57:55.132819] [INFO ] [MAIN ] UZF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:55.151210] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:55.184035] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZF took 0.7s. Estimated remaining: 51.3s. Rate: 188.4 symbols/min [2025-09-28T02:57:55.443830] [DEBUG] [LOCAL ] VAC: Loaded 35026 existing records from primary storage. [2025-09-28T02:57:55.547627] [INFO ] [MAIN ] VAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:55.544842] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:55.548684] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:55.549060] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. VAC took 0.8s. Estimated remaining: 51.0s. Rate: 188.4 symbols/min [2025-09-28T02:57:55.780748] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:55.783148] [DEBUG] [LOCAL ] V: Loaded 54535 existing records from primary storage. [2025-09-28T02:57:55.797481] [INFO ] [MAIN ] V: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:55.810940] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. V took 1.2s. Estimated remaining: 50.6s. Rate: 188.4 symbols/min [2025-09-28T02:57:55.889737] [DEBUG] [LOCAL ] VATE: Loaded 5658 existing records from primary storage. [2025-09-28T02:57:55.949286] [INFO ] [MAIN ] VATE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:55.964249] [DEBUG] [LOCAL ] VALE: Loaded 54474 existing records from primary storage. [2025-09-28T02:57:55.965479] [DEBUG] [LOCAL ] VAL: Loaded 51142 existing records from primary storage. [2025-09-28T02:57:55.966277] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VATE took 0.4s. Estimated remaining: 50.3s. Rate: 188.5 symbols/min [2025-09-28T02:57:55.966496] [INFO ] [MAIN ] VALE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:55.993069] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VALE took 0.8s. Estimated remaining: 50.0s. Rate: 188.5 symbols/min [2025-09-28T02:57:55.999240] [INFO ] [MAIN ] VAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:56.059634] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VAL took 0.9s. Estimated remaining: 49.6s. Rate: 188.6 symbols/min [2025-09-28T02:57:56.175719] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:56.474051] [DEBUG] [LOCAL ] VBF: Loaded 7206 existing records from primary storage. [2025-09-28T02:57:56.550369] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:56.579272] [INFO ] [MAIN ] VBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:56.581281] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:56.602995] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VBF took 0.8s. Estimated remaining: 49.3s. Rate: 188.6 symbols/min [2025-09-28T02:57:56.700903] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:56.757228] [DEBUG] [LOCAL ] VCV: Loaded 13766 existing records from primary storage. [2025-09-28T02:57:56.769395] [INFO ] [MAIN ] VCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:56.805346] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VCV took 0.8s. Estimated remaining: 49.0s. Rate: 188.6 symbols/min [2025-09-28T02:57:56.948303] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:56.926566] [DEBUG] [LOCAL ] VEL: Loaded 13299 existing records from primary storage. [2025-09-28T02:57:56.976971] [INFO ] [MAIN ] VEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:56.996463] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEL took 0.9s. Estimated remaining: 48.7s. Rate: 188.6 symbols/min [2025-09-28T02:57:57.147330] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:57.169796] [DEBUG] [LOCAL ] VEEV: Loaded 47821 existing records from primary storage. [2025-09-28T02:57:57.186436] [INFO ] [MAIN ] VEEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:57.215314] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VEEV took 1.2s. Estimated remaining: 48.3s. Rate: 188.6 symbols/min [2025-09-28T02:57:57.444937] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:57.450594] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-28T02:57:57.452501] [DEBUG] [LOCAL ] VET: Loaded 44749 existing records from primary storage. [2025-09-28T02:57:57.468271] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-28T02:57:57.504101] [INFO ] [MAIN ] VET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:57.517265] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VET took 0.9s. Estimated remaining: 48.0s. Rate: 188.6 symbols/min [2025-09-28T02:57:57.520238] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-28T02:57:57.520605] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-28T02:57:57.548349] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-28T02:57:57.548670] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-28T02:57:57.553268] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:57.755457] [DEBUG] [LOCAL ] VFC: Loaded 54390 existing records from primary storage. [2025-09-28T02:57:57.793232] [INFO ] [MAIN ] VFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:57.819145] [DEBUG] [LOCAL ] VGI: Loaded 5237 existing records from primary storage. [2025-09-28T02:57:57.828985] [INFO ] [MAIN ] VGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:57.829141] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VGI took 0.6s. Estimated remaining: 47.7s. Rate: 188.7 symbols/min [2025-09-28T02:57:57.835691] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VFC took 1.0s. Estimated remaining: 47.4s. Rate: 188.7 symbols/min [2025-09-28T02:57:58.012276] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:58.396860] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:58.493849] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:58.464841] [DEBUG] [LOCAL ] VGM: Loaded 18384 existing records from primary storage. [2025-09-28T02:57:58.499502] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-28T02:57:58.539976] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-28T02:57:58.540369] [INFO ] [MAIN ] VGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:58.546249] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-28T02:57:58.556919] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VGM took 1.0s. Estimated remaining: 47.1s. Rate: 188.6 symbols/min [2025-09-28T02:57:58.583256] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-28T02:57:58.559621] [DEBUG] [LOCAL ] VHI: Loaded 2905 existing records from primary storage. [2025-09-28T02:57:58.642168] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-28T02:57:58.595761] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:58.660140] [INFO ] [MAIN ] VHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:58.665972] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-28T02:57:58.666276] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VHI took 0.8s. Estimated remaining: 46.7s. Rate: 188.7 symbols/min [2025-09-28T02:57:58.666467] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-28T02:57:58.968307] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:57:59.033918] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-28T02:57:59.081391] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:57:59.085000] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-09-28T02:57:59.094295] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:57:59.100764] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:59.101022] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-28T02:57:59.114412] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-28T02:57:59.198400] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-28T02:57:59.214885] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-28T02:57:59.238048] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VG took 2.2s. Estimated remaining: 46.4s. Rate: 188.6 symbols/min [2025-09-28T02:57:59.248185] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:59.522215] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:57:59.582613] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-28T02:57:59.619085] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:57:59.661686] [DEBUG] [LOCAL ] VICI: Loaded 54427 existing records from primary storage. [2025-09-28T02:57:59.661913] [DEBUG] [LOCAL ] VIK: Loaded 53250 existing records from primary storage. [2025-09-28T02:57:59.662570] [INFO ] [MAIN ] VICI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:59.663133] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VICI took 1.1s. Estimated remaining: 46.1s. Rate: 188.6 symbols/min [2025-09-28T02:57:59.663316] [INFO ] [MAIN ] VIK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:57:59.664347] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VIK took 1.0s. Estimated remaining: 45.8s. Rate: 188.7 symbols/min [2025-09-28T02:57:59.833952] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:57:59.867804] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-28T02:57:59.878417] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:57:59.884557] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-09-28T02:57:59.921025] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:57:59.960027] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-28T02:57:59.972988] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-28T02:58:00.003630] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-28T02:58:00.078521] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-28T02:58:00.077943] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:00.059218] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:00.095481] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIA took 2.2s. Estimated remaining: 45.5s. Rate: 188.6 symbols/min [2025-09-28T02:58:00.098286] [DEBUG] [LOCAL ] VIPS: Loaded 52093 existing records from primary storage. [2025-09-28T02:58:00.120585] [INFO ] [MAIN ] VIPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:00.136046] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIPS took 0.9s. Estimated remaining: 45.1s. Rate: 188.7 symbols/min [2025-09-28T02:58:00.455894] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:00.543423] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:00.545981] [DEBUG] [LOCAL ] VIST: Loaded 46722 existing records from primary storage. [2025-09-28T02:58:00.563557] [INFO ] [MAIN ] VIST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:00.564142] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIST took 0.9s. Estimated remaining: 44.8s. Rate: 188.7 symbols/min [2025-09-28T02:58:00.602050] [DEBUG] [LOCAL ] VIRT: Loaded 47448 existing records from primary storage. [2025-09-28T02:58:00.626964] [INFO ] [MAIN ] VIRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:00.667782] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VIRT took 1.0s. Estimated remaining: 44.5s. Rate: 188.7 symbols/min [2025-09-28T02:58:00.824446] [DEBUG] [LOCAL ] VKQ: Loaded 17552 existing records from primary storage. [2025-09-28T02:58:00.881627] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:00.893888] [INFO ] [MAIN ] VKQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:00.895996] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VKQ took 0.8s. Estimated remaining: 44.2s. Rate: 188.8 symbols/min [2025-09-28T02:58:01.033550] [DEBUG] [LOCAL ] VIV: Loaded 45667 existing records from primary storage. [2025-09-28T02:58:01.101730] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:01.112531] [INFO ] [MAIN ] VIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:01.143944] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VIV took 1.0s. Estimated remaining: 43.9s. Rate: 188.8 symbols/min [2025-09-28T02:58:01.202220] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:01.252003] [DEBUG] [LOCAL ] VLN: Loaded 29056 existing records from primary storage. [2025-09-28T02:58:01.264038] [INFO ] [MAIN ] VLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:01.283912] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VLN took 0.7s. Estimated remaining: 43.5s. Rate: 188.8 symbols/min [2025-09-28T02:58:01.579478] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:01.655429] [DEBUG] [LOCAL ] VLRS: Loaded 41188 existing records from primary storage. [2025-09-28T02:58:01.685675] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:01.681551] [INFO ] [MAIN ] VLRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:01.687821] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLRS took 0.8s. Estimated remaining: 43.2s. Rate: 188.8 symbols/min [2025-09-28T02:58:01.687363] [DEBUG] [LOCAL ] VLO: Loaded 53865 existing records from primary storage. [2025-09-28T02:58:01.689495] [INFO ] [MAIN ] VLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:01.711529] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLO took 1.0s. Estimated remaining: 42.9s. Rate: 188.9 symbols/min [2025-09-28T02:58:01.762956] [DEBUG] [LOCAL ] VLT: Loaded 4615 existing records from primary storage. [2025-09-28T02:58:01.799158] [INFO ] [MAIN ] VLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:01.838851] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLT took 0.6s. Estimated remaining: 42.6s. Rate: 188.9 symbols/min [2025-09-28T02:58:02.046154] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:02.074613] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:02.120071] [DEBUG] [LOCAL ] VLTO: Loaded 46710 existing records from primary storage. [2025-09-28T02:58:02.120561] [INFO ] [MAIN ] VLTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:02.120721] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VLTO took 0.8s. Estimated remaining: 42.2s. Rate: 188.9 symbols/min [2025-09-28T02:58:02.136078] [DEBUG] [LOCAL ] VMI: Loaded 15711 existing records from primary storage. [2025-09-28T02:58:02.136572] [INFO ] [MAIN ] VMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:02.136747] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VMI took 0.4s. Estimated remaining: 41.9s. Rate: 189.0 symbols/min [2025-09-28T02:58:02.171001] [DEBUG] [LOCAL ] VMC: Loaded 44263 existing records from primary storage. [2025-09-28T02:58:02.171401] [INFO ] [MAIN ] VMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:02.171505] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMC took 0.5s. Estimated remaining: 41.6s. Rate: 189.1 symbols/min [2025-09-28T02:58:02.806817] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:02.915048] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:02.885044] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:02.911151] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:02.931800] [DEBUG] [LOCAL ] VNCE: Loaded 7593 existing records from primary storage. [2025-09-28T02:58:02.932371] [INFO ] [MAIN ] VNCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:02.932559] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VNCE took 0.8s. Estimated remaining: 41.3s. Rate: 189.0 symbols/min [2025-09-28T02:58:03.059074] [DEBUG] [LOCAL ] VMO: Loaded 21297 existing records from primary storage. [2025-09-28T02:58:03.086149] [INFO ] [MAIN ] VMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:03.110384] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VMO took 0.9s. Estimated remaining: 40.9s. Rate: 189.0 symbols/min [2025-09-28T02:58:03.177727] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:03.224344] [DEBUG] [LOCAL ] VNO: Loaded 49668 existing records from primary storage. [2025-09-28T02:58:03.230305] [DEBUG] [LOCAL ] VNT: Loaded 44451 existing records from primary storage. [2025-09-28T02:58:03.281314] [INFO ] [MAIN ] VNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:03.273476] [INFO ] [MAIN ] VNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:03.304972] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNO took 1.1s. Estimated remaining: 40.6s. Rate: 189.1 symbols/min [2025-09-28T02:58:03.309931] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VNT took 1.1s. Estimated remaining: 40.3s. Rate: 189.1 symbols/min [2025-09-28T02:58:03.541036] [DEBUG] [LOCAL ] VOC: Loaded 9021 existing records from primary storage. [2025-09-28T02:58:03.535231] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:03.596231] [INFO ] [MAIN ] VOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:03.617888] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VOC took 0.7s. Estimated remaining: 40.0s. Rate: 189.1 symbols/min [2025-09-28T02:58:03.829034] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:03.860780] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-28T02:58:03.865243] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:03.886246] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-28T02:58:03.892050] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-28T02:58:03.908013] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-28T02:58:03.908306] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-28T02:58:03.913852] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-28T02:58:04.117736] [DEBUG] [LOCAL ] VPG: Loaded 17373 existing records from primary storage. [2025-09-28T02:58:04.161077] [DEBUG] [LOCAL ] VOYA: Loaded 43377 existing records from primary storage. [2025-09-28T02:58:04.167760] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:04.178601] [INFO ] [MAIN ] VPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:04.189327] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VPG took 0.9s. Estimated remaining: 39.7s. Rate: 189.1 symbols/min [2025-09-28T02:58:04.214939] [INFO ] [MAIN ] VOYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:04.295879] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VOYA took 1.1s. Estimated remaining: 39.3s. Rate: 189.1 symbols/min [2025-09-28T02:58:04.429332] [DEBUG] [LOCAL ] VPV: Loaded 5429 existing records from primary storage. [2025-09-28T02:58:04.539186] [INFO ] [MAIN ] VPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:04.571830] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VPV took 0.9s. Estimated remaining: 39.0s. Rate: 189.1 symbols/min [2025-09-28T02:58:04.816132] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:04.866862] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:58:04.916864] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-28T02:58:04.951926] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:05.040980] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:05.063537] [DEBUG] [LOCAL ] VRTS: Loaded 9287 existing records from primary storage. [2025-09-28T02:58:05.073995] [INFO ] [MAIN ] VRTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:05.074248] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VRTS took 0.5s. Estimated remaining: 38.7s. Rate: 189.1 symbols/min [2025-09-28T02:58:05.097239] [DEBUG] [LOCAL ] VRE: Loaded 35345 existing records from primary storage. [2025-09-28T02:58:05.114762] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:58:05.115108] [INFO ] [MAIN ] VRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:05.115540] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-28T02:58:05.115455] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRE took 0.9s. Estimated remaining: 38.4s. Rate: 189.2 symbols/min [2025-09-28T02:58:05.126355] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:58:05.162420] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-09-28T02:58:05.176665] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:58:05.243096] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-28T02:58:05.284830] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-28T02:58:05.290389] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-28T02:58:05.311789] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-28T02:58:05.432409] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:05.443435] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VOYG took 2.1s. Estimated remaining: 38.1s. Rate: 189.2 symbols/min [2025-09-28T02:58:05.445015] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-09-28T02:58:05.482728] [INFO ] [MAIN ] VRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:05.522201] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VRT took 1.2s. Estimated remaining: 37.7s. Rate: 189.2 symbols/min [2025-09-28T02:58:05.632306] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:05.863069] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:05.934896] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:05.955621] [DEBUG] [LOCAL ] VSCO: Loaded 53556 existing records from primary storage. [2025-09-28T02:58:05.956482] [INFO ] [MAIN ] VSCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:05.957126] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSCO took 0.9s. Estimated remaining: 37.4s. Rate: 189.2 symbols/min [2025-09-28T02:58:06.187717] [DEBUG] [LOCAL ] VSH: Loaded 49188 existing records from primary storage. [2025-09-28T02:58:06.185812] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:06.202846] [INFO ] [MAIN ] VSH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:06.203613] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 1.1s. Estimated remaining: 37.1s. Rate: 189.2 symbols/min [2025-09-28T02:58:06.308574] [DEBUG] [LOCAL ] VSTS: Loaded 49773 existing records from primary storage. [2025-09-28T02:58:06.372461] [DEBUG] [LOCAL ] VST: Loaded 54498 existing records from primary storage. [2025-09-28T02:58:06.365740] [INFO ] [MAIN ] VSTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:06.373389] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VSTS took 0.8s. Estimated remaining: 36.8s. Rate: 189.2 symbols/min [2025-09-28T02:58:06.378860] [INFO ] [MAIN ] VST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:06.468277] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:06.475288] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VST took 1.0s. Estimated remaining: 36.4s. Rate: 189.3 symbols/min [2025-09-28T02:58:06.649797] [DEBUG] [LOCAL ] VTEX: Loaded 43948 existing records from primary storage. [2025-09-28T02:58:06.699067] [INFO ] [MAIN ] VTEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:06.731702] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTEX took 0.8s. Estimated remaining: 36.1s. Rate: 189.3 symbols/min [2025-09-28T02:58:06.866583] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:06.964370] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:07.041597] [DEBUG] [LOCAL ] VTLE: Loaded 49337 existing records from primary storage. [2025-09-28T02:58:07.074626] [INFO ] [MAIN ] VTLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:07.130007] [DEBUG] [LOCAL ] VTN: Loaded 7293 existing records from primary storage. [2025-09-28T02:58:07.130188] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTLE took 0.9s. Estimated remaining: 35.8s. Rate: 189.3 symbols/min [2025-09-28T02:58:07.134798] [DEBUG] [LOCAL ] VTMX: Loaded 17811 existing records from primary storage. [2025-09-28T02:58:07.134252] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:07.141443] [INFO ] [MAIN ] VTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:07.170853] [INFO ] [MAIN ] VTMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:07.207241] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTN took 0.7s. Estimated remaining: 35.5s. Rate: 189.4 symbols/min [2025-09-28T02:58:07.245294] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTMX took 0.8s. Estimated remaining: 35.2s. Rate: 189.4 symbols/min [2025-09-28T02:58:07.536460] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:07.537397] [DEBUG] [LOCAL ] VTOL: Loaded 19915 existing records from primary storage. [2025-09-28T02:58:07.577256] [INFO ] [MAIN ] VTOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:07.605583] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTOL took 0.8s. Estimated remaining: 34.8s. Rate: 189.4 symbols/min [2025-09-28T02:58:07.771328] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:07.748259] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:07.945243] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:08.020071] [DEBUG] [LOCAL ] VVR: Loaded 31251 existing records from primary storage. [2025-09-28T02:58:08.022554] [DEBUG] [LOCAL ] VTR: Loaded 53620 existing records from primary storage. [2025-09-28T02:58:08.023324] [INFO ] [MAIN ] VTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:08.021069] [DEBUG] [LOCAL ] VTS: Loaded 30992 existing records from primary storage. [2025-09-28T02:58:08.023672] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTR took 0.9s. Estimated remaining: 34.5s. Rate: 189.4 symbols/min [2025-09-28T02:58:08.029353] [INFO ] [MAIN ] VVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:08.029533] [INFO ] [MAIN ] VTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:08.035184] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VVR took 0.8s. Estimated remaining: 34.2s. Rate: 189.5 symbols/min [2025-09-28T02:58:08.040714] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VTS took 0.8s. Estimated remaining: 33.9s. Rate: 189.6 symbols/min [2025-09-28T02:58:08.491745] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:08.555699] [DEBUG] [LOCAL ] VVV: Loaded 50933 existing records from primary storage. [2025-09-28T02:58:08.578439] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:08.614407] [INFO ] [MAIN ] VVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:08.648625] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:08.646163] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVV took 1.0s. Estimated remaining: 33.6s. Rate: 189.5 symbols/min [2025-09-28T02:58:08.779719] [DEBUG] [LOCAL ] VVX: Loaded 23664 existing records from primary storage. [2025-09-28T02:58:08.793203] [INFO ] [MAIN ] VVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:08.815211] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVX took 0.8s. Estimated remaining: 33.2s. Rate: 189.5 symbols/min [2025-09-28T02:58:08.976621] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:09.043883] [DEBUG] [LOCAL ] VYX: Loaded 49624 existing records from primary storage. [2025-09-28T02:58:09.142374] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:09.122745] [INFO ] [MAIN ] VYX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:09.142783] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 1.1s. Estimated remaining: 32.9s. Rate: 189.5 symbols/min [2025-09-28T02:58:09.154935] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-09-28T02:58:09.183057] [INFO ] [MAIN ] VZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:09.214024] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. VZ took 1.1s. Estimated remaining: 32.6s. Rate: 189.6 symbols/min [2025-09-28T02:58:09.481282] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:09.589714] [DEBUG] [LOCAL ] W: Loaded 54266 existing records from primary storage. [2025-09-28T02:58:09.599160] [INFO ] [MAIN ] W: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:09.620714] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. W took 1.0s. Estimated remaining: 32.3s. Rate: 189.6 symbols/min [2025-09-28T02:58:09.620234] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:09.764258] [DEBUG] [LOCAL ] WAB: Loaded 44872 existing records from primary storage. [2025-09-28T02:58:09.770823] [INFO ] [MAIN ] WAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:09.807331] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WAB took 1.0s. Estimated remaining: 32.0s. Rate: 189.6 symbols/min [2025-09-28T02:58:09.877920] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:09.944358] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-28T02:58:09.994278] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-28T02:58:09.987066] [DEBUG] [LOCAL ] WAL: Loaded 46040 existing records from primary storage. [2025-09-28T02:58:10.016417] [DEBUG] [LOCAL ] WAT: Loaded 35620 existing records from primary storage. [2025-09-28T02:58:10.020209] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-28T02:58:10.020565] [INFO ] [MAIN ] WAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:10.022211] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WAL took 0.9s. Estimated remaining: 31.6s. Rate: 189.6 symbols/min [2025-09-28T02:58:10.021285] [INFO ] [MAIN ] WAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:10.021548] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-28T02:58:10.104225] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAT took 0.9s. Estimated remaining: 31.3s. Rate: 189.7 symbols/min [2025-09-28T02:58:10.179172] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-28T02:58:10.230517] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:10.260021] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-28T02:58:10.484364] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:10.612599] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:10.716572] [DEBUG] [LOCAL ] WBX: Loaded 12558 existing records from primary storage. [2025-09-28T02:58:10.750582] [INFO ] [MAIN ] WBX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:10.773339] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WBX took 0.8s. Estimated remaining: 31.0s. Rate: 189.6 symbols/min [2025-09-28T02:58:11.018147] [DEBUG] [LOCAL ] WBS: Loaded 49471 existing records from primary storage. [2025-09-28T02:58:11.076594] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:58:11.115867] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-28T02:58:11.092759] [INFO ] [MAIN ] WBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:11.138730] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WBS took 1.3s. Estimated remaining: 30.7s. Rate: 189.6 symbols/min [2025-09-28T02:58:11.215707] [DEBUG] [LOCAL ] WCC: Loaded 40567 existing records from primary storage. [2025-09-28T02:58:11.215441] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:11.258163] [INFO ] [MAIN ] WCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:11.275846] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WCC took 1.2s. Estimated remaining: 30.4s. Rate: 189.6 symbols/min [2025-09-28T02:58:11.376172] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:58:11.459215] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:11.423908] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-28T02:58:11.465894] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:58:11.485204] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-09-28T02:58:11.485705] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:58:11.501774] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-28T02:58:11.544086] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-28T02:58:11.566130] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-28T02:58:11.565920] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:11.566828] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-28T02:58:11.566935] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WBI took 1.9s. Estimated remaining: 30.1s. Rate: 189.6 symbols/min [2025-09-28T02:58:11.739362] [DEBUG] [LOCAL ] WDH: Loaded 17597 existing records from primary storage. [2025-09-28T02:58:11.749770] [DEBUG] [LOCAL ] WCN: Loaded 48708 existing records from primary storage. [2025-09-28T02:58:11.756159] [DEBUG] [LOCAL ] WD: Loaded 23747 existing records from primary storage. [2025-09-28T02:58:11.761886] [INFO ] [MAIN ] WCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:11.756365] [INFO ] [MAIN ] WDH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:11.767295] [INFO ] [MAIN ] WD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:11.777780] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WCN took 1.0s. Estimated remaining: 29.7s. Rate: 189.7 symbols/min [2025-09-28T02:58:11.799382] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WDH took 0.5s. Estimated remaining: 29.4s. Rate: 189.7 symbols/min [2025-09-28T02:58:11.829339] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:11.829714] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WD took 0.7s. Estimated remaining: 29.1s. Rate: 189.8 symbols/min [2025-09-28T02:58:11.854088] [DEBUG] [LOCAL ] WDI: Loaded 21314 existing records from primary storage. [2025-09-28T02:58:11.854381] [INFO ] [MAIN ] WDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:11.854762] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 0.3s. Estimated remaining: 28.8s. Rate: 189.9 symbols/min [2025-09-28T02:58:12.495422] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:12.521478] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:12.637576] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:12.656745] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:12.684330] [DEBUG] [LOCAL ] WEA: Loaded 7379 existing records from primary storage. [2025-09-28T02:58:12.685079] [INFO ] [MAIN ] WEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:12.685417] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 0.8s. Estimated remaining: 28.5s. Rate: 189.8 symbols/min [2025-09-28T02:58:12.841463] [DEBUG] [LOCAL ] WEAV: Loaded 42562 existing records from primary storage. [2025-09-28T02:58:12.860149] [INFO ] [MAIN ] WEAV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:12.917356] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 1.1s. Estimated remaining: 28.1s. Rate: 189.8 symbols/min [2025-09-28T02:58:12.877812] [DEBUG] [LOCAL ] WDS: Loaded 44259 existing records from primary storage. [2025-09-28T02:58:12.951518] [INFO ] [MAIN ] WDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:12.965195] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:12.983549] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WDS took 1.1s. Estimated remaining: 27.8s. Rate: 189.8 symbols/min [2025-09-28T02:58:13.119274] [DEBUG] [LOCAL ] WEC: Loaded 52958 existing records from primary storage. [2025-09-28T02:58:13.184980] [INFO ] [MAIN ] WEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:13.197181] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WEC took 1.3s. Estimated remaining: 27.5s. Rate: 189.9 symbols/min [2025-09-28T02:58:13.479823] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:13.478009] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:13.574682] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:13.610873] [DEBUG] [LOCAL ] WF: Loaded 10903 existing records from primary storage. [2025-09-28T02:58:13.611424] [INFO ] [MAIN ] WF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:13.611892] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WF took 0.4s. Estimated remaining: 27.2s. Rate: 189.8 symbols/min [2025-09-28T02:58:13.642986] [DEBUG] [LOCAL ] WELL: Loaded 53132 existing records from primary storage. [2025-09-28T02:58:13.663375] [INFO ] [MAIN ] WELL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:13.692708] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WELL took 1.0s. Estimated remaining: 26.9s. Rate: 189.9 symbols/min [2025-09-28T02:58:13.944815] [DEBUG] [LOCAL ] WES: Loaded 48689 existing records from primary storage. [2025-09-28T02:58:13.930855] [DEBUG] [LOCAL ] WEX: Loaded 35697 existing records from primary storage. [2025-09-28T02:58:13.971293] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:13.977541] [INFO ] [MAIN ] WES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:13.983138] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WES took 1.0s. Estimated remaining: 26.5s. Rate: 189.9 symbols/min [2025-09-28T02:58:13.994918] [INFO ] [MAIN ] WEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:14.022141] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WEX took 1.0s. Estimated remaining: 26.2s. Rate: 190.0 symbols/min [2025-09-28T02:58:14.078901] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:14.455517] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:14.529898] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:14.534233] [DEBUG] [LOCAL ] WFG: Loaded 25211 existing records from primary storage. [2025-09-28T02:58:14.536676] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-09-28T02:58:14.537027] [INFO ] [MAIN ] WFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:14.538365] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFG took 0.8s. Estimated remaining: 25.9s. Rate: 189.9 symbols/min [2025-09-28T02:58:14.538475] [INFO ] [MAIN ] WFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:14.539607] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFC took 0.9s. Estimated remaining: 25.6s. Rate: 190.0 symbols/min [2025-09-28T02:58:15.009301] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:15.029767] [DEBUG] [LOCAL ] WGO: Loaded 39823 existing records from primary storage. [2025-09-28T02:58:15.027515] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:15.044953] [INFO ] [MAIN ] WGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:15.046004] [DEBUG] [LOCAL ] WH: Loaded 46339 existing records from primary storage. [2025-09-28T02:58:15.046265] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WGO took 1.0s. Estimated remaining: 25.3s. Rate: 190.0 symbols/min [2025-09-28T02:58:15.046923] [INFO ] [MAIN ] WH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:15.084890] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WH took 1.0s. Estimated remaining: 24.9s. Rate: 190.0 symbols/min [2025-09-28T02:58:15.107566] [DEBUG] [LOCAL ] WHG: Loaded 3416 existing records from primary storage. [2025-09-28T02:58:15.153999] [INFO ] [MAIN ] WHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:15.228020] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WHG took 0.6s. Estimated remaining: 24.6s. Rate: 190.1 symbols/min [2025-09-28T02:58:15.457222] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:15.515691] [DEBUG] [LOCAL ] WHD: Loaded 41130 existing records from primary storage. [2025-09-28T02:58:15.614672] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:15.621813] [INFO ] [MAIN ] WHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:15.653906] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:15.654136] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WHD took 1.1s. Estimated remaining: 24.3s. Rate: 190.1 symbols/min [2025-09-28T02:58:15.724751] [DEBUG] [LOCAL ] WIA: Loaded 4937 existing records from primary storage. [2025-09-28T02:58:15.784306] [INFO ] [MAIN ] WIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:15.784831] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WIA took 0.7s. Estimated remaining: 24.0s. Rate: 190.1 symbols/min [2025-09-28T02:58:15.823133] [DEBUG] [LOCAL ] WINN: Loaded 11944 existing records from primary storage. [2025-09-28T02:58:15.948168] [INFO ] [MAIN ] WINN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:15.956344] [DEBUG] [LOCAL ] WHR: Loaded 48846 existing records from primary storage. [2025-09-28T02:58:16.024088] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WINN took 0.8s. Estimated remaining: 23.7s. Rate: 190.1 symbols/min [2025-09-28T02:58:16.028852] [INFO ] [MAIN ] WHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:16.028557] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:16.071709] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WHR took 1.0s. Estimated remaining: 23.3s. Rate: 190.2 symbols/min [2025-09-28T02:58:16.174234] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:16.436380] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:16.520026] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:16.534617] [DEBUG] [LOCAL ] WIW: Loaded 20756 existing records from primary storage. [2025-09-28T02:58:16.550397] [INFO ] [MAIN ] WIW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:16.552496] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIW took 0.8s. Estimated remaining: 23.0s. Rate: 190.2 symbols/min [2025-09-28T02:58:16.597056] [DEBUG] [LOCAL ] WIT: Loaded 53070 existing records from primary storage. [2025-09-28T02:58:16.629346] [INFO ] [MAIN ] WIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:16.661212] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIT took 1.0s. Estimated remaining: 22.7s. Rate: 190.2 symbols/min [2025-09-28T02:58:16.807246] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:16.909178] [DEBUG] [LOCAL ] WK: Loaded 37342 existing records from primary storage. [2025-09-28T02:58:16.926502] [DEBUG] [LOCAL ] WKC: Loaded 35538 existing records from primary storage. [2025-09-28T02:58:16.937393] [INFO ] [MAIN ] WK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:16.937689] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 0.9s. Estimated remaining: 22.4s. Rate: 190.2 symbols/min [2025-09-28T02:58:16.964767] [INFO ] [MAIN ] WKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:17.012894] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 0.9s. Estimated remaining: 22.1s. Rate: 190.3 symbols/min [2025-09-28T02:58:17.012792] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:17.304263] [DEBUG] [LOCAL ] WLKP: Loaded 6800 existing records from primary storage. [2025-09-28T02:58:17.332772] [INFO ] [MAIN ] WLKP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:17.303460] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:17.353500] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLKP took 0.7s. Estimated remaining: 21.8s. Rate: 190.3 symbols/min [2025-09-28T02:58:17.357074] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-28T02:58:17.403352] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-28T02:58:17.403234] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:17.454739] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-28T02:58:17.466586] [DEBUG] [LOCAL ] WLK: Loaded 46113 existing records from primary storage. [2025-09-28T02:58:17.488310] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-28T02:58:17.500344] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-28T02:58:17.500503] [INFO ] [MAIN ] WLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:17.511279] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-28T02:58:17.511518] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLK took 1.0s. Estimated remaining: 21.4s. Rate: 190.3 symbols/min [2025-09-28T02:58:17.760447] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:17.954950] [DEBUG] [LOCAL ] WLY: Loaded 30414 existing records from primary storage. [2025-09-28T02:58:18.015893] [INFO ] [MAIN ] WLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:18.026317] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLY took 1.0s. Estimated remaining: 21.1s. Rate: 190.3 symbols/min [2025-09-28T02:58:18.076862] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:18.415158] [DEBUG] [LOCAL ] WM: Loaded 51697 existing records from primary storage. [2025-09-28T02:58:18.456827] [INFO ] [MAIN ] WM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:18.465105] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:58:18.490192] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-28T02:58:18.457113] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WM took 1.1s. Estimated remaining: 20.8s. Rate: 190.2 symbols/min [2025-09-28T02:58:18.510514] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:18.628109] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-09-28T02:58:18.660517] [DEBUG] [LOCAL ] WMK: Loaded 14753 existing records from primary storage. [2025-09-28T02:58:18.671992] [INFO ] [MAIN ] WMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:18.672288] [INFO ] [MAIN ] WMK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:18.704295] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WMB took 1.2s. Estimated remaining: 20.5s. Rate: 190.2 symbols/min [2025-09-28T02:58:18.736345] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WMK took 0.7s. Estimated remaining: 20.2s. Rate: 190.3 symbols/min [2025-09-28T02:58:18.742131] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:18.835798] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-28T02:58:18.881183] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-28T02:58:19.079692] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:19.143690] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:19.174879] [DEBUG] [LOCAL ] WMS: Loaded 40249 existing records from primary storage. [2025-09-28T02:58:19.175408] [INFO ] [MAIN ] WMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:19.175566] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WMS took 0.7s. Estimated remaining: 19.9s. Rate: 190.3 symbols/min [2025-09-28T02:58:19.222368] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-28T02:58:19.250333] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-28T02:58:19.401046] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:19.442359] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-09-28T02:58:19.443838] [DEBUG] [LOCAL ] WNC: Loaded 40452 existing records from primary storage. [2025-09-28T02:58:19.444091] [INFO ] [MAIN ] WMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:19.445995] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMT took 0.7s. Estimated remaining: 19.5s. Rate: 190.3 symbols/min [2025-09-28T02:58:19.446162] [INFO ] [MAIN ] WNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:19.473688] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNC took 0.7s. Estimated remaining: 19.2s. Rate: 190.4 symbols/min [2025-09-28T02:58:19.557113] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-28T02:58:19.589019] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-28T02:58:19.818811] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:19.875756] [DEBUG] [LOCAL ] WNS: Loaded 40539 existing records from primary storage. [2025-09-28T02:58:19.896144] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:19.896618] [INFO ] [MAIN ] WNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:19.897304] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNS took 0.7s. Estimated remaining: 18.9s. Rate: 190.3 symbols/min [2025-09-28T02:58:19.993445] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-28T02:58:20.015319] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-28T02:58:20.133292] [DEBUG] [LOCAL ] WOR: Loaded 25288 existing records from primary storage. [2025-09-28T02:58:20.132290] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:20.133801] [INFO ] [MAIN ] WOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:20.134195] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WOR took 0.6s. Estimated remaining: 18.6s. Rate: 190.4 symbols/min [2025-09-28T02:58:20.277927] [DEBUG] [LOCAL ] WOLF: Loaded 54312 existing records from primary storage. [2025-09-28T02:58:20.337427] [INFO ] [MAIN ] WOLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:20.339883] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOLF took 0.9s. Estimated remaining: 18.3s. Rate: 190.4 symbols/min [2025-09-28T02:58:20.371536] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:20.407739] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-28T02:58:20.425206] [DEBUG] [LOCAL ] WOW: Loaded 30769 existing records from primary storage. [2025-09-28T02:58:20.446075] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-28T02:58:20.466343] [INFO ] [MAIN ] WOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:20.478588] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOW took 0.6s. Estimated remaining: 18.0s. Rate: 190.4 symbols/min [2025-09-28T02:58:20.744099] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-28T02:58:20.741031] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:20.755927] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-28T02:58:20.825902] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:20.848809] [DEBUG] [LOCAL ] WPC: Loaded 49217 existing records from primary storage. [2025-09-28T02:58:20.849482] [INFO ] [MAIN ] WPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:20.849772] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WPC took 0.7s. Estimated remaining: 17.6s. Rate: 190.4 symbols/min [2025-09-28T02:58:21.088852] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:21.107486] [DEBUG] [LOCAL ] WPP: Loaded 34282 existing records from primary storage. [2025-09-28T02:58:21.108921] [DEBUG] [LOCAL ] WPM: Loaded 53504 existing records from primary storage. [2025-09-28T02:58:21.109497] [INFO ] [MAIN ] WPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:21.109590] [INFO ] [MAIN ] WPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:21.109765] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPP took 0.6s. Estimated remaining: 17.3s. Rate: 190.4 symbols/min [2025-09-28T02:58:21.122481] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPM took 0.7s. Estimated remaining: 17.0s. Rate: 190.5 symbols/min [2025-09-28T02:58:21.226438] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-28T02:58:21.239035] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-28T02:58:21.307116] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:21.346493] [DEBUG] [LOCAL ] WRB: Loaded 51313 existing records from primary storage. [2025-09-28T02:58:21.346951] [INFO ] [MAIN ] WRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:21.347058] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WRB took 0.5s. Estimated remaining: 16.7s. Rate: 190.5 symbols/min [2025-09-28T02:58:21.391092] [DEBUG] [LOCAL ] WRBY: Loaded 51609 existing records from primary storage. [2025-09-28T02:58:21.391523] [INFO ] [MAIN ] WRBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:21.391628] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRBY took 0.3s. Estimated remaining: 16.4s. Rate: 190.6 symbols/min [2025-09-28T02:58:21.621921] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-28T02:58:21.623080] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-28T02:58:21.929502] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-28T02:58:21.931003] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-28T02:58:22.155271] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-28T02:58:22.156400] [INFO ] [REMOTE ] WLTG: Full fetch complete (1661 records). [2025-09-28T02:58:22.156509] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-28T02:58:22.352990] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-28T02:58:22.353205] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:58:22.353293] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:58:22.353379] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-28T02:58:22.353493] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-28T02:58:22.353568] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-28T02:58:22.353697] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-28T02:58:22.353795] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WLTG took 5.4s. Estimated remaining: 16.1s. Rate: 190.4 symbols/min [2025-09-28T02:58:23.038396] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:23.071779] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:23.072714] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:23.106956] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:23.171066] [DEBUG] [LOCAL ] WSR: Loaded 23550 existing records from primary storage. [2025-09-28T02:58:23.172067] [DEBUG] [LOCAL ] WSO: Loaded 25059 existing records from primary storage. [2025-09-28T02:58:23.172710] [INFO ] [MAIN ] WSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:23.173413] [INFO ] [MAIN ] WSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:23.173312] [DEBUG] [LOCAL ] WS: Loaded 24434 existing records from primary storage. [2025-09-28T02:58:23.173946] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WSR took 0.8s. Estimated remaining: 15.8s. Rate: 190.3 symbols/min [2025-09-28T02:58:23.174964] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WSO took 0.8s. Estimated remaining: 15.4s. Rate: 190.4 symbols/min [2025-09-28T02:58:23.180440] [INFO ] [MAIN ] WS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:23.212686] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WS took 0.8s. Estimated remaining: 15.1s. Rate: 190.5 symbols/min [2025-09-28T02:58:23.593147] [DEBUG] [LOCAL ] WSM: Loaded 50533 existing records from primary storage. [2025-09-28T02:58:23.663791] [INFO ] [MAIN ] WSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:23.647482] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:23.761759] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:23.765557] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:23.715803] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSM took 1.4s. Estimated remaining: 14.8s. Rate: 190.4 symbols/min [2025-09-28T02:58:24.003602] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:24.017804] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-28T02:58:24.017946] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-28T02:58:24.019207] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-28T02:58:24.020578] [DEBUG] [LOCAL ] WST: Loaded 38092 existing records from primary storage. [2025-09-28T02:58:24.021537] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-28T02:58:24.021784] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-28T02:58:24.037323] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-28T02:58:24.034116] [INFO ] [MAIN ] WST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:24.069691] [DEBUG] [LOCAL ] WTI: Loaded 44472 existing records from primary storage. [2025-09-28T02:58:24.080566] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 0.9s. Estimated remaining: 14.5s. Rate: 190.4 symbols/min [2025-09-28T02:58:24.159348] [DEBUG] [LOCAL ] WT: Loaded 48354 existing records from primary storage. [2025-09-28T02:58:24.126140] [INFO ] [MAIN ] WTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:24.209760] [INFO ] [MAIN ] WT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:24.233370] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WTI took 0.9s. Estimated remaining: 14.2s. Rate: 190.5 symbols/min [2025-09-28T02:58:24.344548] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WT took 1.0s. Estimated remaining: 13.9s. Rate: 190.5 symbols/min [2025-09-28T02:58:24.684206] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:24.956973] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:24.980592] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:25.082986] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:58:25.083575] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-28T02:58:25.121347] [DEBUG] [LOCAL ] WTS: Loaded 18597 existing records from primary storage. [2025-09-28T02:58:25.121716] [INFO ] [MAIN ] WTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:25.121915] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WTS took 0.8s. Estimated remaining: 13.6s. Rate: 190.4 symbols/min [2025-09-28T02:58:25.263037] [DEBUG] [LOCAL ] WTRG: Loaded 51656 existing records from primary storage. [2025-09-28T02:58:25.275593] [INFO ] [MAIN ] WTRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:25.313064] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTRG took 1.2s. Estimated remaining: 13.2s. Rate: 190.4 symbols/min [2025-09-28T02:58:25.366996] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:25.396869] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-28T02:58:25.415820] [DEBUG] [LOCAL ] WTTR: Loaded 45735 existing records from primary storage. [2025-09-28T02:58:25.414489] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-28T02:58:25.434062] [INFO ] [MAIN ] WTTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:25.450435] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTTR took 1.1s. Estimated remaining: 12.9s. Rate: 190.5 symbols/min [2025-09-28T02:58:25.673121] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:25.749119] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:25.753182] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-28T02:58:25.772733] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-28T02:58:25.808708] [DEBUG] [LOCAL ] WU: Loaded 54232 existing records from primary storage. [2025-09-28T02:58:25.809148] [INFO ] [MAIN ] WU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:25.809283] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WU took 0.7s. Estimated remaining: 12.6s. Rate: 190.5 symbols/min [2025-09-28T02:58:25.944314] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.17 seconds). [2025-09-28T02:58:25.951294] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-28T02:58:26.057885] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:26.060345] [DEBUG] [LOCAL ] WWW: Loaded 49906 existing records from primary storage. [2025-09-28T02:58:26.062846] [INFO ] [MAIN ] WWW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:26.062968] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WWW took 0.7s. Estimated remaining: 12.3s. Rate: 190.5 symbols/min [2025-09-28T02:58:26.064082] [DEBUG] [LOCAL ] WY: Loaded 53899 existing records from primary storage. [2025-09-28T02:58:26.076310] [INFO ] [MAIN ] WY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:26.110418] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WY took 0.6s. Estimated remaining: 12.0s. Rate: 190.5 symbols/min [2025-09-28T02:58:26.368281] [DEBUG] [LOCAL ] XFLT: Loaded 30306 existing records from primary storage. [2025-09-28T02:58:26.368575] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-28T02:58:26.375248] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-28T02:58:26.395271] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:26.390837] [INFO ] [MAIN ] XFLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:26.418804] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XFLT took 0.6s. Estimated remaining: 11.7s. Rate: 190.5 symbols/min [2025-09-28T02:58:26.478374] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:26.511671] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-28T02:58:26.524807] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-28T02:58:26.586937] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-28T02:58:26.593313] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-28T02:58:26.609170] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-28T02:58:26.636094] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-28T02:58:26.672713] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:26.767982] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-28T02:58:26.781089] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-28T02:58:26.825927] [DEBUG] [LOCAL ] XHR: Loaded 44680 existing records from primary storage. [2025-09-28T02:58:26.863634] [INFO ] [MAIN ] XHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:26.906382] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. XHR took 0.8s. Estimated remaining: 11.3s. Rate: 190.5 symbols/min [2025-09-28T02:58:27.018423] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-28T02:58:27.068578] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-28T02:58:27.201727] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-09-28T02:58:27.248761] [INFO ] [MAIN ] XOM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:27.340692] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. XOM took 0.9s. Estimated remaining: 11.0s. Rate: 190.5 symbols/min [2025-09-28T02:58:27.324978] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:58:27.344184] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:27.345194] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-28T02:58:27.576447] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-28T02:58:27.576119] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:58:27.587146] [DEBUG] [LOCAL ] XPER: Loaded 30181 existing records from primary storage. [2025-09-28T02:58:27.607900] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-28T02:58:27.612639] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-28T02:58:27.612122] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:27.614105] [INFO ] [MAIN ] XPER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:27.614886] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XPER took 0.7s. Estimated remaining: 10.7s. Rate: 190.5 symbols/min [2025-09-28T02:58:27.614939] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:58:27.615429] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-09-28T02:58:27.615527] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:58:27.639771] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-28T02:58:27.655636] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-28T02:58:27.696158] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-28T02:58:27.721318] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-28T02:58:27.746341] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XIFR took 1.6s. Estimated remaining: 10.4s. Rate: 190.5 symbols/min [2025-09-28T02:58:27.920240] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:27.951792] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-28T02:58:28.034087] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:28.049529] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-28T02:58:28.057186] [DEBUG] [LOCAL ] XPEV: Loaded 54419 existing records from primary storage. [2025-09-28T02:58:28.057953] [INFO ] [MAIN ] XPEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:28.058477] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XPEV took 0.7s. Estimated remaining: 10.1s. Rate: 190.5 symbols/min [2025-09-28T02:58:28.283203] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:28.313305] [DEBUG] [LOCAL ] XPOF: Loaded 39243 existing records from primary storage. [2025-09-28T02:58:28.311809] [DEBUG] [LOCAL ] XPO: Loaded 48656 existing records from primary storage. [2025-09-28T02:58:28.314019] [INFO ] [MAIN ] XPOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:28.314191] [INFO ] [MAIN ] XPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:28.314710] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPOF took 0.6s. Estimated remaining: 9.8s. Rate: 190.5 symbols/min [2025-09-28T02:58:28.320159] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPO took 0.7s. Estimated remaining: 9.4s. Rate: 190.6 symbols/min [2025-09-28T02:58:28.425324] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-28T02:58:28.481941] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-28T02:58:28.704827] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:28.701084] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:28.728299] [DEBUG] [LOCAL ] XPRO: Loaded 46617 existing records from primary storage. [2025-09-28T02:58:28.729077] [INFO ] [MAIN ] XPRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:28.729184] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPRO took 0.7s. Estimated remaining: 9.1s. Rate: 190.6 symbols/min [2025-09-28T02:58:28.926432] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:28.935820] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-28T02:58:28.947564] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-28T02:58:28.952409] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-28T02:58:28.952284] [DEBUG] [LOCAL ] XYF: Loaded 28464 existing records from primary storage. [2025-09-28T02:58:28.953212] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-28T02:58:28.953345] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-28T02:58:28.953984] [INFO ] [MAIN ] XYF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:28.954432] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-28T02:58:28.956678] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-28T02:58:28.956826] [INFO ] [REMOTE ] WTM: Full fetch complete (2277 records). [2025-09-28T02:58:28.954630] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYF took 0.6s. Estimated remaining: 8.8s. Rate: 190.6 symbols/min [2025-09-28T02:58:28.991781] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-28T02:58:29.154924] [DEBUG] [LOCAL ] XYL: Loaded 48777 existing records from primary storage. [2025-09-28T02:58:29.292110] [INFO ] [MAIN ] XYL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:29.344868] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XYL took 1.0s. Estimated remaining: 8.5s. Rate: 190.6 symbols/min [2025-09-28T02:58:29.650059] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:29.775803] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-28T02:58:29.811817] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-28T02:58:29.817283] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-28T02:58:29.832639] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-28T02:58:29.852302] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-28T02:58:29.878179] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-28T02:58:29.940246] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:29.946371] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-28T02:58:29.975147] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. WTM took 6.2s. Estimated remaining: 8.2s. Rate: 190.5 symbols/min [2025-09-28T02:58:29.981826] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-28T02:58:30.032817] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-28T02:58:30.132095] [DEBUG] [LOCAL ] YALA: Loaded 37892 existing records from primary storage. [2025-09-28T02:58:30.151732] [INFO ] [MAIN ] YALA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:30.178426] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. YALA took 1.2s. Estimated remaining: 7.9s. Rate: 190.5 symbols/min [2025-09-28T02:58:30.239554] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-28T02:58:30.262370] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:30.308177] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-28T02:58:30.310235] [DEBUG] [LOCAL ] YELP: Loaded 45909 existing records from primary storage. [2025-09-28T02:58:30.320724] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-28T02:58:30.336881] [INFO ] [MAIN ] YELP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:30.364389] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-09-28T02:58:30.369503] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-28T02:58:30.369319] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YELP took 1.0s. Estimated remaining: 7.6s. Rate: 190.6 symbols/min [2025-09-28T02:58:30.369799] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-28T02:58:30.376226] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-28T02:58:30.417922] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-28T02:58:30.456136] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-28T02:58:30.487434] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. XYZ took 1.8s. Estimated remaining: 7.2s. Rate: 190.6 symbols/min [2025-09-28T02:58:30.518110] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:30.774228] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:30.831495] [DEBUG] [LOCAL ] YETI: Loaded 53216 existing records from primary storage. [2025-09-28T02:58:30.883482] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:30.883831] [INFO ] [MAIN ] YETI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:30.884526] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YETI took 0.9s. Estimated remaining: 6.9s. Rate: 190.6 symbols/min [2025-09-28T02:58:31.014214] [DEBUG] [LOCAL ] YEXT: Loaded 43863 existing records from primary storage. [2025-09-28T02:58:31.018864] [INFO ] [MAIN ] YEXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:31.019097] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YEXT took 0.8s. Estimated remaining: 6.6s. Rate: 190.6 symbols/min [2025-09-28T02:58:31.165685] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:31.265117] [DEBUG] [LOCAL ] YMM: Loaded 53425 existing records from primary storage. [2025-09-28T02:58:31.333782] [INFO ] [MAIN ] YMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:31.354458] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:31.354689] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YMM took 1.0s. Estimated remaining: 6.3s. Rate: 190.6 symbols/min [2025-09-28T02:58:31.356115] [DEBUG] [LOCAL ] YOU: Loaded 50504 existing records from primary storage. [2025-09-28T02:58:31.357314] [INFO ] [MAIN ] YOU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:31.373956] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YOU took 0.9s. Estimated remaining: 6.0s. Rate: 190.7 symbols/min [2025-09-28T02:58:31.644979] [DEBUG] [LOCAL ] YRD: Loaded 12726 existing records from primary storage. [2025-09-28T02:58:31.673582] [INFO ] [MAIN ] YRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:31.701419] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YRD took 0.7s. Estimated remaining: 5.7s. Rate: 190.7 symbols/min [2025-09-28T02:58:31.731955] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:31.784633] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:31.881583] [DEBUG] [LOCAL ] YPF: Loaded 51252 existing records from primary storage. [2025-09-28T02:58:31.905718] [INFO ] [MAIN ] YPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:31.917677] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YPF took 1.0s. Estimated remaining: 5.3s. Rate: 190.7 symbols/min [2025-09-28T02:58:32.076459] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:32.150015] [DEBUG] [LOCAL ] YSG: Loaded 25485 existing records from primary storage. [2025-09-28T02:58:32.201148] [INFO ] [MAIN ] YSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:32.227288] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YSG took 0.9s. Estimated remaining: 5.0s. Rate: 190.7 symbols/min [2025-09-28T02:58:32.228674] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:32.355884] [DEBUG] [LOCAL ] YUM: Loaded 51931 existing records from primary storage. [2025-09-28T02:58:32.361396] [INFO ] [MAIN ] YUM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:32.362446] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. YUM took 1.0s. Estimated remaining: 4.7s. Rate: 190.8 symbols/min [2025-09-28T02:58:32.539705] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:32.616253] [DEBUG] [LOCAL ] YUMC: Loaded 53455 existing records from primary storage. [2025-09-28T02:58:32.662932] [INFO ] [MAIN ] YUMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:32.715497] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. YUMC took 0.9s. Estimated remaining: 4.4s. Rate: 190.8 symbols/min [2025-09-28T02:58:32.716537] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:32.718623] [DEBUG] [LOCAL ] ZBH: Loaded 51948 existing records from primary storage. [2025-09-28T02:58:32.719597] [INFO ] [MAIN ] ZBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:32.719788] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. ZBH took 0.8s. Estimated remaining: 4.1s. Rate: 190.9 symbols/min [2025-09-28T02:58:32.727237] [DEBUG] [LOCAL ] ZEPP: Loaded 17335 existing records from primary storage. [2025-09-28T02:58:32.727569] [INFO ] [MAIN ] ZEPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:32.728149] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. ZEPP took 0.5s. Estimated remaining: 3.8s. Rate: 190.9 symbols/min [2025-09-28T02:58:32.784522] [DEBUG] [LOCAL ] ZETA: Loaded 54375 existing records from primary storage. [2025-09-28T02:58:32.784974] [INFO ] [MAIN ] ZETA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:32.785093] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 0.4s. Estimated remaining: 3.5s. Rate: 191.0 symbols/min [2025-09-28T02:58:33.447340] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:33.507595] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:33.558984] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:33.583839] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:33.613662] [DEBUG] [LOCAL ] ZH: Loaded 27298 existing records from primary storage. [2025-09-28T02:58:33.614190] [INFO ] [MAIN ] ZH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:33.614638] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 0.8s. Estimated remaining: 3.1s. Rate: 190.9 symbols/min [2025-09-28T02:58:33.812747] [DEBUG] [LOCAL ] ZGN: Loaded 41333 existing records from primary storage. [2025-09-28T02:58:33.828890] [INFO ] [MAIN ] ZGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:33.857976] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZGN took 1.1s. Estimated remaining: 2.8s. Rate: 190.9 symbols/min [2025-09-28T02:58:33.885153] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:33.880545] [DEBUG] [LOCAL ] ZIP: Loaded 44952 existing records from primary storage. [2025-09-28T02:58:33.933331] [INFO ] [MAIN ] ZIP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:33.944803] [DEBUG] [LOCAL ] ZIM: Loaded 54298 existing records from primary storage. [2025-09-28T02:58:33.973065] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZIP took 1.2s. Estimated remaining: 2.5s. Rate: 190.9 symbols/min [2025-09-28T02:58:33.978858] [INFO ] [MAIN ] ZIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:34.007687] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 1.2s. Estimated remaining: 2.2s. Rate: 191.0 symbols/min [2025-09-28T02:58:34.237523] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:34.497458] [DEBUG] [LOCAL ] ZK: Loaded 40504 existing records from primary storage. [2025-09-28T02:58:34.533341] [DEBUG] [LOCAL ] ZKH: Loaded 8119 existing records from primary storage. [2025-09-28T02:58:34.534762] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:34.555432] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:34.556720] [INFO ] [MAIN ] ZKH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:34.557344] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZKH took 0.7s. Estimated remaining: 1.9s. Rate: 191.0 symbols/min [2025-09-28T02:58:34.552368] [INFO ] [MAIN ] ZK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:34.569847] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZK took 1.0s. Estimated remaining: 1.6s. Rate: 191.0 symbols/min [2025-09-28T02:58:34.800104] [DEBUG] [LOCAL ] ZTR: Loaded 16911 existing records from primary storage. [2025-09-28T02:58:34.800610] [INFO ] [MAIN ] ZTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:34.865198] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTR took 0.8s. Estimated remaining: 1.3s. Rate: 191.0 symbols/min [2025-09-28T02:58:34.901380] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:35.053807] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:35.065201] [DEBUG] [LOCAL ] ZTO: Loaded 50751 existing records from primary storage. [2025-09-28T02:58:35.093869] [INFO ] [MAIN ] ZTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:35.107559] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTO took 1.1s. Estimated remaining: 0.9s. Rate: 191.1 symbols/min [2025-09-28T02:58:35.196377] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-28T02:58:35.211551] [DEBUG] [LOCAL ] ZVIA: Loaded 35966 existing records from primary storage. [2025-09-28T02:58:35.212110] [INFO ] [MAIN ] ZVIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:35.212215] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZVIA took 0.6s. Estimated remaining: 0.6s. Rate: 191.1 symbols/min [2025-09-28T02:58:35.271574] [DEBUG] [LOCAL ] ZTS: Loaded 53775 existing records from primary storage. [2025-09-28T02:58:35.272102] [INFO ] [MAIN ] ZTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:35.272207] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZTS took 0.7s. Estimated remaining: 0.3s. Rate: 191.2 symbols/min [2025-09-28T02:58:35.288386] [DEBUG] [LOCAL ] ZWS: Loaded 43134 existing records from primary storage. [2025-09-28T02:58:35.288796] [INFO ] [MAIN ] ZWS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-28T02:58:35.288978] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZWS took 0.4s. Estimated remaining: 0.0s. Rate: 191.2 symbols/min [2025-09-28T02:58:35.290364] [INFO ] [MAIN ] Parallel update completed in 12m 24s [2025-09-28T02:58:35.290504] [WARN ] [MAIN ] Failed symbols (160): AAMI, AAUC, AAM, AD, AEXA, AHL, AII, AKA, AMBQ, AMRZ... [2025-09-28T02:58:35.290584] [INFO ] [MAIN ] Update success rate: 93.3% (2211/2371 symbols) [2025-09-28T02:58:35.986089] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2211/2371 @ 93.25%)' [2025-09-28T02:58:35.987237] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-28T02:58:35.987533] [INFO ] [STATE ] Last completion updated: 2025-09-28T02:58:35.987321 [2025-09-28T02:58:35.987820] [WARN ] [STATE ] State set to: RUNNING [2025-09-28T02:58:35.987921] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-09-28T02:58:35.987996] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-28T02:58:35.988135] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-28T02:58:35.988203] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-28T02:58:37.560746] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-28T02:58:37.560934] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-28T02:58:37.561240] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-28T02:58:37.562012] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-28T02:58:37.562091] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-28T02:58:37.562162] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-28T02:58:37.562261] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-28T02:58:37.562352] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-28T02:58:37.562449] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-28T02:58:37.562874] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-28T02:58:37.562947] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-28T02:58:37.563150] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-28T02:58:37.563221] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-28T02:58:37.563293] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-28T02:58:37.563365] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-28T02:58:37.592356] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-28T02:58:37.592804] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-28T02:58:37.592882] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-28T02:58:37.592954] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-28T02:58:37.593023] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-28T02:58:37.593121] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-28T02:58:37.593196] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-28T02:58:37.593272] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-28T02:58:37.593372] [INFO ] [LOCAL ] Deleted 0 derivative data files. [2025-09-28T02:58:37.593440] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-28T02:58:37.595717] [INFO ] [LOCAL ] Found 2211 symbols with primary data. [2025-09-28T02:58:37.596086] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2211 symbols [2025-09-28T02:58:37.596865] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:37.597445] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:37.597909] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:37.693193] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-28T02:58:37.709131] [INFO ] [MAIN ] AAP: Loaded 52789 primary data records. [2025-09-28T02:58:37.762777] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-28T02:58:37.783925] [INFO ] [MAIN ] AA: Loaded 54394 primary data records. [2025-09-28T02:58:37.783757] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-28T02:58:37.822566] [INFO ] [MAIN ] A: Loaded 51487 primary data records. [2025-09-28T02:58:38.783793] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:38.784716] [INFO ] [MAIN ] AAP: Generated 1820 derivative records from 52789 primary records. [2025-09-28T02:58:38.784908] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-28T02:58:38.809908] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:38.811258] [INFO ] [MAIN ] AA: Generated 1820 derivative records from 54394 primary records. [2025-09-28T02:58:38.823505] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-28T02:58:38.836606] [DEBUG] [LOCAL ] AAP: Derivative data saved (1820 records). [2025-09-28T02:58:38.841086] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-28T02:58:38.844513] [INFO ] [MAIN ] Derivative Progress: 1/2211 symbols completed. AAP took 1.2s. Estimated remaining: 45m 60s. Rate: 48.1 symbols/min [2025-09-28T02:58:38.845340] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:38.869714] [DEBUG] [LOCAL ] AA: Derivative data saved (1820 records). [2025-09-28T02:58:38.870468] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-28T02:58:38.874989] [INFO ] [MAIN ] Derivative Progress: 2/2211 symbols completed. AA took 1.3s. Estimated remaining: 23m 33s. Rate: 93.8 symbols/min [2025-09-28T02:58:38.870395] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:38.875221] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:38.876319] [INFO ] [MAIN ] A: Generated 1820 derivative records from 51487 primary records. [2025-09-28T02:58:38.876604] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-28T02:58:38.895510] [DEBUG] [LOCAL ] A: Derivative data saved (1820 records). [2025-09-28T02:58:38.895701] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-28T02:58:38.898885] [INFO ] [MAIN ] Derivative Progress: 3/2211 symbols completed. A took 1.3s. Estimated remaining: 15m 59s. Rate: 138.1 symbols/min [2025-09-28T02:58:38.899230] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:38.932600] [DEBUG] [LOCAL ] AAT: Loaded 31069 existing records from primary storage. [2025-09-28T02:58:38.942020] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-28T02:58:38.941465] [INFO ] [MAIN ] AAT: Loaded 31069 primary data records. [2025-09-28T02:58:38.943228] [INFO ] [MAIN ] AB: Loaded 28642 primary data records. [2025-09-28T02:58:39.448707] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-28T02:58:39.500282] [INFO ] [MAIN ] ABBV: Loaded 54465 primary data records. [2025-09-28T02:58:40.055424] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:40.058342] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:40.057383] [INFO ] [MAIN ] AB: Generated 1820 derivative records from 28642 primary records. [2025-09-28T02:58:40.060796] [INFO ] [MAIN ] AAT: Generated 1820 derivative records from 31069 primary records. [2025-09-28T02:58:40.060914] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-28T02:58:40.059767] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-28T02:58:40.093637] [DEBUG] [LOCAL ] AB: Derivative data saved (1820 records). [2025-09-28T02:58:40.096432] [DEBUG] [LOCAL ] AAT: Derivative data saved (1820 records). [2025-09-28T02:58:40.096868] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-28T02:58:40.096666] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-28T02:58:40.099875] [INFO ] [MAIN ] Derivative Progress: 4/2211 symbols completed. AAT took 1.3s. Estimated remaining: 23m 2s. Rate: 95.8 symbols/min [2025-09-28T02:58:40.100553] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:40.103698] [INFO ] [MAIN ] Derivative Progress: 5/2211 symbols completed. AB took 1.2s. Estimated remaining: 18m 26s. Rate: 119.6 symbols/min [2025-09-28T02:58:40.104544] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:40.123778] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:40.124550] [INFO ] [MAIN ] ABBV: Generated 1820 derivative records from 54465 primary records. [2025-09-28T02:58:40.124775] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-28T02:58:40.157474] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1820 records). [2025-09-28T02:58:40.157714] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-28T02:58:40.160043] [INFO ] [MAIN ] Derivative Progress: 6/2211 symbols completed. ABBV took 1.3s. Estimated remaining: 15m 42s. Rate: 140.4 symbols/min [2025-09-28T02:58:40.160334] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:40.173051] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-28T02:58:40.173403] [INFO ] [MAIN ] ABCB: Loaded 31144 primary data records. [2025-09-28T02:58:40.390144] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-28T02:58:40.390952] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-28T02:58:40.391083] [INFO ] [MAIN ] ABEV: Loaded 54055 primary data records. [2025-09-28T02:58:40.401392] [INFO ] [MAIN ] ABG: Loaded 19034 primary data records. [2025-09-28T02:58:41.225576] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:41.228411] [INFO ] [MAIN ] ABCB: Generated 1820 derivative records from 31144 primary records. [2025-09-28T02:58:41.228894] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-28T02:58:41.247721] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1820 records). [2025-09-28T02:58:41.247976] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-28T02:58:41.251271] [INFO ] [MAIN ] Derivative Progress: 7/2211 symbols completed. ABCB took 1.2s. Estimated remaining: 19m 11s. Rate: 114.9 symbols/min [2025-09-28T02:58:41.251507] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:41.270544] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:41.271453] [INFO ] [MAIN ] ABG: Generated 1820 derivative records from 19034 primary records. [2025-09-28T02:58:41.274235] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-28T02:58:41.302044] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:41.316796] [INFO ] [MAIN ] ABEV: Generated 1820 derivative records from 54055 primary records. [2025-09-28T02:58:41.315806] [DEBUG] [LOCAL ] ABG: Derivative data saved (1820 records). [2025-09-28T02:58:41.317164] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-28T02:58:41.317109] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-28T02:58:41.320026] [INFO ] [MAIN ] Derivative Progress: 8/2211 symbols completed. ABG took 1.2s. Estimated remaining: 17m 6s. Rate: 128.9 symbols/min [2025-09-28T02:58:41.320842] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:41.349064] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-28T02:58:41.349287] [INFO ] [MAIN ] ABM: Loaded 32915 primary data records. [2025-09-28T02:58:41.417918] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1820 records). [2025-09-28T02:58:41.440444] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-28T02:58:41.473174] [INFO ] [MAIN ] Derivative Progress: 9/2211 symbols completed. ABEV took 1.4s. Estimated remaining: 15m 49s. Rate: 139.3 symbols/min [2025-09-28T02:58:41.499513] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:41.719168] [DEBUG] [LOCAL ] ABR: Loaded 52817 existing records from primary storage. [2025-09-28T02:58:41.719833] [INFO ] [MAIN ] ABR: Loaded 52817 primary data records. [2025-09-28T02:58:42.129323] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-28T02:58:42.132821] [INFO ] [MAIN ] ABT: Loaded 54400 primary data records. [2025-09-28T02:58:42.241281] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:42.271187] [INFO ] [MAIN ] ABM: Generated 1820 derivative records from 32915 primary records. [2025-09-28T02:58:42.271408] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-28T02:58:42.388920] [DEBUG] [LOCAL ] ABM: Derivative data saved (1820 records). [2025-09-28T02:58:42.507013] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-28T02:58:42.518562] [INFO ] [MAIN ] Derivative Progress: 10/2211 symbols completed. ABM took 1.3s. Estimated remaining: 18m 3s. Rate: 121.9 symbols/min [2025-09-28T02:58:42.519177] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:42.539026] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:42.540699] [INFO ] [MAIN ] ABR: Generated 1820 derivative records from 52817 primary records. [2025-09-28T02:58:42.541063] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-28T02:58:42.566334] [DEBUG] [LOCAL ] ABR: Derivative data saved (1820 records). [2025-09-28T02:58:42.567010] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-28T02:58:42.569107] [INFO ] [MAIN ] Derivative Progress: 11/2211 symbols completed. ABR took 1.2s. Estimated remaining: 16m 35s. Rate: 132.7 symbols/min [2025-09-28T02:58:42.569316] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:42.586109] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-28T02:58:42.587347] [INFO ] [MAIN ] ACA: Loaded 24034 primary data records. [2025-09-28T02:58:42.658978] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:42.699954] [INFO ] [MAIN ] ABT: Generated 1820 derivative records from 54400 primary records. [2025-09-28T02:58:42.725613] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-28T02:58:42.966135] [DEBUG] [LOCAL ] ABT: Derivative data saved (1820 records). [2025-09-28T02:58:42.965567] [DEBUG] [LOCAL ] ACCO: Loaded 38214 existing records from primary storage. [2025-09-28T02:58:42.966457] [INFO ] [MAIN ] ACCO: Loaded 38214 primary data records. [2025-09-28T02:58:42.966376] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-28T02:58:42.974536] [INFO ] [MAIN ] Derivative Progress: 12/2211 symbols completed. ABT took 1.5s. Estimated remaining: 16m 26s. Rate: 133.9 symbols/min [2025-09-28T02:58:43.017161] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:43.315780] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-28T02:58:43.319779] [INFO ] [MAIN ] ACEL: Loaded 27405 primary data records. [2025-09-28T02:58:43.392815] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:43.421498] [INFO ] [MAIN ] ACA: Generated 1820 derivative records from 24034 primary records. [2025-09-28T02:58:43.442218] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-28T02:58:43.661254] [DEBUG] [LOCAL ] ACA: Derivative data saved (1820 records). [2025-09-28T02:58:43.671922] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-28T02:58:43.675524] [INFO ] [MAIN ] Derivative Progress: 13/2211 symbols completed. ACA took 1.2s. Estimated remaining: 17m 8s. Rate: 128.3 symbols/min [2025-09-28T02:58:43.692726] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:43.693982] [INFO ] [MAIN ] ACCO: Generated 1820 derivative records from 38214 primary records. [2025-09-28T02:58:43.694402] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-28T02:58:43.711373] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1820 records). [2025-09-28T02:58:43.711674] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-28T02:58:43.713923] [INFO ] [MAIN ] Derivative Progress: 14/2211 symbols completed. ACCO took 1.1s. Estimated remaining: 16m 0s. Rate: 137.3 symbols/min [2025-09-28T02:58:43.730298] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:43.730913] [INFO ] [MAIN ] ACEL: Generated 1820 derivative records from 27405 primary records. [2025-09-28T02:58:43.730997] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-28T02:58:43.746504] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1820 records). [2025-09-28T02:58:43.746592] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-28T02:58:43.749376] [INFO ] [MAIN ] Derivative Progress: 15/2211 symbols completed. ACEL took 0.7s. Estimated remaining: 15m 1s. Rate: 146.3 symbols/min [2025-09-28T02:58:43.749885] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:43.749808] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:43.749956] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:43.819866] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-28T02:58:43.820236] [INFO ] [MAIN ] ACM: Loaded 43767 primary data records. [2025-09-28T02:58:43.987823] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-28T02:58:43.989407] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-28T02:58:43.989730] [INFO ] [MAIN ] ACHR: Loaded 54598 primary data records. [2025-09-28T02:58:43.989948] [INFO ] [MAIN ] ACI: Loaded 54044 primary data records. [2025-09-28T02:58:44.922442] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:44.924876] [INFO ] [MAIN ] ACM: Generated 1820 derivative records from 43767 primary records. [2025-09-28T02:58:44.926013] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-28T02:58:44.961618] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:44.966489] [INFO ] [MAIN ] ACI: Generated 1820 derivative records from 54044 primary records. [2025-09-28T02:58:44.968100] [DEBUG] [LOCAL ] ACM: Derivative data saved (1820 records). [2025-09-28T02:58:44.966787] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-28T02:58:44.968510] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-28T02:58:44.973001] [INFO ] [MAIN ] Derivative Progress: 16/2211 symbols completed. ACM took 1.2s. Estimated remaining: 16m 52s. Rate: 130.1 symbols/min [2025-09-28T02:58:44.983606] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:44.999574] [DEBUG] [LOCAL ] ACI: Derivative data saved (1820 records). [2025-09-28T02:58:45.000003] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-28T02:58:45.003626] [INFO ] [MAIN ] Derivative Progress: 17/2211 symbols completed. ACI took 1.3s. Estimated remaining: 15m 56s. Rate: 137.7 symbols/min [2025-09-28T02:58:45.017184] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:45.018129] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:45.019370] [INFO ] [MAIN ] ACHR: Generated 1820 derivative records from 54598 primary records. [2025-09-28T02:58:45.019755] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-28T02:58:45.041846] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1820 records). [2025-09-28T02:58:45.042011] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-28T02:58:45.044370] [INFO ] [MAIN ] Derivative Progress: 18/2211 symbols completed. ACHR took 1.3s. Estimated remaining: 15m 7s. Rate: 145.0 symbols/min [2025-09-28T02:58:45.044807] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:45.079454] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-28T02:58:45.079683] [INFO ] [MAIN ] ACR: Loaded 6352 primary data records. [2025-09-28T02:58:45.215186] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-28T02:58:45.229268] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-28T02:58:45.231386] [INFO ] [MAIN ] ACP: Loaded 31428 primary data records. [2025-09-28T02:58:45.242000] [INFO ] [MAIN ] ACN: Loaded 54204 primary data records. [2025-09-28T02:58:46.138603] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:46.140182] [INFO ] [MAIN ] ACR: Generated 1820 derivative records from 6352 primary records. [2025-09-28T02:58:46.140583] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-28T02:58:46.160430] [DEBUG] [LOCAL ] ACR: Derivative data saved (1820 records). [2025-09-28T02:58:46.160600] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-28T02:58:46.162996] [INFO ] [MAIN ] Derivative Progress: 19/2211 symbols completed. ACR took 1.1s. Estimated remaining: 16m 28s. Rate: 133.1 symbols/min [2025-09-28T02:58:46.164062] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:46.195497] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:46.195979] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:46.197474] [INFO ] [MAIN ] ACP: Generated 1820 derivative records from 31428 primary records. [2025-09-28T02:58:46.197735] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-28T02:58:46.199368] [INFO ] [MAIN ] ACN: Generated 1820 derivative records from 54204 primary records. [2025-09-28T02:58:46.199572] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-28T02:58:46.230190] [DEBUG] [LOCAL ] ACN: Derivative data saved (1820 records). [2025-09-28T02:58:46.231159] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-28T02:58:46.236218] [INFO ] [MAIN ] Derivative Progress: 20/2211 symbols completed. ACN took 1.3s. Estimated remaining: 15m 47s. Rate: 138.9 symbols/min [2025-09-28T02:58:46.236786] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:46.237940] [DEBUG] [LOCAL ] ACP: Derivative data saved (1820 records). [2025-09-28T02:58:46.238484] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-28T02:58:46.240795] [INFO ] [MAIN ] Derivative Progress: 21/2211 symbols completed. ACP took 1.2s. Estimated remaining: 15m 2s. Rate: 145.7 symbols/min [2025-09-28T02:58:46.241220] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:46.251119] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-28T02:58:46.259766] [INFO ] [MAIN ] ACV: Loaded 7095 primary data records. [2025-09-28T02:58:46.410333] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-28T02:58:46.439472] [INFO ] [MAIN ] ACRE: Loaded 34027 primary data records. [2025-09-28T02:58:46.774379] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-28T02:58:46.775705] [INFO ] [MAIN ] ACVA: Loaded 50072 primary data records. [2025-09-28T02:58:47.341513] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:47.343142] [INFO ] [MAIN ] ACV: Generated 1820 derivative records from 7095 primary records. [2025-09-28T02:58:47.345016] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-28T02:58:47.381459] [DEBUG] [LOCAL ] ACV: Derivative data saved (1820 records). [2025-09-28T02:58:47.382151] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:47.381889] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-28T02:58:47.383240] [INFO ] [MAIN ] ACRE: Generated 1820 derivative records from 34027 primary records. [2025-09-28T02:58:47.386780] [INFO ] [MAIN ] Derivative Progress: 22/2211 symbols completed. ACV took 1.1s. Estimated remaining: 16m 14s. Rate: 134.8 symbols/min [2025-09-28T02:58:47.386936] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-28T02:58:47.387099] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:47.410350] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1820 records). [2025-09-28T02:58:47.423336] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-28T02:58:47.423755] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:47.428057] [INFO ] [MAIN ] ACVA: Generated 1820 derivative records from 50072 primary records. [2025-09-28T02:58:47.427889] [INFO ] [MAIN ] Derivative Progress: 23/2211 symbols completed. ACRE took 1.3s. Estimated remaining: 15m 35s. Rate: 140.4 symbols/min [2025-09-28T02:58:47.428373] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:47.428274] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-28T02:58:47.451693] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1820 records). [2025-09-28T02:58:47.452075] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-28T02:58:47.455996] [INFO ] [MAIN ] Derivative Progress: 24/2211 symbols completed. ACVA took 1.2s. Estimated remaining: 14m 59s. Rate: 146.0 symbols/min [2025-09-28T02:58:47.456283] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:47.504203] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-28T02:58:47.506102] [INFO ] [MAIN ] ADC: Loaded 46934 primary data records. [2025-09-28T02:58:47.578080] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-28T02:58:47.610349] [INFO ] [MAIN ] ADCT: Loaded 34670 primary data records. [2025-09-28T02:58:47.887966] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-28T02:58:48.055078] [INFO ] [MAIN ] ADM: Loaded 54175 primary data records. [2025-09-28T02:58:48.608695] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:48.611325] [INFO ] [MAIN ] ADC: Generated 1820 derivative records from 46934 primary records. [2025-09-28T02:58:48.612094] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-28T02:58:48.643907] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:48.648075] [INFO ] [MAIN ] ADCT: Generated 1820 derivative records from 34670 primary records. [2025-09-28T02:58:48.648199] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-28T02:58:48.651203] [DEBUG] [LOCAL ] ADC: Derivative data saved (1820 records). [2025-09-28T02:58:48.663697] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-28T02:58:48.669191] [INFO ] [MAIN ] Derivative Progress: 25/2211 symbols completed. ADC took 1.3s. Estimated remaining: 16m 8s. Rate: 135.5 symbols/min [2025-09-28T02:58:48.669613] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:48.672983] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1820 records). [2025-09-28T02:58:48.673510] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-28T02:58:48.676520] [INFO ] [MAIN ] Derivative Progress: 26/2211 symbols completed. ADCT took 1.2s. Estimated remaining: 15m 31s. Rate: 140.8 symbols/min [2025-09-28T02:58:48.676916] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:48.697549] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:48.698611] [INFO ] [MAIN ] ADM: Generated 1820 derivative records from 54175 primary records. [2025-09-28T02:58:48.698920] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-28T02:58:48.717464] [DEBUG] [LOCAL ] ADM: Derivative data saved (1820 records). [2025-09-28T02:58:48.717763] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-28T02:58:48.720528] [INFO ] [MAIN ] Derivative Progress: 27/2211 symbols completed. ADM took 1.3s. Estimated remaining: 14m 60s. Rate: 145.6 symbols/min [2025-09-28T02:58:48.721010] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:48.796909] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-28T02:58:48.797242] [INFO ] [MAIN ] ADT: Loaded 54253 primary data records. [2025-09-28T02:58:48.798911] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-28T02:58:48.831222] [INFO ] [MAIN ] ADNT: Loaded 48095 primary data records. [2025-09-28T02:58:48.982982] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-28T02:58:49.083716] [INFO ] [MAIN ] ADX: Loaded 28180 primary data records. [2025-09-28T02:58:49.823995] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:49.825053] [INFO ] [MAIN ] ADT: Generated 1820 derivative records from 54253 primary records. [2025-09-28T02:58:49.825273] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-28T02:58:49.847072] [DEBUG] [LOCAL ] ADT: Derivative data saved (1820 records). [2025-09-28T02:58:49.847622] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-28T02:58:49.851057] [INFO ] [MAIN ] Derivative Progress: 28/2211 symbols completed. ADT took 1.2s. Estimated remaining: 15m 55s. Rate: 137.1 symbols/min [2025-09-28T02:58:49.866414] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:49.867549] [INFO ] [MAIN ] ADNT: Generated 1820 derivative records from 48095 primary records. [2025-09-28T02:58:49.867825] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-28T02:58:49.887878] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1820 records). [2025-09-28T02:58:49.888123] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-28T02:58:49.891514] [INFO ] [MAIN ] Derivative Progress: 29/2211 symbols completed. ADNT took 1.2s. Estimated remaining: 15m 25s. Rate: 141.5 symbols/min [2025-09-28T02:58:49.904853] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:49.905606] [INFO ] [MAIN ] ADX: Generated 1820 derivative records from 28180 primary records. [2025-09-28T02:58:49.905731] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-28T02:58:49.922060] [DEBUG] [LOCAL ] ADX: Derivative data saved (1820 records). [2025-09-28T02:58:49.922196] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-28T02:58:49.924475] [INFO ] [MAIN ] Derivative Progress: 30/2211 symbols completed. ADX took 1.2s. Estimated remaining: 14m 56s. Rate: 146.0 symbols/min [2025-09-28T02:58:49.925099] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:49.925148] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:49.925209] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:49.940028] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-28T02:58:49.940430] [INFO ] [MAIN ] AEFC: Loaded 8643 primary data records. [2025-09-28T02:58:50.328235] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-28T02:58:50.330923] [INFO ] [MAIN ] AEG: Loaded 50307 primary data records. [2025-09-28T02:58:50.330591] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-28T02:58:50.332335] [INFO ] [MAIN ] AEE: Loaded 50875 primary data records. [2025-09-28T02:58:51.049368] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:51.051562] [INFO ] [MAIN ] AEFC: Generated 1820 derivative records from 8643 primary records. [2025-09-28T02:58:51.051761] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-28T02:58:51.071222] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1820 records). [2025-09-28T02:58:51.072299] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-28T02:58:51.075188] [INFO ] [MAIN ] Derivative Progress: 31/2211 symbols completed. AEFC took 1.1s. Estimated remaining: 15m 48s. Rate: 138.0 symbols/min [2025-09-28T02:58:51.075583] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:51.098307] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:51.101252] [INFO ] [MAIN ] AEG: Generated 1820 derivative records from 50307 primary records. [2025-09-28T02:58:51.101414] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-28T02:58:51.122729] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:51.128279] [INFO ] [MAIN ] AEE: Generated 1820 derivative records from 50875 primary records. [2025-09-28T02:58:51.133157] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-28T02:58:51.135006] [DEBUG] [LOCAL ] AEG: Derivative data saved (1820 records). [2025-09-28T02:58:51.136034] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-28T02:58:51.150139] [INFO ] [MAIN ] Derivative Progress: 32/2211 symbols completed. AEG took 1.2s. Estimated remaining: 15m 23s. Rate: 141.7 symbols/min [2025-09-28T02:58:51.151896] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:51.155232] [DEBUG] [LOCAL ] AEE: Derivative data saved (1820 records). [2025-09-28T02:58:51.155784] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-28T02:58:51.158734] [INFO ] [MAIN ] Derivative Progress: 33/2211 symbols completed. AEE took 1.2s. Estimated remaining: 14m 55s. Rate: 146.0 symbols/min [2025-09-28T02:58:51.160152] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:51.207737] [DEBUG] [LOCAL ] AEM: Loaded 54243 existing records from primary storage. [2025-09-28T02:58:51.207945] [INFO ] [MAIN ] AEM: Loaded 54243 primary data records. [2025-09-28T02:58:51.577304] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-28T02:58:51.578338] [INFO ] [MAIN ] AEO: Loaded 54336 primary data records. [2025-09-28T02:58:51.591802] [DEBUG] [LOCAL ] AER: Loaded 49271 existing records from primary storage. [2025-09-28T02:58:51.607433] [INFO ] [MAIN ] AER: Loaded 49271 primary data records. [2025-09-28T02:58:52.254374] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:52.255730] [INFO ] [MAIN ] AEM: Generated 1820 derivative records from 54243 primary records. [2025-09-28T02:58:52.256092] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-28T02:58:52.277059] [DEBUG] [LOCAL ] AEM: Derivative data saved (1820 records). [2025-09-28T02:58:52.277856] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-28T02:58:52.281252] [INFO ] [MAIN ] Derivative Progress: 34/2211 symbols completed. AEM took 1.2s. Estimated remaining: 15m 40s. Rate: 138.9 symbols/min [2025-09-28T02:58:52.281824] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:52.301212] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:52.302172] [INFO ] [MAIN ] AEO: Generated 1820 derivative records from 54336 primary records. [2025-09-28T02:58:52.302593] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-28T02:58:52.321276] [DEBUG] [LOCAL ] AEO: Derivative data saved (1820 records). [2025-09-28T02:58:52.322508] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-28T02:58:52.324559] [INFO ] [MAIN ] Derivative Progress: 35/2211 symbols completed. AEO took 1.2s. Estimated remaining: 15m 16s. Rate: 142.6 symbols/min [2025-09-28T02:58:52.326411] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:52.340715] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:52.341545] [INFO ] [MAIN ] AER: Generated 1820 derivative records from 49271 primary records. [2025-09-28T02:58:52.341676] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-28T02:58:52.373891] [DEBUG] [LOCAL ] AER: Derivative data saved (1820 records). [2025-09-28T02:58:52.374065] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-28T02:58:52.378074] [INFO ] [MAIN ] Derivative Progress: 36/2211 symbols completed. AER took 1.2s. Estimated remaining: 14m 53s. Rate: 146.1 symbols/min [2025-09-28T02:58:52.378498] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:52.413529] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-28T02:58:52.416889] [INFO ] [MAIN ] AES: Loaded 54450 primary data records. [2025-09-28T02:58:52.483560] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-28T02:58:52.538269] [INFO ] [MAIN ] AFB: Loaded 11422 primary data records. [2025-09-28T02:58:52.547699] [DEBUG] [LOCAL ] AESI: Loaded 50213 existing records from primary storage. [2025-09-28T02:58:52.557545] [INFO ] [MAIN ] AESI: Loaded 50213 primary data records. [2025-09-28T02:58:53.510296] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:53.513688] [INFO ] [MAIN ] AES: Generated 1820 derivative records from 54450 primary records. [2025-09-28T02:58:53.513887] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-28T02:58:53.541278] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:53.545514] [INFO ] [MAIN ] AFB: Generated 1820 derivative records from 11422 primary records. [2025-09-28T02:58:53.545677] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-28T02:58:53.548711] [DEBUG] [LOCAL ] AES: Derivative data saved (1820 records). [2025-09-28T02:58:53.551615] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-28T02:58:53.562555] [INFO ] [MAIN ] Derivative Progress: 37/2211 symbols completed. AES took 1.3s. Estimated remaining: 15m 38s. Rate: 139.0 symbols/min [2025-09-28T02:58:53.565793] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:53.581986] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:53.583528] [INFO ] [MAIN ] AESI: Generated 1820 derivative records from 50213 primary records. [2025-09-28T02:58:53.585633] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-28T02:58:53.585180] [DEBUG] [LOCAL ] AFB: Derivative data saved (1820 records). [2025-09-28T02:58:53.586210] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-28T02:58:53.588748] [INFO ] [MAIN ] Derivative Progress: 38/2211 symbols completed. AFB took 1.2s. Estimated remaining: 15m 15s. Rate: 142.6 symbols/min [2025-09-28T02:58:53.588944] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:53.606933] [DEBUG] [LOCAL ] AESI: Derivative data saved (1820 records). [2025-09-28T02:58:53.609499] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-28T02:58:53.610189] [INFO ] [MAIN ] AFGB: Loaded 2404 primary data records. [2025-09-28T02:58:53.610067] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-28T02:58:53.626107] [INFO ] [MAIN ] Derivative Progress: 39/2211 symbols completed. AESI took 1.3s. Estimated remaining: 14m 53s. Rate: 146.0 symbols/min [2025-09-28T02:58:53.661092] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:53.741879] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-28T02:58:53.749158] [INFO ] [MAIN ] AFGC: Loaded 2602 primary data records. [2025-09-28T02:58:53.846690] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-28T02:58:54.043554] [INFO ] [MAIN ] AFG: Loaded 33021 primary data records. [2025-09-28T02:58:54.705712] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:54.708804] [INFO ] [MAIN ] AFGB: Generated 1820 derivative records from 2404 primary records. [2025-09-28T02:58:54.710939] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-28T02:58:54.742355] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-28T02:58:54.754675] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1820 records). [2025-09-28T02:58:54.753956] [INFO ] [MAIN ] AFGC: Generated 1819 derivative records from 2602 primary records. [2025-09-28T02:58:54.755229] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-28T02:58:54.755328] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-28T02:58:54.759708] [INFO ] [MAIN ] Derivative Progress: 40/2211 symbols completed. AFGB took 1.2s. Estimated remaining: 15m 32s. Rate: 139.8 symbols/min [2025-09-28T02:58:54.767220] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:54.789981] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1819 records). [2025-09-28T02:58:54.804136] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-28T02:58:54.805144] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:54.808318] [INFO ] [MAIN ] Derivative Progress: 41/2211 symbols completed. AFGC took 1.1s. Estimated remaining: 15m 11s. Rate: 142.9 symbols/min [2025-09-28T02:58:54.814013] [INFO ] [MAIN ] AFG: Generated 1820 derivative records from 33021 primary records. [2025-09-28T02:58:54.812464] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-28T02:58:54.814457] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:54.814672] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-28T02:58:54.815571] [INFO ] [MAIN ] AFGD: Loaded 1859 primary data records. [2025-09-28T02:58:54.889934] [DEBUG] [LOCAL ] AFGE: Loaded 2512 existing records from primary storage. [2025-09-28T02:58:54.914238] [INFO ] [MAIN ] AFGE: Loaded 2512 primary data records. [2025-09-28T02:58:55.114944] [DEBUG] [LOCAL ] AFG: Derivative data saved (1820 records). [2025-09-28T02:58:55.161610] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-28T02:58:55.184622] [INFO ] [MAIN ] Derivative Progress: 42/2211 symbols completed. AFG took 1.6s. Estimated remaining: 15m 8s. Rate: 143.3 symbols/min [2025-09-28T02:58:55.209482] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:55.715785] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-28T02:58:55.716929] [INFO ] [MAIN ] AFGD: Generated 1818 derivative records from 1859 primary records. [2025-09-28T02:58:55.717124] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-28T02:58:55.767285] [DEBUG] [LOCAL ] AFL: Loaded 53915 existing records from primary storage. [2025-09-28T02:58:55.769820] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1818 records). [2025-09-28T02:58:55.770068] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-28T02:58:55.768888] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:55.769992] [INFO ] [MAIN ] AFL: Loaded 53915 primary data records. [2025-09-28T02:58:55.772437] [INFO ] [MAIN ] Derivative Progress: 43/2211 symbols completed. AFGD took 1.0s. Estimated remaining: 15m 16s. Rate: 141.9 symbols/min [2025-09-28T02:58:55.773540] [INFO ] [MAIN ] AFGE: Generated 1820 derivative records from 2512 primary records. [2025-09-28T02:58:55.821504] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-28T02:58:55.981271] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1820 records). [2025-09-28T02:58:56.106170] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-28T02:58:56.109523] [INFO ] [MAIN ] Derivative Progress: 44/2211 symbols completed. AFGE took 1.3s. Estimated remaining: 15m 12s. Rate: 142.6 symbols/min [2025-09-28T02:58:56.138441] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:56.139277] [INFO ] [MAIN ] AFL: Generated 1820 derivative records from 53915 primary records. [2025-09-28T02:58:56.139368] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-28T02:58:56.156097] [DEBUG] [LOCAL ] AFL: Derivative data saved (1820 records). [2025-09-28T02:58:56.156246] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-28T02:58:56.160835] [INFO ] [MAIN ] Derivative Progress: 45/2211 symbols completed. AFL took 1.0s. Estimated remaining: 14m 54s. Rate: 145.4 symbols/min [2025-09-28T02:58:56.161752] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:56.161887] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:56.161588] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:56.194883] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-28T02:58:56.195128] [INFO ] [MAIN ] AGD: Loaded 17937 primary data records. [2025-09-28T02:58:56.423373] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-28T02:58:56.566565] [INFO ] [MAIN ] AGCO: Loaded 43086 primary data records. [2025-09-28T02:58:56.573690] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-28T02:58:56.595424] [INFO ] [MAIN ] AG: Loaded 54423 primary data records. [2025-09-28T02:58:57.284565] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:57.286671] [INFO ] [MAIN ] AGD: Generated 1820 derivative records from 17937 primary records. [2025-09-28T02:58:57.287614] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-28T02:58:57.307886] [DEBUG] [LOCAL ] AGD: Derivative data saved (1820 records). [2025-09-28T02:58:57.308368] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-28T02:58:57.311603] [INFO ] [MAIN ] Derivative Progress: 46/2211 symbols completed. AGD took 1.1s. Estimated remaining: 15m 28s. Rate: 140.0 symbols/min [2025-09-28T02:58:57.312746] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:57.335612] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:57.345037] [INFO ] [MAIN ] AGCO: Generated 1820 derivative records from 43086 primary records. [2025-09-28T02:58:57.350237] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:57.351054] [INFO ] [MAIN ] AG: Generated 1820 derivative records from 54423 primary records. [2025-09-28T02:58:57.351138] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-28T02:58:57.351727] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-28T02:58:57.385348] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1820 records). [2025-09-28T02:58:57.387741] [DEBUG] [LOCAL ] AG: Derivative data saved (1820 records). [2025-09-28T02:58:57.387911] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-28T02:58:57.388029] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-28T02:58:57.390333] [INFO ] [MAIN ] Derivative Progress: 47/2211 symbols completed. AGCO took 1.2s. Estimated remaining: 15m 11s. Rate: 142.5 symbols/min [2025-09-28T02:58:57.393870] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:57.393980] [INFO ] [MAIN ] Derivative Progress: 48/2211 symbols completed. AG took 1.2s. Estimated remaining: 14m 52s. Rate: 145.5 symbols/min [2025-09-28T02:58:57.394756] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:57.444376] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-28T02:58:57.438933] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-28T02:58:57.444579] [INFO ] [MAIN ] AGM: Loaded 10125 primary data records. [2025-09-28T02:58:57.444793] [INFO ] [MAIN ] AGI: Loaded 54195 primary data records. [2025-09-28T02:58:57.831437] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-28T02:58:57.910574] [INFO ] [MAIN ] AGL: Loaded 53191 primary data records. [2025-09-28T02:58:58.560487] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:58.555089] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:58.562299] [INFO ] [MAIN ] AGI: Generated 1820 derivative records from 54195 primary records. [2025-09-28T02:58:58.561562] [INFO ] [MAIN ] AGM: Generated 1820 derivative records from 10125 primary records. [2025-09-28T02:58:58.563612] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-28T02:58:58.563815] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-28T02:58:58.595438] [DEBUG] [LOCAL ] AGI: Derivative data saved (1820 records). [2025-09-28T02:58:58.596833] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-28T02:58:58.599521] [INFO ] [MAIN ] Derivative Progress: 49/2211 symbols completed. AGI took 1.3s. Estimated remaining: 15m 27s. Rate: 140.0 symbols/min [2025-09-28T02:58:58.600138] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:58.603438] [DEBUG] [LOCAL ] AGM: Derivative data saved (1820 records). [2025-09-28T02:58:58.604373] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-28T02:58:58.606682] [INFO ] [MAIN ] Derivative Progress: 50/2211 symbols completed. AGM took 1.2s. Estimated remaining: 15m 8s. Rate: 142.8 symbols/min [2025-09-28T02:58:58.607186] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:58.622473] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:58.623354] [INFO ] [MAIN ] AGL: Generated 1820 derivative records from 53191 primary records. [2025-09-28T02:58:58.623486] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-28T02:58:58.644098] [DEBUG] [LOCAL ] AGL: Derivative data saved (1820 records). [2025-09-28T02:58:58.652406] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-28T02:58:58.655235] [INFO ] [MAIN ] Derivative Progress: 51/2211 symbols completed. AGL took 1.3s. Estimated remaining: 14m 52s. Rate: 145.3 symbols/min [2025-09-28T02:58:58.655785] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:58.677458] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-28T02:58:58.687661] [INFO ] [MAIN ] AGO: Loaded 28356 primary data records. [2025-09-28T02:58:58.688287] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-28T02:58:58.693762] [INFO ] [MAIN ] AGRO: Loaded 34097 primary data records. [2025-09-28T02:58:59.084790] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-28T02:58:59.197184] [INFO ] [MAIN ] AGX: Loaded 33823 primary data records. [2025-09-28T02:58:59.832893] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:59.835270] [INFO ] [MAIN ] AGO: Generated 1820 derivative records from 28356 primary records. [2025-09-28T02:58:59.835444] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-28T02:58:59.862011] [DEBUG] [LOCAL ] AGO: Derivative data saved (1820 records). [2025-09-28T02:58:59.862726] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-28T02:58:59.878356] [INFO ] [MAIN ] Derivative Progress: 52/2211 symbols completed. AGO took 1.3s. Estimated remaining: 15m 25s. Rate: 140.0 symbols/min [2025-09-28T02:58:59.879065] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:59.880055] [INFO ] [MAIN ] AGRO: Generated 1820 derivative records from 34097 primary records. [2025-09-28T02:58:59.880385] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-28T02:58:59.880263] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:59.901695] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1820 records). [2025-09-28T02:58:59.902019] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-28T02:58:59.904754] [INFO ] [MAIN ] Derivative Progress: 53/2211 symbols completed. AGRO took 1.3s. Estimated remaining: 15m 8s. Rate: 142.5 symbols/min [2025-09-28T02:58:59.905451] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:59.920000] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:58:59.921099] [INFO ] [MAIN ] AGX: Generated 1820 derivative records from 33823 primary records. [2025-09-28T02:58:59.921244] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-28T02:58:59.941363] [DEBUG] [LOCAL ] AGX: Derivative data saved (1820 records). [2025-09-28T02:58:59.941856] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-28T02:58:59.944376] [INFO ] [MAIN ] Derivative Progress: 54/2211 symbols completed. AGX took 1.3s. Estimated remaining: 14m 53s. Rate: 145.0 symbols/min [2025-09-28T02:58:59.944607] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:58:59.972864] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-28T02:58:59.973109] [INFO ] [MAIN ] AHT: Loaded 6181 primary data records. [2025-09-28T02:59:00.111582] [DEBUG] [LOCAL ] AHH: Loaded 41885 existing records from primary storage. [2025-09-28T02:59:00.118368] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-28T02:59:00.123837] [INFO ] [MAIN ] AHR: Loaded 49946 primary data records. [2025-09-28T02:59:00.118517] [INFO ] [MAIN ] AHH: Loaded 41885 primary data records. [2025-09-28T02:59:00.989466] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:00.991145] [INFO ] [MAIN ] AHT: Generated 1820 derivative records from 6181 primary records. [2025-09-28T02:59:00.991625] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-28T02:59:01.008761] [DEBUG] [LOCAL ] AHT: Derivative data saved (1820 records). [2025-09-28T02:59:01.009350] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-28T02:59:01.011870] [INFO ] [MAIN ] Derivative Progress: 55/2211 symbols completed. AHT took 1.1s. Estimated remaining: 15m 18s. Rate: 140.9 symbols/min [2025-09-28T02:59:01.012139] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:01.044201] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:01.043831] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:01.045036] [INFO ] [MAIN ] AHR: Generated 1820 derivative records from 49946 primary records. [2025-09-28T02:59:01.045721] [INFO ] [MAIN ] AHH: Generated 1820 derivative records from 41885 primary records. [2025-09-28T02:59:01.046301] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-28T02:59:01.047070] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-28T02:59:01.071312] [DEBUG] [LOCAL ] AHR: Derivative data saved (1820 records). [2025-09-28T02:59:01.076781] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-28T02:59:01.078615] [DEBUG] [LOCAL ] AHH: Derivative data saved (1820 records). [2025-09-28T02:59:01.078911] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-28T02:59:01.081745] [INFO ] [MAIN ] Derivative Progress: 56/2211 symbols completed. AHH took 1.2s. Estimated remaining: 15m 4s. Rate: 143.1 symbols/min [2025-09-28T02:59:01.084754] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:01.084810] [INFO ] [MAIN ] Derivative Progress: 57/2211 symbols completed. AHR took 1.2s. Estimated remaining: 14m 48s. Rate: 145.6 symbols/min [2025-09-28T02:59:01.085655] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:01.131196] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-28T02:59:01.131562] [INFO ] [MAIN ] AIN: Loaded 24906 primary data records. [2025-09-28T02:59:01.274535] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-28T02:59:01.281259] [INFO ] [MAIN ] AI: Loaded 54529 primary data records. [2025-09-28T02:59:01.581493] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-28T02:59:01.627465] [INFO ] [MAIN ] AIG: Loaded 54254 primary data records. [2025-09-28T02:59:02.218873] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:02.224604] [INFO ] [MAIN ] AIN: Generated 1820 derivative records from 24906 primary records. [2025-09-28T02:59:02.225457] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-28T02:59:02.251016] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:02.257953] [INFO ] [MAIN ] AI: Generated 1820 derivative records from 54529 primary records. [2025-09-28T02:59:02.261472] [DEBUG] [LOCAL ] AIN: Derivative data saved (1820 records). [2025-09-28T02:59:02.261725] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-28T02:59:02.261571] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-28T02:59:02.264281] [INFO ] [MAIN ] Derivative Progress: 58/2211 symbols completed. AIN took 1.2s. Estimated remaining: 15m 16s. Rate: 141.1 symbols/min [2025-09-28T02:59:02.287687] [DEBUG] [LOCAL ] AI: Derivative data saved (1820 records). [2025-09-28T02:59:02.288229] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-28T02:59:02.301674] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:02.304447] [INFO ] [MAIN ] Derivative Progress: 59/2211 symbols completed. AI took 1.3s. Estimated remaining: 15m 1s. Rate: 143.3 symbols/min [2025-09-28T02:59:02.305853] [INFO ] [MAIN ] AIG: Generated 1820 derivative records from 54254 primary records. [2025-09-28T02:59:02.305985] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-28T02:59:02.325719] [DEBUG] [LOCAL ] AIG: Derivative data saved (1820 records). [2025-09-28T02:59:02.325958] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-28T02:59:02.329679] [INFO ] [MAIN ] Derivative Progress: 60/2211 symbols completed. AIG took 1.2s. Estimated remaining: 14m 47s. Rate: 145.5 symbols/min [2025-09-28T02:59:02.330404] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:02.330467] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:02.330526] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:02.371301] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-28T02:59:02.372255] [INFO ] [MAIN ] AIO: Loaded 13477 primary data records. [2025-09-28T02:59:02.435135] [DEBUG] [LOCAL ] AIR: Loaded 28152 existing records from primary storage. [2025-09-28T02:59:02.473238] [INFO ] [MAIN ] AIR: Loaded 28152 primary data records. [2025-09-28T02:59:02.482071] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-28T02:59:02.557543] [INFO ] [MAIN ] AIT: Loaded 28208 primary data records. [2025-09-28T02:59:03.417423] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:03.421616] [INFO ] [MAIN ] AIO: Generated 1820 derivative records from 13477 primary records. [2025-09-28T02:59:03.424304] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-28T02:59:03.452899] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:03.472430] [DEBUG] [LOCAL ] AIO: Derivative data saved (1820 records). [2025-09-28T02:59:03.472813] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-28T02:59:03.471283] [INFO ] [MAIN ] AIR: Generated 1820 derivative records from 28152 primary records. [2025-09-28T02:59:03.473015] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-28T02:59:03.475339] [INFO ] [MAIN ] Derivative Progress: 61/2211 symbols completed. AIO took 1.1s. Estimated remaining: 15m 12s. Rate: 141.4 symbols/min [2025-09-28T02:59:03.477410] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:03.476809] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:03.479334] [INFO ] [MAIN ] AIT: Generated 1820 derivative records from 28208 primary records. [2025-09-28T02:59:03.479809] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-28T02:59:03.499975] [DEBUG] [LOCAL ] AIR: Derivative data saved (1820 records). [2025-09-28T02:59:03.513013] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-28T02:59:03.518505] [INFO ] [MAIN ] Derivative Progress: 62/2211 symbols completed. AIR took 1.2s. Estimated remaining: 14m 59s. Rate: 143.5 symbols/min [2025-09-28T02:59:03.519147] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:03.520951] [DEBUG] [LOCAL ] AIT: Derivative data saved (1820 records). [2025-09-28T02:59:03.522529] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-28T02:59:03.526127] [INFO ] [MAIN ] Derivative Progress: 63/2211 symbols completed. AIT took 1.2s. Estimated remaining: 14m 44s. Rate: 145.8 symbols/min [2025-09-28T02:59:03.526513] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:03.544786] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-28T02:59:03.545208] [INFO ] [MAIN ] AIZN: Loaded 3935 primary data records. [2025-09-28T02:59:03.670052] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-28T02:59:03.689125] [INFO ] [MAIN ] AIV: Loaded 40950 primary data records. [2025-09-28T02:59:03.689693] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-28T02:59:03.716151] [INFO ] [MAIN ] AIZ: Loaded 30543 primary data records. [2025-09-28T02:59:04.617089] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:04.619098] [INFO ] [MAIN ] AIZN: Generated 1820 derivative records from 3935 primary records. [2025-09-28T02:59:04.619612] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-28T02:59:04.658304] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:04.660611] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1820 records). [2025-09-28T02:59:04.662193] [INFO ] [MAIN ] AIZ: Generated 1820 derivative records from 30543 primary records. [2025-09-28T02:59:04.662433] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-28T02:59:04.662542] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-28T02:59:04.665266] [INFO ] [MAIN ] Derivative Progress: 64/2211 symbols completed. AIZN took 1.1s. Estimated remaining: 15m 8s. Rate: 141.9 symbols/min [2025-09-28T02:59:04.666426] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:04.685710] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1820 records). [2025-09-28T02:59:04.689253] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-28T02:59:04.692320] [INFO ] [MAIN ] Derivative Progress: 65/2211 symbols completed. AIZ took 1.2s. Estimated remaining: 14m 55s. Rate: 143.9 symbols/min [2025-09-28T02:59:04.692901] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:04.707804] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:04.708554] [INFO ] [MAIN ] AIV: Generated 1820 derivative records from 40950 primary records. [2025-09-28T02:59:04.708920] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-28T02:59:04.727089] [DEBUG] [LOCAL ] AIV: Derivative data saved (1820 records). [2025-09-28T02:59:04.727507] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-28T02:59:04.730963] [INFO ] [MAIN ] Derivative Progress: 66/2211 symbols completed. AIV took 1.3s. Estimated remaining: 14m 42s. Rate: 145.9 symbols/min [2025-09-28T02:59:04.731838] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:04.775839] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-28T02:59:04.777149] [INFO ] [MAIN ] AJG: Loaded 47710 primary data records. [2025-09-28T02:59:04.893227] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-28T02:59:04.912893] [INFO ] [MAIN ] AKR: Loaded 46481 primary data records. [2025-09-28T02:59:05.087919] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-28T02:59:05.232994] [INFO ] [MAIN ] AL: Loaded 44831 primary data records. [2025-09-28T02:59:05.845666] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:05.847330] [INFO ] [MAIN ] AJG: Generated 1820 derivative records from 47710 primary records. [2025-09-28T02:59:05.847914] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-28T02:59:05.869240] [DEBUG] [LOCAL ] AJG: Derivative data saved (1820 records). [2025-09-28T02:59:05.870828] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-28T02:59:05.873300] [INFO ] [MAIN ] Derivative Progress: 67/2211 symbols completed. AJG took 1.2s. Estimated remaining: 15m 5s. Rate: 142.2 symbols/min [2025-09-28T02:59:05.873590] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:05.890382] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:05.892078] [INFO ] [MAIN ] AKR: Generated 1820 derivative records from 46481 primary records. [2025-09-28T02:59:05.892547] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-28T02:59:05.912941] [DEBUG] [LOCAL ] AKR: Derivative data saved (1820 records). [2025-09-28T02:59:05.913307] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-28T02:59:05.916240] [INFO ] [MAIN ] Derivative Progress: 68/2211 symbols completed. AKR took 1.2s. Estimated remaining: 14m 53s. Rate: 144.1 symbols/min [2025-09-28T02:59:05.930434] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:05.930951] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:05.932297] [INFO ] [MAIN ] AL: Generated 1820 derivative records from 44831 primary records. [2025-09-28T02:59:05.932527] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-28T02:59:05.952020] [DEBUG] [LOCAL ] AL: Derivative data saved (1820 records). [2025-09-28T02:59:05.952364] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-28T02:59:05.955011] [INFO ] [MAIN ] Derivative Progress: 69/2211 symbols completed. AL took 1.2s. Estimated remaining: 14m 40s. Rate: 146.0 symbols/min [2025-09-28T02:59:05.955331] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:05.994034] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-28T02:59:05.994217] [INFO ] [MAIN ] ALB: Loaded 54000 primary data records. [2025-09-28T02:59:06.341066] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-28T02:59:06.356546] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-28T02:59:06.357814] [INFO ] [MAIN ] ALC: Loaded 51537 primary data records. [2025-09-28T02:59:06.356738] [INFO ] [MAIN ] ALE: Loaded 30788 primary data records. [2025-09-28T02:59:07.030439] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:07.031800] [INFO ] [MAIN ] ALB: Generated 1820 derivative records from 54000 primary records. [2025-09-28T02:59:07.032063] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-28T02:59:07.051736] [DEBUG] [LOCAL ] ALB: Derivative data saved (1820 records). [2025-09-28T02:59:07.052301] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-28T02:59:07.055177] [INFO ] [MAIN ] Derivative Progress: 70/2211 symbols completed. ALB took 1.2s. Estimated remaining: 15m 1s. Rate: 142.6 symbols/min [2025-09-28T02:59:07.055692] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:07.078274] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:07.091515] [INFO ] [MAIN ] ALE: Generated 1820 derivative records from 30788 primary records. [2025-09-28T02:59:07.091827] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-28T02:59:07.092845] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:07.093584] [INFO ] [MAIN ] ALC: Generated 1820 derivative records from 51537 primary records. [2025-09-28T02:59:07.093720] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-28T02:59:07.134497] [DEBUG] [LOCAL ] ALC: Derivative data saved (1820 records). [2025-09-28T02:59:07.134768] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-28T02:59:07.133349] [DEBUG] [LOCAL ] ALE: Derivative data saved (1820 records). [2025-09-28T02:59:07.137209] [INFO ] [MAIN ] Derivative Progress: 71/2211 symbols completed. ALC took 1.2s. Estimated remaining: 14m 50s. Rate: 144.2 symbols/min [2025-09-28T02:59:07.137496] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:07.134914] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-28T02:59:07.140508] [INFO ] [MAIN ] Derivative Progress: 72/2211 symbols completed. ALE took 1.2s. Estimated remaining: 14m 38s. Rate: 146.2 symbols/min [2025-09-28T02:59:07.141936] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:07.155152] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-28T02:59:07.155468] [INFO ] [MAIN ] ALEX: Loaded 31769 primary data records. [2025-09-28T02:59:07.236600] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-28T02:59:07.253908] [INFO ] [MAIN ] ALG: Loaded 10562 primary data records. [2025-09-28T02:59:07.864069] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-28T02:59:07.865212] [INFO ] [MAIN ] ALIT: Loaded 53534 primary data records. [2025-09-28T02:59:08.204290] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:08.206350] [INFO ] [MAIN ] ALEX: Generated 1820 derivative records from 31769 primary records. [2025-09-28T02:59:08.206989] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-28T02:59:08.226895] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1820 records). [2025-09-28T02:59:08.227283] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-28T02:59:08.230389] [INFO ] [MAIN ] Derivative Progress: 73/2211 symbols completed. ALEX took 1.2s. Estimated remaining: 14m 57s. Rate: 143.0 symbols/min [2025-09-28T02:59:08.245361] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:08.246187] [INFO ] [MAIN ] ALG: Generated 1820 derivative records from 10562 primary records. [2025-09-28T02:59:08.246425] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-28T02:59:08.264143] [DEBUG] [LOCAL ] ALG: Derivative data saved (1820 records). [2025-09-28T02:59:08.266795] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-28T02:59:08.269314] [INFO ] [MAIN ] Derivative Progress: 74/2211 symbols completed. ALG took 1.1s. Estimated remaining: 14m 46s. Rate: 144.8 symbols/min [2025-09-28T02:59:08.282321] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:08.283072] [INFO ] [MAIN ] ALIT: Generated 1820 derivative records from 53534 primary records. [2025-09-28T02:59:08.283160] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-28T02:59:08.299088] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1820 records). [2025-09-28T02:59:08.299177] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-28T02:59:08.302278] [INFO ] [MAIN ] Derivative Progress: 75/2211 symbols completed. ALIT took 1.2s. Estimated remaining: 14m 35s. Rate: 146.5 symbols/min [2025-09-28T02:59:08.302788] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:08.302912] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:08.303637] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:08.401255] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-28T02:59:08.402711] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-28T02:59:08.414441] [INFO ] [MAIN ] ALK: Loaded 53840 primary data records. [2025-09-28T02:59:08.417472] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-28T02:59:08.416565] [INFO ] [MAIN ] ALL: Loaded 50903 primary data records. [2025-09-28T02:59:08.418001] [INFO ] [MAIN ] ALLE: Loaded 45637 primary data records. [2025-09-28T02:59:09.422343] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:09.425301] [INFO ] [MAIN ] ALK: Generated 1820 derivative records from 53840 primary records. [2025-09-28T02:59:09.426929] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-28T02:59:09.467872] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:09.468573] [DEBUG] [LOCAL ] ALK: Derivative data saved (1820 records). [2025-09-28T02:59:09.474554] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-28T02:59:09.474266] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:09.475610] [INFO ] [MAIN ] ALL: Generated 1820 derivative records from 50903 primary records. [2025-09-28T02:59:09.479855] [INFO ] [MAIN ] Derivative Progress: 76/2211 symbols completed. ALK took 1.2s. Estimated remaining: 14m 56s. Rate: 143.0 symbols/min [2025-09-28T02:59:09.480099] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:09.476573] [INFO ] [MAIN ] ALLE: Generated 1820 derivative records from 45637 primary records. [2025-09-28T02:59:09.480183] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-28T02:59:09.480553] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-28T02:59:09.513627] [DEBUG] [LOCAL ] ALL: Derivative data saved (1820 records). [2025-09-28T02:59:09.515200] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-28T02:59:09.516615] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1820 records). [2025-09-28T02:59:09.519114] [INFO ] [MAIN ] Derivative Progress: 77/2211 symbols completed. ALL took 1.2s. Estimated remaining: 14m 45s. Rate: 144.7 symbols/min [2025-09-28T02:59:09.519570] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-28T02:59:09.519805] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:09.522752] [INFO ] [MAIN ] Derivative Progress: 78/2211 symbols completed. ALLE took 1.2s. Estimated remaining: 14m 33s. Rate: 146.6 symbols/min [2025-09-28T02:59:09.523516] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:09.571597] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-28T02:59:09.571957] [INFO ] [MAIN ] ALLY: Loaded 53997 primary data records. [2025-09-28T02:59:09.728035] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-28T02:59:09.752426] [INFO ] [MAIN ] ALTG: Loaded 24161 primary data records. [2025-09-28T02:59:09.762614] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-28T02:59:09.984629] [INFO ] [MAIN ] ALSN: Loaded 43953 primary data records. [2025-09-28T02:59:10.622812] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:10.624176] [INFO ] [MAIN ] ALLY: Generated 1820 derivative records from 53997 primary records. [2025-09-28T02:59:10.625184] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-28T02:59:10.643317] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1820 records). [2025-09-28T02:59:10.644698] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-28T02:59:10.647058] [INFO ] [MAIN ] Derivative Progress: 79/2211 symbols completed. ALLY took 1.2s. Estimated remaining: 14m 52s. Rate: 143.4 symbols/min [2025-09-28T02:59:10.647632] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:10.669009] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:10.669982] [INFO ] [MAIN ] ALTG: Generated 1820 derivative records from 24161 primary records. [2025-09-28T02:59:10.670217] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-28T02:59:10.694750] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-28T02:59:10.708537] [INFO ] [MAIN ] ALUR: Loaded 10950 primary data records. [2025-09-28T02:59:10.709346] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:10.722144] [INFO ] [MAIN ] ALSN: Generated 1820 derivative records from 43953 primary records. [2025-09-28T02:59:10.733133] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1820 records). [2025-09-28T02:59:10.733203] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-28T02:59:10.757996] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-28T02:59:10.760745] [INFO ] [MAIN ] Derivative Progress: 80/2211 symbols completed. ALTG took 1.2s. Estimated remaining: 14m 43s. Rate: 144.7 symbols/min [2025-09-28T02:59:10.780957] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:10.835944] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1820 records). [2025-09-28T02:59:10.840947] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-28T02:59:10.843547] [INFO ] [MAIN ] Derivative Progress: 81/2211 symbols completed. ALSN took 1.3s. Estimated remaining: 14m 34s. Rate: 146.2 symbols/min [2025-09-28T02:59:10.855045] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:11.065502] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-28T02:59:11.065838] [INFO ] [MAIN ] ALX: Loaded 6121 primary data records. [2025-09-28T02:59:11.419999] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-28T02:59:11.421931] [INFO ] [MAIN ] ALV: Loaded 43217 primary data records. [2025-09-28T02:59:11.610730] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:11.752452] [INFO ] [MAIN ] ALUR: Generated 1820 derivative records from 10950 primary records. [2025-09-28T02:59:11.753845] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-28T02:59:11.776437] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1820 records). [2025-09-28T02:59:11.778257] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-28T02:59:11.781502] [INFO ] [MAIN ] Derivative Progress: 82/2211 symbols completed. ALUR took 1.1s. Estimated remaining: 14m 48s. Rate: 143.9 symbols/min [2025-09-28T02:59:11.781920] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:11.796999] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:11.798020] [INFO ] [MAIN ] ALX: Generated 1820 derivative records from 6121 primary records. [2025-09-28T02:59:11.798139] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-28T02:59:11.820963] [DEBUG] [LOCAL ] ALX: Derivative data saved (1820 records). [2025-09-28T02:59:11.821314] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-28T02:59:11.823905] [INFO ] [MAIN ] Derivative Progress: 83/2211 symbols completed. ALX took 1.0s. Estimated remaining: 14m 38s. Rate: 145.5 symbols/min [2025-09-28T02:59:11.824540] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:11.843807] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:11.844980] [INFO ] [MAIN ] ALV: Generated 1820 derivative records from 43217 primary records. [2025-09-28T02:59:11.845499] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-28T02:59:11.878996] [DEBUG] [LOCAL ] ALV: Derivative data saved (1820 records). [2025-09-28T02:59:11.879191] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-28T02:59:11.881860] [INFO ] [MAIN ] Derivative Progress: 84/2211 symbols completed. ALV took 1.1s. Estimated remaining: 14m 28s. Rate: 147.0 symbols/min [2025-09-28T02:59:11.882345] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:11.923048] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-28T02:59:11.924936] [INFO ] [MAIN ] AMBC: Loaded 37453 primary data records. [2025-09-28T02:59:11.924765] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-28T02:59:11.937457] [INFO ] [MAIN ] AM: Loaded 52887 primary data records. [2025-09-28T02:59:12.624409] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-28T02:59:12.624794] [INFO ] [MAIN ] AMBP: Loaded 45863 primary data records. [2025-09-28T02:59:13.002704] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:13.004749] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:13.004339] [INFO ] [MAIN ] AMBC: Generated 1820 derivative records from 37453 primary records. [2025-09-28T02:59:13.005765] [INFO ] [MAIN ] AM: Generated 1820 derivative records from 52887 primary records. [2025-09-28T02:59:13.005007] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-28T02:59:13.006136] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-28T02:59:13.038440] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1820 records). [2025-09-28T02:59:13.041932] [DEBUG] [LOCAL ] AM: Derivative data saved (1820 records). [2025-09-28T02:59:13.042131] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-28T02:59:13.042739] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-28T02:59:13.044754] [INFO ] [MAIN ] Derivative Progress: 85/2211 symbols completed. AMBC took 1.2s. Estimated remaining: 14m 47s. Rate: 143.9 symbols/min [2025-09-28T02:59:13.048407] [INFO ] [MAIN ] Derivative Progress: 86/2211 symbols completed. AM took 1.3s. Estimated remaining: 14m 36s. Rate: 145.5 symbols/min [2025-09-28T02:59:13.048139] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:13.048595] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:13.067614] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:13.068357] [INFO ] [MAIN ] AMBP: Generated 1820 derivative records from 45863 primary records. [2025-09-28T02:59:13.068445] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-28T02:59:13.085515] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1820 records). [2025-09-28T02:59:13.085813] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-28T02:59:13.088615] [INFO ] [MAIN ] Derivative Progress: 87/2211 symbols completed. AMBP took 1.2s. Estimated remaining: 14m 27s. Rate: 147.1 symbols/min [2025-09-28T02:59:13.088982] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:13.144921] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-28T02:59:13.148051] [INFO ] [MAIN ] AMC: Loaded 54539 primary data records. [2025-09-28T02:59:13.248701] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-28T02:59:13.272012] [INFO ] [MAIN ] AMCR: Loaded 54449 primary data records. [2025-09-28T02:59:13.612934] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-28T02:59:13.640507] [INFO ] [MAIN ] AME: Loaded 49252 primary data records. [2025-09-28T02:59:14.213996] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:14.216835] [INFO ] [MAIN ] AMC: Generated 1820 derivative records from 54539 primary records. [2025-09-28T02:59:14.218449] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-28T02:59:14.246050] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:14.249392] [INFO ] [MAIN ] AMCR: Generated 1820 derivative records from 54449 primary records. [2025-09-28T02:59:14.249758] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-28T02:59:14.253396] [DEBUG] [LOCAL ] AMC: Derivative data saved (1820 records). [2025-09-28T02:59:14.262352] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-28T02:59:14.264429] [INFO ] [MAIN ] Derivative Progress: 88/2211 symbols completed. AMC took 1.2s. Estimated remaining: 14m 45s. Rate: 144.0 symbols/min [2025-09-28T02:59:14.272823] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1820 records). [2025-09-28T02:59:14.273085] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-28T02:59:14.275525] [INFO ] [MAIN ] Derivative Progress: 89/2211 symbols completed. AMCR took 1.2s. Estimated remaining: 14m 35s. Rate: 145.6 symbols/min [2025-09-28T02:59:14.291175] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:14.291937] [INFO ] [MAIN ] AME: Generated 1820 derivative records from 49252 primary records. [2025-09-28T02:59:14.292024] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-28T02:59:14.310043] [DEBUG] [LOCAL ] AME: Derivative data saved (1820 records). [2025-09-28T02:59:14.310185] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-28T02:59:14.312445] [INFO ] [MAIN ] Derivative Progress: 90/2211 symbols completed. AME took 1.2s. Estimated remaining: 14m 25s. Rate: 147.1 symbols/min [2025-09-28T02:59:14.313019] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:14.313186] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:14.313788] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:14.340448] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-28T02:59:14.340859] [INFO ] [MAIN ] AMG: Loaded 21046 primary data records. [2025-09-28T02:59:14.533025] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-28T02:59:14.556792] [INFO ] [MAIN ] AMN: Loaded 42588 primary data records. [2025-09-28T02:59:14.533928] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-28T02:59:14.571617] [INFO ] [MAIN ] AMH: Loaded 52467 primary data records. [2025-09-28T02:59:15.388366] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:15.391049] [INFO ] [MAIN ] AMG: Generated 1820 derivative records from 21046 primary records. [2025-09-28T02:59:15.391630] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-28T02:59:15.410528] [DEBUG] [LOCAL ] AMG: Derivative data saved (1820 records). [2025-09-28T02:59:15.410968] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-28T02:59:15.412912] [INFO ] [MAIN ] Derivative Progress: 91/2211 symbols completed. AMG took 1.1s. Estimated remaining: 14m 41s. Rate: 144.4 symbols/min [2025-09-28T02:59:15.413139] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:15.432600] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:15.435407] [INFO ] [MAIN ] AMN: Generated 1820 derivative records from 42588 primary records. [2025-09-28T02:59:15.435692] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-28T02:59:15.463064] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:15.464636] [INFO ] [MAIN ] AMH: Generated 1820 derivative records from 52467 primary records. [2025-09-28T02:59:15.465746] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-28T02:59:15.484558] [DEBUG] [LOCAL ] AMH: Derivative data saved (1820 records). [2025-09-28T02:59:15.493447] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-28T02:59:15.483821] [DEBUG] [LOCAL ] AMN: Derivative data saved (1820 records). [2025-09-28T02:59:15.496027] [INFO ] [MAIN ] Derivative Progress: 92/2211 symbols completed. AMH took 1.2s. Estimated remaining: 14m 33s. Rate: 145.6 symbols/min [2025-09-28T02:59:15.496488] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:15.497015] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-28T02:59:15.500313] [INFO ] [MAIN ] Derivative Progress: 93/2211 symbols completed. AMN took 1.2s. Estimated remaining: 14m 23s. Rate: 147.2 symbols/min [2025-09-28T02:59:15.500751] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:15.515393] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-28T02:59:15.515812] [INFO ] [MAIN ] AMP: Loaded 32959 primary data records. [2025-09-28T02:59:15.870854] [DEBUG] [LOCAL ] AMPY: Loaded 38164 existing records from primary storage. [2025-09-28T02:59:15.872379] [INFO ] [MAIN ] AMPY: Loaded 38164 primary data records. [2025-09-28T02:59:15.976503] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-28T02:59:15.987585] [INFO ] [MAIN ] AMPX: Loaded 52949 primary data records. [2025-09-28T02:59:16.588907] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:16.590636] [INFO ] [MAIN ] AMP: Generated 1820 derivative records from 32959 primary records. [2025-09-28T02:59:16.591996] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-28T02:59:16.614810] [DEBUG] [LOCAL ] AMP: Derivative data saved (1820 records). [2025-09-28T02:59:16.615466] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-28T02:59:16.617836] [INFO ] [MAIN ] Derivative Progress: 94/2211 symbols completed. AMP took 1.2s. Estimated remaining: 14m 39s. Rate: 144.5 symbols/min [2025-09-28T02:59:16.618430] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:16.635335] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:16.636182] [INFO ] [MAIN ] AMPY: Generated 1820 derivative records from 38164 primary records. [2025-09-28T02:59:16.636412] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-28T02:59:16.658013] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1820 records). [2025-09-28T02:59:16.658479] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-28T02:59:16.661079] [INFO ] [MAIN ] Derivative Progress: 95/2211 symbols completed. AMPY took 1.2s. Estimated remaining: 14m 30s. Rate: 145.9 symbols/min [2025-09-28T02:59:16.661406] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:16.675397] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:16.676232] [INFO ] [MAIN ] AMPX: Generated 1820 derivative records from 52949 primary records. [2025-09-28T02:59:16.676320] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-28T02:59:16.701387] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1820 records). [2025-09-28T02:59:16.711508] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-28T02:59:16.714869] [INFO ] [MAIN ] Derivative Progress: 96/2211 symbols completed. AMPX took 1.2s. Estimated remaining: 14m 22s. Rate: 147.2 symbols/min [2025-09-28T02:59:16.715512] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-28T02:59:16.715911] [INFO ] [MAIN ] AMR: Loaded 29441 primary data records. [2025-09-28T02:59:16.715779] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:16.900341] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-28T02:59:17.054424] [INFO ] [MAIN ] AMRC: Loaded 38981 primary data records. [2025-09-28T02:59:17.398462] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-28T02:59:17.399325] [INFO ] [MAIN ] AMT: Loaded 53212 primary data records. [2025-09-28T02:59:17.739074] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:17.740343] [INFO ] [MAIN ] AMR: Generated 1820 derivative records from 29441 primary records. [2025-09-28T02:59:17.740806] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-28T02:59:17.765572] [DEBUG] [LOCAL ] AMR: Derivative data saved (1820 records). [2025-09-28T02:59:17.778674] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-28T02:59:17.779211] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:17.781398] [INFO ] [MAIN ] Derivative Progress: 97/2211 symbols completed. AMR took 1.2s. Estimated remaining: 14m 36s. Rate: 144.8 symbols/min [2025-09-28T02:59:17.783700] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:17.783487] [INFO ] [MAIN ] AMRC: Generated 1820 derivative records from 38981 primary records. [2025-09-28T02:59:17.784281] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-28T02:59:17.804441] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1820 records). [2025-09-28T02:59:17.804606] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-28T02:59:17.807396] [INFO ] [MAIN ] Derivative Progress: 98/2211 symbols completed. AMRC took 1.1s. Estimated remaining: 14m 27s. Rate: 146.2 symbols/min [2025-09-28T02:59:17.808723] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:17.829458] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:17.838391] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-28T02:59:17.839365] [INFO ] [MAIN ] AMTB: Loaded 20599 primary data records. [2025-09-28T02:59:17.839243] [INFO ] [MAIN ] AMT: Generated 1820 derivative records from 53212 primary records. [2025-09-28T02:59:17.839614] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-28T02:59:17.887786] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-28T02:59:17.940185] [INFO ] [MAIN ] AMTD: Loaded 3622 primary data records. [2025-09-28T02:59:17.962630] [DEBUG] [LOCAL ] AMT: Derivative data saved (1820 records). [2025-09-28T02:59:17.984035] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-28T02:59:18.017398] [INFO ] [MAIN ] Derivative Progress: 99/2211 symbols completed. AMT took 1.3s. Estimated remaining: 14m 22s. Rate: 147.0 symbols/min [2025-09-28T02:59:18.040367] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:18.573320] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:18.588328] [INFO ] [MAIN ] AMTB: Generated 1820 derivative records from 20599 primary records. [2025-09-28T02:59:18.596459] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-28T02:59:18.605675] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-28T02:59:18.606356] [INFO ] [MAIN ] AMTM: Loaded 51451 primary data records. [2025-09-28T02:59:18.606127] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:18.607411] [INFO ] [MAIN ] AMTD: Generated 1820 derivative records from 3622 primary records. [2025-09-28T02:59:18.613834] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-28T02:59:18.723855] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1820 records). [2025-09-28T02:59:18.714667] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1820 records). [2025-09-28T02:59:18.741795] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-28T02:59:18.756275] [INFO ] [MAIN ] Derivative Progress: 100/2211 symbols completed. AMTD took 0.9s. Estimated remaining: 14m 29s. Rate: 145.8 symbols/min [2025-09-28T02:59:18.756573] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-28T02:59:18.756869] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:18.760274] [INFO ] [MAIN ] Derivative Progress: 101/2211 symbols completed. AMTB took 1.0s. Estimated remaining: 14m 20s. Rate: 147.2 symbols/min [2025-09-28T02:59:18.782742] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:18.986763] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-28T02:59:18.987010] [INFO ] [MAIN ] AMWL: Loaded 8830 primary data records. [2025-09-28T02:59:19.346627] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-28T02:59:19.349509] [INFO ] [MAIN ] AMX: Loaded 49855 primary data records. [2025-09-28T02:59:19.471333] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:19.497974] [INFO ] [MAIN ] AMTM: Generated 1820 derivative records from 51451 primary records. [2025-09-28T02:59:19.509723] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-28T02:59:19.607345] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1820 records). [2025-09-28T02:59:19.750892] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-28T02:59:19.759833] [INFO ] [MAIN ] Derivative Progress: 102/2211 symbols completed. AMTM took 1.7s. Estimated remaining: 14m 32s. Rate: 145.1 symbols/min [2025-09-28T02:59:19.756612] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:19.761529] [INFO ] [MAIN ] AMWL: Generated 1820 derivative records from 8830 primary records. [2025-09-28T02:59:19.760498] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:19.762840] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-28T02:59:19.783201] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1820 records). [2025-09-28T02:59:19.783936] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-28T02:59:19.787963] [INFO ] [MAIN ] Derivative Progress: 103/2211 symbols completed. AMWL took 1.0s. Estimated remaining: 14m 24s. Rate: 146.5 symbols/min [2025-09-28T02:59:19.810390] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:19.811326] [INFO ] [MAIN ] AMX: Generated 1820 derivative records from 49855 primary records. [2025-09-28T02:59:19.811417] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-28T02:59:19.853050] [DEBUG] [LOCAL ] AMX: Derivative data saved (1820 records). [2025-09-28T02:59:19.853266] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-28T02:59:19.853951] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-28T02:59:19.856856] [INFO ] [MAIN ] Derivative Progress: 104/2211 symbols completed. AMX took 1.1s. Estimated remaining: 14m 16s. Rate: 147.7 symbols/min [2025-09-28T02:59:19.857150] [INFO ] [MAIN ] AN: Loaded 32842 primary data records. [2025-09-28T02:59:20.178387] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:20.179141] [INFO ] [MAIN ] AN: Generated 1820 derivative records from 32842 primary records. [2025-09-28T02:59:20.179229] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-28T02:59:20.194981] [DEBUG] [LOCAL ] AN: Derivative data saved (1820 records). [2025-09-28T02:59:20.195068] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-28T02:59:20.197280] [INFO ] [MAIN ] Derivative Progress: 105/2211 symbols completed. AN took 0.4s. Estimated remaining: 14m 14s. Rate: 147.9 symbols/min [2025-09-28T02:59:20.198136] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:20.198874] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:20.198418] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:20.222754] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-28T02:59:20.222966] [INFO ] [MAIN ] ANRO: Loaded 19387 primary data records. [2025-09-28T02:59:20.621396] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-28T02:59:20.622222] [INFO ] [MAIN ] ANF: Loaded 52967 primary data records. [2025-09-28T02:59:20.623561] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-28T02:59:20.647485] [INFO ] [MAIN ] ANET: Loaded 54546 primary data records. [2025-09-28T02:59:21.326747] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:21.328961] [INFO ] [MAIN ] ANRO: Generated 1820 derivative records from 19387 primary records. [2025-09-28T02:59:21.329765] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-28T02:59:21.352818] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1820 records). [2025-09-28T02:59:21.355781] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-28T02:59:21.358693] [INFO ] [MAIN ] Derivative Progress: 106/2211 symbols completed. ANRO took 1.2s. Estimated remaining: 14m 29s. Rate: 145.3 symbols/min [2025-09-28T02:59:21.360749] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:21.377492] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:21.378679] [INFO ] [MAIN ] ANF: Generated 1820 derivative records from 52967 primary records. [2025-09-28T02:59:21.379096] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-28T02:59:21.396539] [DEBUG] [LOCAL ] ANF: Derivative data saved (1820 records). [2025-09-28T02:59:21.396790] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-28T02:59:21.399031] [INFO ] [MAIN ] Derivative Progress: 107/2211 symbols completed. ANF took 1.2s. Estimated remaining: 14m 21s. Rate: 146.6 symbols/min [2025-09-28T02:59:21.402516] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:21.423301] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:21.424287] [INFO ] [MAIN ] ANET: Generated 1820 derivative records from 54546 primary records. [2025-09-28T02:59:21.424538] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-28T02:59:21.447247] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-28T02:59:21.451329] [INFO ] [MAIN ] ANVS: Loaded 23508 primary data records. [2025-09-28T02:59:21.479395] [DEBUG] [LOCAL ] ANET: Derivative data saved (1820 records). [2025-09-28T02:59:21.509229] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-28T02:59:21.549779] [INFO ] [MAIN ] Derivative Progress: 108/2211 symbols completed. ANET took 1.4s. Estimated remaining: 14m 16s. Rate: 147.4 symbols/min [2025-09-28T02:59:21.579290] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:21.618458] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-28T02:59:21.624055] [INFO ] [MAIN ] AOD: Loaded 30414 primary data records. [2025-09-28T02:59:21.926691] [DEBUG] [LOCAL ] AOMR: Loaded 16852 existing records from primary storage. [2025-09-28T02:59:21.939846] [INFO ] [MAIN ] AOMR: Loaded 16852 primary data records. [2025-09-28T02:59:22.608206] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:22.609866] [INFO ] [MAIN ] ANVS: Generated 1820 derivative records from 23508 primary records. [2025-09-28T02:59:22.610791] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-28T02:59:22.629133] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1820 records). [2025-09-28T02:59:22.629792] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-28T02:59:22.632348] [INFO ] [MAIN ] Derivative Progress: 109/2211 symbols completed. ANVS took 1.3s. Estimated remaining: 14m 29s. Rate: 145.2 symbols/min [2025-09-28T02:59:22.633011] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:22.657469] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:22.671607] [INFO ] [MAIN ] AOD: Generated 1820 derivative records from 30414 primary records. [2025-09-28T02:59:22.671969] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:22.672872] [INFO ] [MAIN ] AOMR: Generated 1820 derivative records from 16852 primary records. [2025-09-28T02:59:22.672990] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-28T02:59:22.673165] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-28T02:59:22.706165] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1820 records). [2025-09-28T02:59:22.707177] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-28T02:59:22.709326] [INFO ] [MAIN ] Derivative Progress: 110/2211 symbols completed. AOMR took 1.1s. Estimated remaining: 14m 22s. Rate: 146.3 symbols/min [2025-09-28T02:59:22.710433] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:22.724782] [DEBUG] [LOCAL ] AOD: Derivative data saved (1820 records). [2025-09-28T02:59:22.724943] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-28T02:59:22.727482] [INFO ] [MAIN ] Derivative Progress: 111/2211 symbols completed. AOD took 1.3s. Estimated remaining: 14m 14s. Rate: 147.6 symbols/min [2025-09-28T02:59:22.728372] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:22.748750] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-28T02:59:22.748968] [INFO ] [MAIN ] AON: Loaded 46248 primary data records. [2025-09-28T02:59:22.963424] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-28T02:59:22.988584] [INFO ] [MAIN ] AORT: Loaded 30087 primary data records. [2025-09-28T02:59:23.202402] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-28T02:59:23.228480] [INFO ] [MAIN ] AOS: Loaded 49769 primary data records. [2025-09-28T02:59:23.798754] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:23.800615] [INFO ] [MAIN ] AON: Generated 1820 derivative records from 46248 primary records. [2025-09-28T02:59:23.800799] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-28T02:59:23.823291] [DEBUG] [LOCAL ] AON: Derivative data saved (1820 records). [2025-09-28T02:59:23.823760] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-28T02:59:23.827749] [INFO ] [MAIN ] Derivative Progress: 112/2211 symbols completed. AON took 1.2s. Estimated remaining: 14m 26s. Rate: 145.4 symbols/min [2025-09-28T02:59:23.828633] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:23.853836] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:23.871812] [INFO ] [MAIN ] AORT: Generated 1820 derivative records from 30087 primary records. [2025-09-28T02:59:23.876796] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-28T02:59:23.877159] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:23.877457] [DEBUG] [LOCAL ] AP: Loaded 7236 existing records from primary storage. [2025-09-28T02:59:23.877821] [INFO ] [MAIN ] AP: Loaded 7236 primary data records. [2025-09-28T02:59:23.878576] [INFO ] [MAIN ] AOS: Generated 1820 derivative records from 49769 primary records. [2025-09-28T02:59:23.879182] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-28T02:59:24.039679] [DEBUG] [LOCAL ] AORT: Derivative data saved (1820 records). [2025-09-28T02:59:24.057045] [DEBUG] [LOCAL ] AOS: Derivative data saved (1820 records). [2025-09-28T02:59:24.075826] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-28T02:59:24.081370] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-28T02:59:24.085176] [INFO ] [MAIN ] Derivative Progress: 113/2211 symbols completed. AOS took 1.4s. Estimated remaining: 14m 23s. Rate: 145.8 symbols/min [2025-09-28T02:59:24.120905] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:24.121096] [INFO ] [MAIN ] Derivative Progress: 114/2211 symbols completed. AORT took 1.4s. Estimated remaining: 14m 16s. Rate: 147.0 symbols/min [2025-09-28T02:59:24.228476] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:24.300258] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:24.301124] [INFO ] [MAIN ] AP: Generated 1820 derivative records from 7236 primary records. [2025-09-28T02:59:24.301274] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-28T02:59:24.341281] [DEBUG] [LOCAL ] AP: Derivative data saved (1820 records). [2025-09-28T02:59:24.342458] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-28T02:59:24.355777] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-28T02:59:24.358921] [INFO ] [MAIN ] APAM: Loaded 36969 primary data records. [2025-09-28T02:59:24.358721] [INFO ] [MAIN ] Derivative Progress: 115/2211 symbols completed. AP took 0.5s. Estimated remaining: 14m 12s. Rate: 147.6 symbols/min [2025-09-28T02:59:24.359454] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:24.365922] [DEBUG] [LOCAL ] APD: Loaded 46087 existing records from primary storage. [2025-09-28T02:59:24.377846] [INFO ] [MAIN ] APD: Loaded 46087 primary data records. [2025-09-28T02:59:25.092417] [DEBUG] [LOCAL ] APG: Loaded 50931 existing records from primary storage. [2025-09-28T02:59:25.092790] [INFO ] [MAIN ] APG: Loaded 50931 primary data records. [2025-09-28T02:59:25.458288] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:25.461017] [INFO ] [MAIN ] APAM: Generated 1820 derivative records from 36969 primary records. [2025-09-28T02:59:25.461680] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-28T02:59:25.462770] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:25.464972] [INFO ] [MAIN ] APD: Generated 1820 derivative records from 46087 primary records. [2025-09-28T02:59:25.465126] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-28T02:59:25.500951] [DEBUG] [LOCAL ] APAM: Derivative data saved (1820 records). [2025-09-28T02:59:25.501151] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-28T02:59:25.497803] [DEBUG] [LOCAL ] APD: Derivative data saved (1820 records). [2025-09-28T02:59:25.501363] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-28T02:59:25.503610] [INFO ] [MAIN ] Derivative Progress: 116/2211 symbols completed. APAM took 1.4s. Estimated remaining: 14m 25s. Rate: 145.3 symbols/min [2025-09-28T02:59:25.506609] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:25.506822] [INFO ] [MAIN ] Derivative Progress: 117/2211 symbols completed. APD took 1.3s. Estimated remaining: 14m 17s. Rate: 146.5 symbols/min [2025-09-28T02:59:25.507521] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:25.531594] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:25.532510] [INFO ] [MAIN ] APG: Generated 1820 derivative records from 50931 primary records. [2025-09-28T02:59:25.532713] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-28T02:59:25.551529] [DEBUG] [LOCAL ] APG: Derivative data saved (1820 records). [2025-09-28T02:59:25.551751] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-28T02:59:25.554774] [INFO ] [MAIN ] Derivative Progress: 118/2211 symbols completed. APG took 1.2s. Estimated remaining: 14m 11s. Rate: 147.6 symbols/min [2025-09-28T02:59:25.613510] [DEBUG] [LOCAL ] APLE: Loaded 52769 existing records from primary storage. [2025-09-28T02:59:25.613855] [INFO ] [MAIN ] APLE: Loaded 52769 primary data records. [2025-09-28T02:59:25.750446] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-28T02:59:25.766063] [INFO ] [MAIN ] APH: Loaded 54471 primary data records. [2025-09-28T02:59:26.289000] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:26.291151] [INFO ] [MAIN ] APLE: Generated 1820 derivative records from 52769 primary records. [2025-09-28T02:59:26.292019] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-28T02:59:26.307714] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:26.319780] [INFO ] [MAIN ] APH: Generated 1820 derivative records from 54471 primary records. [2025-09-28T02:59:26.322128] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-28T02:59:26.324594] [DEBUG] [LOCAL ] APLE: Derivative data saved (1820 records). [2025-09-28T02:59:26.324729] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-28T02:59:26.328060] [INFO ] [MAIN ] Derivative Progress: 119/2211 symbols completed. APLE took 0.8s. Estimated remaining: 14m 17s. Rate: 146.5 symbols/min [2025-09-28T02:59:26.343621] [DEBUG] [LOCAL ] APH: Derivative data saved (1820 records). [2025-09-28T02:59:26.343768] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-28T02:59:26.345953] [INFO ] [MAIN ] Derivative Progress: 120/2211 symbols completed. APH took 0.8s. Estimated remaining: 14m 9s. Rate: 147.7 symbols/min [2025-09-28T02:59:26.346483] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:26.346582] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:26.346788] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:26.359115] [DEBUG] [LOCAL ] APOS: Loaded 7568 existing records from primary storage. [2025-09-28T02:59:26.359280] [INFO ] [MAIN ] APOS: Loaded 7568 primary data records. [2025-09-28T02:59:26.765621] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-28T02:59:26.766279] [INFO ] [MAIN ] APTV: Loaded 52964 primary data records. [2025-09-28T02:59:26.889604] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-28T02:59:26.896977] [INFO ] [MAIN ] APO: Loaded 54162 primary data records. [2025-09-28T02:59:27.483425] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:27.485381] [INFO ] [MAIN ] APOS: Generated 1820 derivative records from 7568 primary records. [2025-09-28T02:59:27.485798] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-28T02:59:27.503530] [DEBUG] [LOCAL ] APOS: Derivative data saved (1820 records). [2025-09-28T02:59:27.504116] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-28T02:59:27.506754] [INFO ] [MAIN ] Derivative Progress: 121/2211 symbols completed. APOS took 1.2s. Estimated remaining: 14m 22s. Rate: 145.5 symbols/min [2025-09-28T02:59:27.508365] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:27.525764] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:27.526581] [INFO ] [MAIN ] APTV: Generated 1820 derivative records from 52964 primary records. [2025-09-28T02:59:27.527022] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-28T02:59:27.548834] [DEBUG] [LOCAL ] APTV: Derivative data saved (1820 records). [2025-09-28T02:59:27.549139] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-28T02:59:27.551332] [INFO ] [MAIN ] Derivative Progress: 122/2211 symbols completed. APTV took 1.2s. Estimated remaining: 14m 15s. Rate: 146.5 symbols/min [2025-09-28T02:59:27.551739] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:27.566231] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:27.567595] [INFO ] [MAIN ] APO: Generated 1820 derivative records from 54162 primary records. [2025-09-28T02:59:27.567848] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-28T02:59:27.588181] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-28T02:59:27.589214] [INFO ] [MAIN ] AQNB: Loaded 4228 primary data records. [2025-09-28T02:59:27.697907] [DEBUG] [LOCAL ] APO: Derivative data saved (1820 records). [2025-09-28T02:59:27.753609] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-28T02:59:27.781996] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-28T02:59:27.790960] [INFO ] [MAIN ] AQN: Loaded 52684 primary data records. [2025-09-28T02:59:27.816513] [INFO ] [MAIN ] Derivative Progress: 123/2211 symbols completed. APO took 1.5s. Estimated remaining: 14m 13s. Rate: 147.0 symbols/min [2025-09-28T02:59:27.939337] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:28.309531] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-28T02:59:28.326509] [INFO ] [MAIN ] AQNB: Generated 1819 derivative records from 4228 primary records. [2025-09-28T02:59:28.326733] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-28T02:59:28.328613] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-28T02:59:28.330378] [INFO ] [MAIN ] AR: Loaded 54364 primary data records. [2025-09-28T02:59:28.437251] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1819 records). [2025-09-28T02:59:28.452628] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-28T02:59:28.460401] [INFO ] [MAIN ] Derivative Progress: 124/2211 symbols completed. AQNB took 0.9s. Estimated remaining: 14m 16s. Rate: 146.3 symbols/min [2025-09-28T02:59:28.483479] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:28.669203] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:28.684310] [INFO ] [MAIN ] AQN: Generated 1820 derivative records from 52684 primary records. [2025-09-28T02:59:28.684777] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-28T02:59:28.714241] [DEBUG] [LOCAL ] AQN: Derivative data saved (1820 records). [2025-09-28T02:59:28.714633] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-28T02:59:28.717674] [INFO ] [MAIN ] Derivative Progress: 125/2211 symbols completed. AQN took 1.2s. Estimated remaining: 14m 13s. Rate: 146.7 symbols/min [2025-09-28T02:59:28.718004] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:28.768813] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:28.769903] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-28T02:59:28.777247] [INFO ] [MAIN ] AR: Generated 1820 derivative records from 54364 primary records. [2025-09-28T02:59:28.777501] [INFO ] [MAIN ] ARCO: Loaded 45249 primary data records. [2025-09-28T02:59:28.777615] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-28T02:59:28.778091] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-28T02:59:28.784905] [INFO ] [MAIN ] ARDC: Loaded 14821 primary data records. [2025-09-28T02:59:28.941227] [DEBUG] [LOCAL ] AR: Derivative data saved (1820 records). [2025-09-28T02:59:28.975533] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-28T02:59:29.023424] [INFO ] [MAIN ] Derivative Progress: 126/2211 symbols completed. AR took 1.1s. Estimated remaining: 14m 11s. Rate: 147.0 symbols/min [2025-09-28T02:59:29.023772] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:29.494407] [DEBUG] [LOCAL ] ARDT: Loaded 28513 existing records from primary storage. [2025-09-28T02:59:29.495116] [INFO ] [MAIN ] ARDT: Loaded 28513 primary data records. [2025-09-28T02:59:29.843342] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:29.857487] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:29.852308] [INFO ] [MAIN ] ARCO: Generated 1820 derivative records from 45249 primary records. [2025-09-28T02:59:29.858292] [INFO ] [MAIN ] ARDC: Generated 1820 derivative records from 14821 primary records. [2025-09-28T02:59:29.858784] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-28T02:59:29.860054] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-28T02:59:29.891060] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1820 records). [2025-09-28T02:59:29.894997] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-28T02:59:29.894561] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1820 records). [2025-09-28T02:59:29.900077] [INFO ] [MAIN ] Derivative Progress: 127/2211 symbols completed. ARDC took 1.2s. Estimated remaining: 14m 18s. Rate: 145.7 symbols/min [2025-09-28T02:59:29.900296] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-28T02:59:29.902977] [INFO ] [MAIN ] Derivative Progress: 128/2211 symbols completed. ARCO took 1.4s. Estimated remaining: 14m 11s. Rate: 146.8 symbols/min [2025-09-28T02:59:29.903402] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:29.900817] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:29.917717] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:29.919283] [INFO ] [MAIN ] ARDT: Generated 1820 derivative records from 28513 primary records. [2025-09-28T02:59:29.919605] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-28T02:59:29.937195] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1820 records). [2025-09-28T02:59:29.937527] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-28T02:59:29.940075] [INFO ] [MAIN ] Derivative Progress: 129/2211 symbols completed. ARDT took 0.9s. Estimated remaining: 14m 5s. Rate: 147.9 symbols/min [2025-09-28T02:59:29.940459] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:30.000869] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-28T02:59:30.001188] [INFO ] [MAIN ] ARES: Loaded 50322 primary data records. [2025-09-28T02:59:30.160953] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-28T02:59:30.203756] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-28T02:59:30.244780] [INFO ] [MAIN ] ARI: Loaded 44009 primary data records. [2025-09-28T02:59:30.203909] [INFO ] [MAIN ] ARE: Loaded 51319 primary data records. [2025-09-28T02:59:31.112348] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:31.118718] [INFO ] [MAIN ] ARES: Generated 1820 derivative records from 50322 primary records. [2025-09-28T02:59:31.119157] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-28T02:59:31.142771] [DEBUG] [LOCAL ] ARES: Derivative data saved (1820 records). [2025-09-28T02:59:31.143837] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-28T02:59:31.146252] [INFO ] [MAIN ] Derivative Progress: 130/2211 symbols completed. ARES took 1.2s. Estimated remaining: 14m 17s. Rate: 145.7 symbols/min [2025-09-28T02:59:31.146835] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:31.171820] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:31.173553] [INFO ] [MAIN ] ARE: Generated 1820 derivative records from 51319 primary records. [2025-09-28T02:59:31.187829] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-28T02:59:31.188202] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:31.190137] [INFO ] [MAIN ] ARI: Generated 1820 derivative records from 44009 primary records. [2025-09-28T02:59:31.191046] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-28T02:59:31.223436] [DEBUG] [LOCAL ] ARE: Derivative data saved (1820 records). [2025-09-28T02:59:31.227054] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-28T02:59:31.228506] [DEBUG] [LOCAL ] ARI: Derivative data saved (1820 records). [2025-09-28T02:59:31.231850] [INFO ] [MAIN ] Derivative Progress: 131/2211 symbols completed. ARE took 1.3s. Estimated remaining: 14m 12s. Rate: 146.5 symbols/min [2025-09-28T02:59:31.232300] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-28T02:59:31.232221] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:31.247080] [INFO ] [MAIN ] Derivative Progress: 132/2211 symbols completed. ARI took 1.3s. Estimated remaining: 14m 5s. Rate: 147.6 symbols/min [2025-09-28T02:59:31.247543] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:31.278298] [DEBUG] [LOCAL ] ARIS: Loaded 42624 existing records from primary storage. [2025-09-28T02:59:31.278615] [INFO ] [MAIN ] ARIS: Loaded 42624 primary data records. [2025-09-28T02:59:31.525618] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-28T02:59:31.660823] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-28T02:59:31.659971] [INFO ] [MAIN ] ARLO: Loaded 44493 primary data records. [2025-09-28T02:59:31.661026] [INFO ] [MAIN ] ARMK: Loaded 51112 primary data records. [2025-09-28T02:59:32.331618] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:32.333054] [INFO ] [MAIN ] ARIS: Generated 1820 derivative records from 42624 primary records. [2025-09-28T02:59:32.333200] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-28T02:59:32.355396] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1820 records). [2025-09-28T02:59:32.356383] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-28T02:59:32.359161] [INFO ] [MAIN ] Derivative Progress: 133/2211 symbols completed. ARIS took 1.2s. Estimated remaining: 14m 16s. Rate: 145.7 symbols/min [2025-09-28T02:59:32.392832] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:32.393202] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:32.394927] [INFO ] [MAIN ] ARMK: Generated 1820 derivative records from 51112 primary records. [2025-09-28T02:59:32.395833] [INFO ] [MAIN ] ARLO: Generated 1820 derivative records from 44493 primary records. [2025-09-28T02:59:32.396048] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-28T02:59:32.396124] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-28T02:59:32.430392] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1820 records). [2025-09-28T02:59:32.431450] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1820 records). [2025-09-28T02:59:32.431708] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-28T02:59:32.431804] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-28T02:59:32.434020] [INFO ] [MAIN ] Derivative Progress: 134/2211 symbols completed. ARLO took 1.2s. Estimated remaining: 14m 10s. Rate: 146.6 symbols/min [2025-09-28T02:59:32.437557] [INFO ] [MAIN ] Derivative Progress: 135/2211 symbols completed. ARMK took 1.2s. Estimated remaining: 14m 3s. Rate: 147.7 symbols/min [2025-09-28T02:59:32.438398] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:32.438294] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:32.438599] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:32.492138] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-28T02:59:32.492309] [INFO ] [MAIN ] ARW: Loaded 33660 primary data records. [2025-09-28T02:59:32.610627] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-28T02:59:32.628080] [INFO ] [MAIN ] AROC: Loaded 49733 primary data records. [2025-09-28T02:59:32.820418] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-28T02:59:32.942840] [INFO ] [MAIN ] ARR: Loaded 52809 primary data records. [2025-09-28T02:59:33.577561] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:33.579019] [INFO ] [MAIN ] ARW: Generated 1820 derivative records from 33660 primary records. [2025-09-28T02:59:33.580235] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-28T02:59:33.602509] [DEBUG] [LOCAL ] ARW: Derivative data saved (1820 records). [2025-09-28T02:59:33.602903] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-28T02:59:33.605710] [INFO ] [MAIN ] Derivative Progress: 136/2211 symbols completed. ARW took 1.2s. Estimated remaining: 14m 15s. Rate: 145.7 symbols/min [2025-09-28T02:59:33.619874] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:33.620907] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:33.622047] [INFO ] [MAIN ] AROC: Generated 1820 derivative records from 49733 primary records. [2025-09-28T02:59:33.622210] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-28T02:59:33.644610] [DEBUG] [LOCAL ] AROC: Derivative data saved (1820 records). [2025-09-28T02:59:33.647013] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-28T02:59:33.650719] [INFO ] [MAIN ] Derivative Progress: 137/2211 symbols completed. AROC took 1.2s. Estimated remaining: 14m 9s. Rate: 146.6 symbols/min [2025-09-28T02:59:33.651045] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:33.666043] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:33.667977] [INFO ] [MAIN ] ARR: Generated 1820 derivative records from 52809 primary records. [2025-09-28T02:59:33.668351] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-28T02:59:33.689794] [DEBUG] [LOCAL ] ARR: Derivative data saved (1820 records). [2025-09-28T02:59:33.704286] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-28T02:59:33.708287] [INFO ] [MAIN ] Derivative Progress: 138/2211 symbols completed. ARR took 1.3s. Estimated remaining: 14m 3s. Rate: 147.6 symbols/min [2025-09-28T02:59:33.708742] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:33.716207] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-28T02:59:33.716398] [INFO ] [MAIN ] ASA: Loaded 14109 primary data records. [2025-09-28T02:59:33.822360] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-28T02:59:33.827873] [INFO ] [MAIN ] AS: Loaded 53854 primary data records. [2025-09-28T02:59:34.289590] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-28T02:59:34.409489] [INFO ] [MAIN ] ASAN: Loaded 53512 primary data records. [2025-09-28T02:59:34.746402] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:34.747509] [INFO ] [MAIN ] ASA: Generated 1820 derivative records from 14109 primary records. [2025-09-28T02:59:34.747921] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-28T02:59:34.766454] [DEBUG] [LOCAL ] ASA: Derivative data saved (1820 records). [2025-09-28T02:59:34.767563] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-28T02:59:34.770675] [INFO ] [MAIN ] Derivative Progress: 139/2211 symbols completed. ASA took 1.1s. Estimated remaining: 14m 12s. Rate: 145.9 symbols/min [2025-09-28T02:59:34.771126] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:34.792517] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:34.793752] [INFO ] [MAIN ] AS: Generated 1820 derivative records from 53854 primary records. [2025-09-28T02:59:34.794050] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-28T02:59:34.813967] [DEBUG] [LOCAL ] AS: Derivative data saved (1820 records). [2025-09-28T02:59:34.816592] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-28T02:59:34.820625] [INFO ] [MAIN ] Derivative Progress: 140/2211 symbols completed. AS took 1.2s. Estimated remaining: 14m 7s. Rate: 146.8 symbols/min [2025-09-28T02:59:34.821149] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:34.835427] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:34.836556] [INFO ] [MAIN ] ASAN: Generated 1820 derivative records from 53512 primary records. [2025-09-28T02:59:34.836734] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-28T02:59:34.868703] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-28T02:59:34.865885] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1820 records). [2025-09-28T02:59:34.869009] [INFO ] [MAIN ] ASBA: Loaded 3458 primary data records. [2025-09-28T02:59:34.868919] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-28T02:59:34.894518] [INFO ] [MAIN ] Derivative Progress: 141/2211 symbols completed. ASAN took 1.2s. Estimated remaining: 14m 1s. Rate: 147.6 symbols/min [2025-09-28T02:59:34.947859] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:35.051369] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-28T02:59:35.083583] [INFO ] [MAIN ] ASB: Loaded 50299 primary data records. [2025-09-28T02:59:35.577497] [DEBUG] [LOCAL ] ASC: Loaded 38153 existing records from primary storage. [2025-09-28T02:59:35.583088] [INFO ] [MAIN ] ASC: Loaded 38153 primary data records. [2025-09-28T02:59:35.926410] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:35.927260] [INFO ] [MAIN ] ASBA: Generated 1820 derivative records from 3458 primary records. [2025-09-28T02:59:35.927967] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-28T02:59:35.945475] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1820 records). [2025-09-28T02:59:35.946277] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-28T02:59:35.948761] [INFO ] [MAIN ] Derivative Progress: 142/2211 symbols completed. ASBA took 1.1s. Estimated remaining: 14m 10s. Rate: 146.0 symbols/min [2025-09-28T02:59:35.949889] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:35.969139] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:35.970741] [INFO ] [MAIN ] ASB: Generated 1820 derivative records from 50299 primary records. [2025-09-28T02:59:35.971030] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-28T02:59:35.993387] [DEBUG] [LOCAL ] ASB: Derivative data saved (1820 records). [2025-09-28T02:59:35.993615] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-28T02:59:35.995986] [INFO ] [MAIN ] Derivative Progress: 143/2211 symbols completed. ASB took 1.2s. Estimated remaining: 14m 5s. Rate: 146.9 symbols/min [2025-09-28T02:59:35.996383] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:36.007972] [DEBUG] [LOCAL ] ASG: Loaded 20695 existing records from primary storage. [2025-09-28T02:59:36.009982] [INFO ] [MAIN ] ASG: Loaded 20695 primary data records. [2025-09-28T02:59:36.045292] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:36.075444] [INFO ] [MAIN ] ASC: Generated 1820 derivative records from 38153 primary records. [2025-09-28T02:59:36.098151] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-28T02:59:36.210611] [DEBUG] [LOCAL ] ASC: Derivative data saved (1820 records). [2025-09-28T02:59:36.217160] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-28T02:59:36.249504] [INFO ] [MAIN ] Derivative Progress: 144/2211 symbols completed. ASC took 1.3s. Estimated remaining: 14m 2s. Rate: 147.3 symbols/min [2025-09-28T02:59:36.256320] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:36.365393] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-28T02:59:36.381524] [INFO ] [MAIN ] ASGI: Loaded 22711 primary data records. [2025-09-28T02:59:36.729471] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-28T02:59:36.730033] [INFO ] [MAIN ] ASGN: Loaded 36554 primary data records. [2025-09-28T02:59:36.824794] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:36.870845] [INFO ] [MAIN ] ASG: Generated 1820 derivative records from 20695 primary records. [2025-09-28T02:59:36.883238] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-28T02:59:36.973727] [DEBUG] [LOCAL ] ASG: Derivative data saved (1820 records). [2025-09-28T02:59:37.088170] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-28T02:59:37.100243] [INFO ] [MAIN ] Derivative Progress: 145/2211 symbols completed. ASG took 1.2s. Estimated remaining: 14m 8s. Rate: 146.2 symbols/min [2025-09-28T02:59:37.101067] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:37.124016] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:37.125437] [INFO ] [MAIN ] ASGI: Generated 1820 derivative records from 22711 primary records. [2025-09-28T02:59:37.125567] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-28T02:59:37.143891] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1820 records). [2025-09-28T02:59:37.144095] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-28T02:59:37.146689] [INFO ] [MAIN ] Derivative Progress: 146/2211 symbols completed. ASGI took 1.2s. Estimated remaining: 14m 2s. Rate: 147.1 symbols/min [2025-09-28T02:59:37.147066] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:37.196127] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:37.198548] [INFO ] [MAIN ] ASGN: Generated 1820 derivative records from 36554 primary records. [2025-09-28T02:59:37.199749] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-28T02:59:37.199530] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-28T02:59:37.199916] [INFO ] [MAIN ] ASH: Loaded 38339 primary data records. [2025-09-28T02:59:37.265434] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-28T02:59:37.301137] [INFO ] [MAIN ] ASIX: Loaded 22834 primary data records. [2025-09-28T02:59:37.380251] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1820 records). [2025-09-28T02:59:37.478308] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-28T02:59:37.499971] [INFO ] [MAIN ] Derivative Progress: 147/2211 symbols completed. ASGN took 1.2s. Estimated remaining: 14m 1s. Rate: 147.2 symbols/min [2025-09-28T02:59:37.563804] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:37.923795] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:37.924683] [INFO ] [MAIN ] ASH: Generated 1820 derivative records from 38339 primary records. [2025-09-28T02:59:37.924912] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-28T02:59:37.957348] [DEBUG] [LOCAL ] ASH: Derivative data saved (1820 records). [2025-09-28T02:59:37.970602] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:37.970848] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-28T02:59:37.974859] [INFO ] [MAIN ] Derivative Progress: 148/2211 symbols completed. ASH took 0.9s. Estimated remaining: 14m 2s. Rate: 147.1 symbols/min [2025-09-28T02:59:37.971873] [INFO ] [MAIN ] ASIX: Generated 1820 derivative records from 22834 primary records. [2025-09-28T02:59:37.976924] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-28T02:59:37.992982] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-28T02:59:37.993408] [INFO ] [MAIN ] ASPN: Loaded 50293 primary data records. [2025-09-28T02:59:38.111026] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1820 records). [2025-09-28T02:59:38.113752] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-28T02:59:38.122095] [INFO ] [MAIN ] Derivative Progress: 149/2211 symbols completed. ASIX took 1.0s. Estimated remaining: 13m 58s. Rate: 147.7 symbols/min [2025-09-28T02:59:38.327593] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:38.328319] [INFO ] [MAIN ] ASPN: Generated 1820 derivative records from 50293 primary records. [2025-09-28T02:59:38.328405] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-28T02:59:38.343414] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1820 records). [2025-09-28T02:59:38.343511] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-28T02:59:38.345904] [INFO ] [MAIN ] Derivative Progress: 150/2211 symbols completed. ASPN took 0.8s. Estimated remaining: 13m 55s. Rate: 148.1 symbols/min [2025-09-28T02:59:38.346537] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:38.346449] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:38.346621] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:38.364072] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-28T02:59:38.364384] [INFO ] [MAIN ] ASR: Loaded 9381 primary data records. [2025-09-28T02:59:38.724798] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-28T02:59:38.725476] [INFO ] [MAIN ] ATEN: Loaded 40398 primary data records. [2025-09-28T02:59:38.764602] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-28T02:59:38.803609] [INFO ] [MAIN ] ASX: Loaded 53639 primary data records. [2025-09-28T02:59:39.445241] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:39.448060] [INFO ] [MAIN ] ASR: Generated 1820 derivative records from 9381 primary records. [2025-09-28T02:59:39.449312] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-28T02:59:39.467695] [DEBUG] [LOCAL ] ASR: Derivative data saved (1820 records). [2025-09-28T02:59:39.469003] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-28T02:59:39.471710] [INFO ] [MAIN ] Derivative Progress: 151/2211 symbols completed. ASR took 1.1s. Estimated remaining: 14m 4s. Rate: 146.4 symbols/min [2025-09-28T02:59:39.472022] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:39.493005] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:39.496227] [INFO ] [MAIN ] ATEN: Generated 1820 derivative records from 40398 primary records. [2025-09-28T02:59:39.496480] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-28T02:59:39.525309] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:39.526824] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1820 records). [2025-09-28T02:59:39.536020] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-28T02:59:39.527913] [INFO ] [MAIN ] ASX: Generated 1820 derivative records from 53639 primary records. [2025-09-28T02:59:39.536253] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-28T02:59:39.538560] [INFO ] [MAIN ] Derivative Progress: 152/2211 symbols completed. ATEN took 1.2s. Estimated remaining: 13m 59s. Rate: 147.2 symbols/min [2025-09-28T02:59:39.540392] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:39.556242] [DEBUG] [LOCAL ] ASX: Derivative data saved (1820 records). [2025-09-28T02:59:39.557757] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-28T02:59:39.569178] [INFO ] [MAIN ] Derivative Progress: 153/2211 symbols completed. ASX took 1.2s. Estimated remaining: 13m 54s. Rate: 148.1 symbols/min [2025-09-28T02:59:39.570429] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-28T02:59:39.570563] [INFO ] [MAIN ] ATGE: Loaded 32251 primary data records. [2025-09-28T02:59:39.570755] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:39.719441] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-28T02:59:39.774003] [INFO ] [MAIN ] ATHS: Loaded 7145 primary data records. [2025-09-28T02:59:39.944703] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-28T02:59:39.988045] [INFO ] [MAIN ] ATHM: Loaded 33015 primary data records. [2025-09-28T02:59:40.557826] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:40.559203] [INFO ] [MAIN ] ATGE: Generated 1820 derivative records from 32251 primary records. [2025-09-28T02:59:40.559583] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-28T02:59:40.578772] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1820 records). [2025-09-28T02:59:40.579779] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-28T02:59:40.582712] [INFO ] [MAIN ] Derivative Progress: 154/2211 symbols completed. ATGE took 1.1s. Estimated remaining: 14m 1s. Rate: 146.7 symbols/min [2025-09-28T02:59:40.582988] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:40.601122] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:40.601993] [INFO ] [MAIN ] ATHS: Generated 1820 derivative records from 7145 primary records. [2025-09-28T02:59:40.602194] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-28T02:59:40.621762] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1820 records). [2025-09-28T02:59:40.621965] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-28T02:59:40.624131] [INFO ] [MAIN ] Derivative Progress: 155/2211 symbols completed. ATHS took 1.1s. Estimated remaining: 13m 56s. Rate: 147.6 symbols/min [2025-09-28T02:59:40.624391] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:40.639460] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:40.640464] [INFO ] [MAIN ] ATHM: Generated 1820 derivative records from 33015 primary records. [2025-09-28T02:59:40.640626] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-28T02:59:40.657876] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1820 records). [2025-09-28T02:59:40.658062] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-28T02:59:40.660623] [INFO ] [MAIN ] Derivative Progress: 156/2211 symbols completed. ATHM took 1.1s. Estimated remaining: 13m 51s. Rate: 148.4 symbols/min [2025-09-28T02:59:40.675493] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:40.715935] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-28T02:59:40.716319] [INFO ] [MAIN ] ATI: Loaded 52283 primary data records. [2025-09-28T02:59:40.716953] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-28T02:59:40.717230] [INFO ] [MAIN ] ATKR: Loaded 36196 primary data records. [2025-09-28T02:59:41.037413] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-28T02:59:41.079710] [INFO ] [MAIN ] ATMU: Loaded 40274 primary data records. [2025-09-28T02:59:41.834346] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:41.835437] [INFO ] [MAIN ] ATI: Generated 1820 derivative records from 52283 primary records. [2025-09-28T02:59:41.843996] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-28T02:59:41.850900] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:41.860868] [INFO ] [MAIN ] ATKR: Generated 1820 derivative records from 36196 primary records. [2025-09-28T02:59:41.865521] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-28T02:59:41.877806] [DEBUG] [LOCAL ] ATI: Derivative data saved (1820 records). [2025-09-28T02:59:41.877933] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-28T02:59:41.880374] [INFO ] [MAIN ] Derivative Progress: 157/2211 symbols completed. ATI took 1.3s. Estimated remaining: 14m 1s. Rate: 146.5 symbols/min [2025-09-28T02:59:41.884623] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:41.892921] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1820 records). [2025-09-28T02:59:41.893488] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-28T02:59:41.896214] [INFO ] [MAIN ] Derivative Progress: 158/2211 symbols completed. ATKR took 1.3s. Estimated remaining: 13m 55s. Rate: 147.4 symbols/min [2025-09-28T02:59:41.896375] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:41.910559] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:41.911518] [INFO ] [MAIN ] ATMU: Generated 1820 derivative records from 40274 primary records. [2025-09-28T02:59:41.911781] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-28T02:59:41.928627] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1820 records). [2025-09-28T02:59:41.928972] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-28T02:59:41.931599] [INFO ] [MAIN ] Derivative Progress: 159/2211 symbols completed. ATMU took 1.3s. Estimated remaining: 13m 50s. Rate: 148.3 symbols/min [2025-09-28T02:59:41.931941] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:41.972968] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-28T02:59:41.984612] [INFO ] [MAIN ] ATR: Loaded 30839 primary data records. [2025-09-28T02:59:41.997883] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-28T02:59:42.043063] [INFO ] [MAIN ] ATO: Loaded 42489 primary data records. [2025-09-28T02:59:42.111772] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-28T02:59:42.154713] [INFO ] [MAIN ] ATS: Loaded 18145 primary data records. [2025-09-28T02:59:42.987272] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:42.989227] [INFO ] [MAIN ] ATR: Generated 1820 derivative records from 30839 primary records. [2025-09-28T02:59:42.989693] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-28T02:59:43.009567] [DEBUG] [LOCAL ] ATR: Derivative data saved (1820 records). [2025-09-28T02:59:43.011577] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-28T02:59:43.014832] [INFO ] [MAIN ] Derivative Progress: 160/2211 symbols completed. ATR took 1.1s. Estimated remaining: 13m 59s. Rate: 146.7 symbols/min [2025-09-28T02:59:43.015444] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:43.034705] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:43.044023] [INFO ] [MAIN ] ATO: Generated 1820 derivative records from 42489 primary records. [2025-09-28T02:59:43.049410] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-28T02:59:43.049818] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:43.051582] [INFO ] [MAIN ] ATS: Generated 1820 derivative records from 18145 primary records. [2025-09-28T02:59:43.059846] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-28T02:59:43.070691] [DEBUG] [LOCAL ] ATO: Derivative data saved (1820 records). [2025-09-28T02:59:43.071143] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-28T02:59:43.074353] [INFO ] [MAIN ] Derivative Progress: 161/2211 symbols completed. ATO took 1.2s. Estimated remaining: 13m 54s. Rate: 147.5 symbols/min [2025-09-28T02:59:43.083056] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:43.092239] [DEBUG] [LOCAL ] ATS: Derivative data saved (1820 records). [2025-09-28T02:59:43.092459] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-28T02:59:43.095007] [INFO ] [MAIN ] Derivative Progress: 162/2211 symbols completed. ATS took 1.2s. Estimated remaining: 13m 48s. Rate: 148.4 symbols/min [2025-09-28T02:59:43.095308] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:43.131402] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-28T02:59:43.131752] [INFO ] [MAIN ] ATUS: Loaded 49958 primary data records. [2025-09-28T02:59:43.552901] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-28T02:59:43.553112] [DEBUG] [LOCAL ] AU: Loaded 53715 existing records from primary storage. [2025-09-28T02:59:43.553464] [INFO ] [MAIN ] AU: Loaded 53715 primary data records. [2025-09-28T02:59:43.553538] [INFO ] [MAIN ] AUB: Loaded 47072 primary data records. [2025-09-28T02:59:44.245927] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:44.248093] [INFO ] [MAIN ] ATUS: Generated 1820 derivative records from 49958 primary records. [2025-09-28T02:59:44.249376] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-28T02:59:44.270564] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1820 records). [2025-09-28T02:59:44.271157] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-28T02:59:44.274995] [INFO ] [MAIN ] Derivative Progress: 163/2211 symbols completed. ATUS took 1.3s. Estimated remaining: 13m 58s. Rate: 146.7 symbols/min [2025-09-28T02:59:44.292887] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:44.293725] [INFO ] [MAIN ] AU: Generated 1820 derivative records from 53715 primary records. [2025-09-28T02:59:44.294076] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-28T02:59:44.314478] [DEBUG] [LOCAL ] AU: Derivative data saved (1820 records). [2025-09-28T02:59:44.314813] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-28T02:59:44.317814] [INFO ] [MAIN ] Derivative Progress: 164/2211 symbols completed. AU took 1.2s. Estimated remaining: 13m 53s. Rate: 147.5 symbols/min [2025-09-28T02:59:44.330777] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:44.331687] [INFO ] [MAIN ] AUB: Generated 1820 derivative records from 47072 primary records. [2025-09-28T02:59:44.332072] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-28T02:59:44.349162] [DEBUG] [LOCAL ] AUB: Derivative data saved (1820 records). [2025-09-28T02:59:44.349276] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-28T02:59:44.353255] [INFO ] [MAIN ] Derivative Progress: 165/2211 symbols completed. AUB took 1.3s. Estimated remaining: 13m 48s. Rate: 148.3 symbols/min [2025-09-28T02:59:44.353772] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:44.353893] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:44.353989] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:44.363761] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-28T02:59:44.366925] [INFO ] [MAIN ] AUNA: Loaded 4966 primary data records. [2025-09-28T02:59:44.454972] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-28T02:59:44.466112] [INFO ] [MAIN ] AVAL: Loaded 9040 primary data records. [2025-09-28T02:59:44.845741] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-28T02:59:44.900517] [INFO ] [MAIN ] AVA: Loaded 40183 primary data records. [2025-09-28T02:59:45.375039] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:45.376431] [INFO ] [MAIN ] AUNA: Generated 1820 derivative records from 4966 primary records. [2025-09-28T02:59:45.377405] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-28T02:59:45.406348] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1820 records). [2025-09-28T02:59:45.406959] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-28T02:59:45.409168] [INFO ] [MAIN ] Derivative Progress: 166/2211 symbols completed. AUNA took 1.1s. Estimated remaining: 13m 55s. Rate: 146.9 symbols/min [2025-09-28T02:59:45.406630] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:45.410194] [INFO ] [MAIN ] AVAL: Generated 1820 derivative records from 9040 primary records. [2025-09-28T02:59:45.410385] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:45.410611] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-28T02:59:45.428860] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1820 records). [2025-09-28T02:59:45.428997] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-28T02:59:45.431431] [INFO ] [MAIN ] Derivative Progress: 167/2211 symbols completed. AVAL took 1.1s. Estimated remaining: 13m 50s. Rate: 147.7 symbols/min [2025-09-28T02:59:45.431674] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:45.450742] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:45.451842] [INFO ] [MAIN ] AVA: Generated 1820 derivative records from 40183 primary records. [2025-09-28T02:59:45.452000] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-28T02:59:45.487685] [DEBUG] [LOCAL ] AVA: Derivative data saved (1820 records). [2025-09-28T02:59:45.487955] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-28T02:59:45.491037] [INFO ] [MAIN ] Derivative Progress: 168/2211 symbols completed. AVA took 1.1s. Estimated remaining: 13m 46s. Rate: 148.5 symbols/min [2025-09-28T02:59:45.491426] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:45.514244] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-28T02:59:45.515593] [INFO ] [MAIN ] AVD: Loaded 23030 primary data records. [2025-09-28T02:59:45.521815] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-28T02:59:45.550392] [INFO ] [MAIN ] AVB: Loaded 42457 primary data records. [2025-09-28T02:59:45.718846] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-28T02:59:45.764443] [INFO ] [MAIN ] AVK: Loaded 18064 primary data records. [2025-09-28T02:59:46.530800] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:46.531793] [INFO ] [MAIN ] AVD: Generated 1820 derivative records from 23030 primary records. [2025-09-28T02:59:46.532085] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-28T02:59:46.553467] [DEBUG] [LOCAL ] AVD: Derivative data saved (1820 records). [2025-09-28T02:59:46.554179] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-28T02:59:46.569666] [INFO ] [MAIN ] Derivative Progress: 169/2211 symbols completed. AVD took 1.1s. Estimated remaining: 13m 53s. Rate: 147.0 symbols/min [2025-09-28T02:59:46.570119] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:46.570488] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:46.571815] [INFO ] [MAIN ] AVB: Generated 1820 derivative records from 42457 primary records. [2025-09-28T02:59:46.572132] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-28T02:59:46.605463] [DEBUG] [LOCAL ] AVB: Derivative data saved (1820 records). [2025-09-28T02:59:46.606442] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-28T02:59:46.609172] [INFO ] [MAIN ] Derivative Progress: 170/2211 symbols completed. AVB took 1.2s. Estimated remaining: 13m 49s. Rate: 147.8 symbols/min [2025-09-28T02:59:46.606344] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:46.609349] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:46.610437] [INFO ] [MAIN ] AVK: Generated 1820 derivative records from 18064 primary records. [2025-09-28T02:59:46.610955] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-28T02:59:46.636756] [DEBUG] [LOCAL ] AVK: Derivative data saved (1820 records). [2025-09-28T02:59:46.637403] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-28T02:59:46.640300] [INFO ] [MAIN ] Derivative Progress: 171/2211 symbols completed. AVK took 1.1s. Estimated remaining: 13m 44s. Rate: 148.6 symbols/min [2025-09-28T02:59:46.640588] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:46.654564] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-28T02:59:46.655182] [INFO ] [MAIN ] AVNS: Loaded 34132 primary data records. [2025-09-28T02:59:46.993717] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-28T02:59:47.011288] [INFO ] [MAIN ] AVNT: Loaded 39887 primary data records. [2025-09-28T02:59:47.181014] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-28T02:59:47.206496] [INFO ] [MAIN ] AVTR: Loaded 54345 primary data records. [2025-09-28T02:59:47.690942] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:47.704520] [INFO ] [MAIN ] AVNS: Generated 1820 derivative records from 34132 primary records. [2025-09-28T02:59:47.745500] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-28T02:59:48.002179] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1820 records). [2025-09-28T02:59:48.003549] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-28T02:59:48.006508] [INFO ] [MAIN ] Derivative Progress: 172/2211 symbols completed. AVNS took 1.4s. Estimated remaining: 13m 55s. Rate: 146.6 symbols/min [2025-09-28T02:59:48.007710] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:48.034603] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:48.036280] [INFO ] [MAIN ] AVNT: Generated 1820 derivative records from 39887 primary records. [2025-09-28T02:59:48.036629] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-28T02:59:48.056865] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1820 records). [2025-09-28T02:59:48.057029] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-28T02:59:48.059296] [INFO ] [MAIN ] Derivative Progress: 173/2211 symbols completed. AVNT took 1.4s. Estimated remaining: 13m 50s. Rate: 147.3 symbols/min [2025-09-28T02:59:48.059912] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:48.090352] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:48.091402] [INFO ] [MAIN ] AVTR: Generated 1820 derivative records from 54345 primary records. [2025-09-28T02:59:48.091597] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-28T02:59:48.131087] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1820 records). [2025-09-28T02:59:48.130827] [DEBUG] [LOCAL ] AVY: Loaded 38102 existing records from primary storage. [2025-09-28T02:59:48.131279] [INFO ] [MAIN ] AVY: Loaded 38102 primary data records. [2025-09-28T02:59:48.131350] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-28T02:59:48.134870] [INFO ] [MAIN ] Derivative Progress: 174/2211 symbols completed. AVTR took 1.5s. Estimated remaining: 13m 46s. Rate: 148.0 symbols/min [2025-09-28T02:59:48.147202] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:48.228268] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-28T02:59:48.254765] [INFO ] [MAIN ] AWF: Loaded 24608 primary data records. [2025-09-28T02:59:48.639506] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-28T02:59:48.681275] [INFO ] [MAIN ] AWI: Loaded 26185 primary data records. [2025-09-28T02:59:49.150875] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:49.152843] [INFO ] [MAIN ] AVY: Generated 1820 derivative records from 38102 primary records. [2025-09-28T02:59:49.153403] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-28T02:59:49.175235] [DEBUG] [LOCAL ] AVY: Derivative data saved (1820 records). [2025-09-28T02:59:49.175963] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-28T02:59:49.192139] [INFO ] [MAIN ] Derivative Progress: 175/2211 symbols completed. AVY took 1.2s. Estimated remaining: 13m 53s. Rate: 146.7 symbols/min [2025-09-28T02:59:49.193048] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:49.193342] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:49.194495] [INFO ] [MAIN ] AWF: Generated 1820 derivative records from 24608 primary records. [2025-09-28T02:59:49.195006] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-28T02:59:49.213972] [DEBUG] [LOCAL ] AWF: Derivative data saved (1820 records). [2025-09-28T02:59:49.214422] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-28T02:59:49.219595] [INFO ] [MAIN ] Derivative Progress: 176/2211 symbols completed. AWF took 1.2s. Estimated remaining: 13m 48s. Rate: 147.4 symbols/min [2025-09-28T02:59:49.221195] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:49.236237] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:49.237264] [INFO ] [MAIN ] AWI: Generated 1820 derivative records from 26185 primary records. [2025-09-28T02:59:49.237458] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-28T02:59:49.261096] [DEBUG] [LOCAL ] AWI: Derivative data saved (1820 records). [2025-09-28T02:59:49.261469] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-28T02:59:49.263973] [INFO ] [MAIN ] Derivative Progress: 177/2211 symbols completed. AWI took 1.1s. Estimated remaining: 13m 44s. Rate: 148.2 symbols/min [2025-09-28T02:59:49.264304] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:49.273488] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-28T02:59:49.273845] [INFO ] [MAIN ] AWP: Loaded 21835 primary data records. [2025-09-28T02:59:49.443379] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-28T02:59:49.464373] [INFO ] [MAIN ] AWK: Loaded 49489 primary data records. [2025-09-28T02:59:49.481780] [DEBUG] [LOCAL ] AWR: Loaded 22993 existing records from primary storage. [2025-09-28T02:59:49.630465] [INFO ] [MAIN ] AWR: Loaded 22993 primary data records. [2025-09-28T02:59:50.347926] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:50.350636] [INFO ] [MAIN ] AWP: Generated 1820 derivative records from 21835 primary records. [2025-09-28T02:59:50.351386] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-28T02:59:50.369265] [DEBUG] [LOCAL ] AWP: Derivative data saved (1820 records). [2025-09-28T02:59:50.369573] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-28T02:59:50.372159] [INFO ] [MAIN ] Derivative Progress: 178/2211 symbols completed. AWP took 1.2s. Estimated remaining: 13m 51s. Rate: 146.8 symbols/min [2025-09-28T02:59:50.391633] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:50.392574] [INFO ] [MAIN ] AWK: Generated 1820 derivative records from 49489 primary records. [2025-09-28T02:59:50.392819] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-28T02:59:50.410024] [DEBUG] [LOCAL ] AWK: Derivative data saved (1820 records). [2025-09-28T02:59:50.411915] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-28T02:59:50.415157] [INFO ] [MAIN ] Derivative Progress: 179/2211 symbols completed. AWK took 1.2s. Estimated remaining: 13m 47s. Rate: 147.5 symbols/min [2025-09-28T02:59:50.428312] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:50.429045] [INFO ] [MAIN ] AWR: Generated 1820 derivative records from 22993 primary records. [2025-09-28T02:59:50.429132] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-28T02:59:50.444484] [DEBUG] [LOCAL ] AWR: Derivative data saved (1820 records). [2025-09-28T02:59:50.444569] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-28T02:59:50.447792] [INFO ] [MAIN ] Derivative Progress: 180/2211 symbols completed. AWR took 1.2s. Estimated remaining: 13m 42s. Rate: 148.2 symbols/min [2025-09-28T02:59:50.448389] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:50.448284] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:50.448682] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:50.481398] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-28T02:59:50.482348] [INFO ] [MAIN ] AX: Loaded 28929 primary data records. [2025-09-28T02:59:50.854683] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-28T02:59:50.870556] [INFO ] [MAIN ] AXL: Loaded 51239 primary data records. [2025-09-28T02:59:50.869449] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-28T02:59:50.870818] [INFO ] [MAIN ] AXP: Loaded 53999 primary data records. [2025-09-28T02:59:51.545244] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:51.547189] [INFO ] [MAIN ] AX: Generated 1820 derivative records from 28929 primary records. [2025-09-28T02:59:51.547491] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-28T02:59:51.569130] [DEBUG] [LOCAL ] AX: Derivative data saved (1820 records). [2025-09-28T02:59:51.572398] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-28T02:59:51.574955] [INFO ] [MAIN ] Derivative Progress: 181/2211 symbols completed. AX took 1.1s. Estimated remaining: 13m 50s. Rate: 146.8 symbols/min [2025-09-28T02:59:51.575698] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:51.589691] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:51.591317] [INFO ] [MAIN ] AXL: Generated 1820 derivative records from 51239 primary records. [2025-09-28T02:59:51.593286] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-28T02:59:51.596853] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-28T02:59:51.596979] [INFO ] [MAIN ] AXR: Loaded 3220 primary data records. [2025-09-28T02:59:51.747400] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:51.727590] [DEBUG] [LOCAL ] AXL: Derivative data saved (1820 records). [2025-09-28T02:59:51.795756] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-28T02:59:51.806772] [INFO ] [MAIN ] Derivative Progress: 182/2211 symbols completed. AXL took 1.4s. Estimated remaining: 13m 47s. Rate: 147.1 symbols/min [2025-09-28T02:59:51.797908] [INFO ] [MAIN ] AXP: Generated 1820 derivative records from 53999 primary records. [2025-09-28T02:59:51.842489] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-28T02:59:51.843380] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:52.035045] [DEBUG] [LOCAL ] AXP: Derivative data saved (1820 records). [2025-09-28T02:59:52.035273] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-28T02:59:52.039544] [INFO ] [MAIN ] Derivative Progress: 183/2211 symbols completed. AXP took 1.6s. Estimated remaining: 13m 45s. Rate: 147.5 symbols/min [2025-09-28T02:59:52.040402] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:52.074497] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-28T02:59:52.075296] [INFO ] [MAIN ] AXR: Generated 1818 derivative records from 3220 primary records. [2025-09-28T02:59:52.075506] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-28T02:59:52.090420] [DEBUG] [LOCAL ] AXR: Derivative data saved (1818 records). [2025-09-28T02:59:52.091378] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-28T02:59:52.094329] [INFO ] [MAIN ] Derivative Progress: 184/2211 symbols completed. AXR took 0.5s. Estimated remaining: 13m 41s. Rate: 148.2 symbols/min [2025-09-28T02:59:52.107834] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:52.110290] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-28T02:59:52.125159] [INFO ] [MAIN ] AXS: Loaded 38920 primary data records. [2025-09-28T02:59:52.260624] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-28T02:59:52.276059] [INFO ] [MAIN ] AXTA: Loaded 52835 primary data records. [2025-09-28T02:59:52.473574] [DEBUG] [LOCAL ] AYI: Loaded 25446 existing records from primary storage. [2025-09-28T02:59:52.611913] [INFO ] [MAIN ] AYI: Loaded 25446 primary data records. [2025-09-28T02:59:53.157252] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:53.158613] [INFO ] [MAIN ] AXS: Generated 1820 derivative records from 38920 primary records. [2025-09-28T02:59:53.159588] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-28T02:59:53.181407] [DEBUG] [LOCAL ] AXS: Derivative data saved (1820 records). [2025-09-28T02:59:53.194417] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-28T02:59:53.197538] [INFO ] [MAIN ] Derivative Progress: 185/2211 symbols completed. AXS took 1.4s. Estimated remaining: 13m 48s. Rate: 146.8 symbols/min [2025-09-28T02:59:53.198047] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:53.198215] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:53.199407] [INFO ] [MAIN ] AXTA: Generated 1820 derivative records from 52835 primary records. [2025-09-28T02:59:53.199880] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-28T02:59:53.230687] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-28T02:59:53.238426] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1820 records). [2025-09-28T02:59:53.237868] [INFO ] [MAIN ] AYI: Generated 1819 derivative records from 25446 primary records. [2025-09-28T02:59:53.238688] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-28T02:59:53.238621] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-28T02:59:53.241593] [INFO ] [MAIN ] Derivative Progress: 186/2211 symbols completed. AXTA took 1.2s. Estimated remaining: 13m 44s. Rate: 147.5 symbols/min [2025-09-28T02:59:53.248531] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-28T02:59:53.255901] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:53.264223] [DEBUG] [LOCAL ] AYI: Derivative data saved (1819 records). [2025-09-28T02:59:53.260348] [INFO ] [MAIN ] AZO: Loaded 11687 primary data records. [2025-09-28T02:59:53.264505] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-28T02:59:53.267002] [INFO ] [MAIN ] Derivative Progress: 187/2211 symbols completed. AYI took 1.2s. Estimated remaining: 13m 39s. Rate: 148.3 symbols/min [2025-09-28T02:59:53.267407] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:53.596876] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-28T02:59:53.597092] [INFO ] [MAIN ] AZZ: Loaded 22359 primary data records. [2025-09-28T02:59:53.943383] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-28T02:59:53.960680] [INFO ] [MAIN ] BA: Loaded 54571 primary data records. [2025-09-28T02:59:54.138980] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:54.238526] [INFO ] [MAIN ] AZO: Generated 1820 derivative records from 11687 primary records. [2025-09-28T02:59:54.345716] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-28T02:59:54.367974] [DEBUG] [LOCAL ] AZO: Derivative data saved (1820 records). [2025-09-28T02:59:54.370436] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-28T02:59:54.373720] [INFO ] [MAIN ] Derivative Progress: 188/2211 symbols completed. AZO took 1.2s. Estimated remaining: 13m 46s. Rate: 146.9 symbols/min [2025-09-28T02:59:54.374327] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:54.388523] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:54.390311] [INFO ] [MAIN ] AZZ: Generated 1820 derivative records from 22359 primary records. [2025-09-28T02:59:54.390580] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-28T02:59:54.407988] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1820 records). [2025-09-28T02:59:54.408609] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-28T02:59:54.411330] [INFO ] [MAIN ] Derivative Progress: 189/2211 symbols completed. AZZ took 1.2s. Estimated remaining: 13m 42s. Rate: 147.6 symbols/min [2025-09-28T02:59:54.411831] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:54.429005] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:54.429753] [INFO ] [MAIN ] BA: Generated 1820 derivative records from 54571 primary records. [2025-09-28T02:59:54.429852] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-28T02:59:54.446844] [DEBUG] [LOCAL ] BA: Derivative data saved (1820 records). [2025-09-28T02:59:54.447043] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-28T02:59:54.449710] [INFO ] [MAIN ] Derivative Progress: 190/2211 symbols completed. BA took 1.2s. Estimated remaining: 13m 37s. Rate: 148.3 symbols/min [2025-09-28T02:59:54.450017] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:54.494943] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-28T02:59:54.511195] [INFO ] [MAIN ] BABA: Loaded 54600 primary data records. [2025-09-28T02:59:54.696252] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-28T02:59:54.721409] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-28T02:59:54.741684] [INFO ] [MAIN ] BAC: Loaded 54588 primary data records. [2025-09-28T02:59:54.767811] [INFO ] [MAIN ] BAH: Loaded 52477 primary data records. [2025-09-28T02:59:55.561055] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:55.562420] [INFO ] [MAIN ] BABA: Generated 1820 derivative records from 54600 primary records. [2025-09-28T02:59:55.562671] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-28T02:59:55.583584] [DEBUG] [LOCAL ] BABA: Derivative data saved (1820 records). [2025-09-28T02:59:55.584089] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-28T02:59:55.587461] [INFO ] [MAIN ] Derivative Progress: 191/2211 symbols completed. BABA took 1.2s. Estimated remaining: 13m 45s. Rate: 146.9 symbols/min [2025-09-28T02:59:55.587942] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:55.610827] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:55.613356] [INFO ] [MAIN ] BAC: Generated 1820 derivative records from 54588 primary records. [2025-09-28T02:59:55.613739] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-28T02:59:55.644842] [DEBUG] [LOCAL ] BAC: Derivative data saved (1820 records). [2025-09-28T02:59:55.645028] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-28T02:59:55.640446] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:55.648063] [INFO ] [MAIN ] Derivative Progress: 192/2211 symbols completed. BAC took 1.2s. Estimated remaining: 13m 41s. Rate: 147.6 symbols/min [2025-09-28T02:59:55.649369] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:55.649273] [INFO ] [MAIN ] BAH: Generated 1820 derivative records from 52477 primary records. [2025-09-28T02:59:55.649673] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-28T02:59:55.677695] [DEBUG] [LOCAL ] BAH: Derivative data saved (1820 records). [2025-09-28T02:59:55.677909] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-28T02:59:55.680338] [INFO ] [MAIN ] Derivative Progress: 193/2211 symbols completed. BAH took 1.2s. Estimated remaining: 13m 36s. Rate: 148.3 symbols/min [2025-09-28T02:59:55.697119] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-28T02:59:55.697310] [INFO ] [MAIN ] BAK: Loaded 39413 primary data records. [2025-09-28T02:59:56.052619] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-28T02:59:56.052916] [INFO ] [MAIN ] BALL: Loaded 52583 primary data records. [2025-09-28T02:59:56.450450] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:56.451406] [INFO ] [MAIN ] BAK: Generated 1820 derivative records from 39413 primary records. [2025-09-28T02:59:56.451501] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-28T02:59:56.469098] [DEBUG] [LOCAL ] BAK: Derivative data saved (1820 records). [2025-09-28T02:59:56.469377] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-28T02:59:56.471560] [INFO ] [MAIN ] Derivative Progress: 194/2211 symbols completed. BAK took 0.9s. Estimated remaining: 13m 40s. Rate: 147.6 symbols/min [2025-09-28T02:59:56.488233] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:56.488932] [INFO ] [MAIN ] BALL: Generated 1820 derivative records from 52583 primary records. [2025-09-28T02:59:56.489035] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-28T02:59:56.504477] [DEBUG] [LOCAL ] BALL: Derivative data saved (1820 records). [2025-09-28T02:59:56.504595] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-28T02:59:56.507342] [INFO ] [MAIN ] Derivative Progress: 195/2211 symbols completed. BALL took 0.9s. Estimated remaining: 13m 36s. Rate: 148.3 symbols/min [2025-09-28T02:59:56.507945] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:56.507861] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:56.508388] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:56.542471] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-28T02:59:56.542870] [INFO ] [MAIN ] BAP: Loaded 26635 primary data records. [2025-09-28T02:59:56.779205] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-28T02:59:56.917186] [INFO ] [MAIN ] BAM: Loaded 52779 primary data records. [2025-09-28T02:59:56.918559] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-28T02:59:56.930883] [INFO ] [MAIN ] BANC: Loaded 52019 primary data records. [2025-09-28T02:59:57.570467] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:57.572725] [INFO ] [MAIN ] BAP: Generated 1820 derivative records from 26635 primary records. [2025-09-28T02:59:57.573106] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-28T02:59:57.595212] [DEBUG] [LOCAL ] BAP: Derivative data saved (1820 records). [2025-09-28T02:59:57.595829] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-28T02:59:57.598480] [INFO ] [MAIN ] Derivative Progress: 196/2211 symbols completed. BAP took 1.1s. Estimated remaining: 13m 42s. Rate: 147.0 symbols/min [2025-09-28T02:59:57.598732] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:57.616994] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:57.617988] [INFO ] [MAIN ] BAM: Generated 1820 derivative records from 52779 primary records. [2025-09-28T02:59:57.618279] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-28T02:59:57.651125] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:57.652055] [INFO ] [MAIN ] BANC: Generated 1820 derivative records from 52019 primary records. [2025-09-28T02:59:57.652312] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-28T02:59:57.650799] [DEBUG] [LOCAL ] BAM: Derivative data saved (1820 records). [2025-09-28T02:59:57.653096] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-28T02:59:57.655675] [INFO ] [MAIN ] Derivative Progress: 197/2211 symbols completed. BAM took 1.1s. Estimated remaining: 13m 38s. Rate: 147.6 symbols/min [2025-09-28T02:59:57.663295] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:57.681723] [DEBUG] [LOCAL ] BANC: Derivative data saved (1820 records). [2025-09-28T02:59:57.681989] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-28T02:59:57.684902] [INFO ] [MAIN ] Derivative Progress: 198/2211 symbols completed. BANC took 1.2s. Estimated remaining: 13m 34s. Rate: 148.3 symbols/min [2025-09-28T02:59:57.685333] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:57.706564] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-28T02:59:57.706833] [INFO ] [MAIN ] BARK: Loaded 38893 primary data records. [2025-09-28T02:59:58.079947] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-28T02:59:58.080463] [INFO ] [MAIN ] BAX: Loaded 54273 primary data records. [2025-09-28T02:59:58.081271] [DEBUG] [LOCAL ] BB: Loaded 53701 existing records from primary storage. [2025-09-28T02:59:58.082595] [INFO ] [MAIN ] BB: Loaded 53701 primary data records. [2025-09-28T02:59:58.811412] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:58.813026] [INFO ] [MAIN ] BARK: Generated 1820 derivative records from 38893 primary records. [2025-09-28T02:59:58.813145] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-28T02:59:58.832381] [DEBUG] [LOCAL ] BARK: Derivative data saved (1820 records). [2025-09-28T02:59:58.833051] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-28T02:59:58.835666] [INFO ] [MAIN ] Derivative Progress: 199/2211 symbols completed. BARK took 1.2s. Estimated remaining: 13m 41s. Rate: 147.0 symbols/min [2025-09-28T02:59:58.835995] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:58.856187] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:58.858967] [INFO ] [MAIN ] BB: Generated 1820 derivative records from 53701 primary records. [2025-09-28T02:59:58.859421] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-28T02:59:58.889587] [DEBUG] [LOCAL ] BB: Derivative data saved (1820 records). [2025-09-28T02:59:58.887820] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T02:59:58.889792] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-28T02:59:58.890570] [INFO ] [MAIN ] BAX: Generated 1820 derivative records from 54273 primary records. [2025-09-28T02:59:58.890816] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-28T02:59:58.893429] [INFO ] [MAIN ] Derivative Progress: 200/2211 symbols completed. BB took 1.2s. Estimated remaining: 13m 37s. Rate: 147.6 symbols/min [2025-09-28T02:59:58.894378] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:58.912079] [DEBUG] [LOCAL ] BAX: Derivative data saved (1820 records). [2025-09-28T02:59:58.912343] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-28T02:59:58.914549] [INFO ] [MAIN ] Derivative Progress: 201/2211 symbols completed. BAX took 1.3s. Estimated remaining: 13m 33s. Rate: 148.3 symbols/min [2025-09-28T02:59:58.929273] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-28T02:59:58.954810] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-28T02:59:58.955579] [INFO ] [MAIN ] BBAI: Loaded 54600 primary data records. [2025-09-28T02:59:59.108053] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-28T02:59:59.119113] [INFO ] [MAIN ] BBAR: Loaded 41988 primary data records. [2025-09-28T02:59:59.440717] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-28T02:59:59.445393] [INFO ] [MAIN ] BBD: Loaded 53959 primary data records. [2025-09-28T02:59:59.998309] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:00.000109] [INFO ] [MAIN ] BBAI: Generated 1820 derivative records from 54600 primary records. [2025-09-28T03:00:00.000689] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-28T03:00:00.019188] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1820 records). [2025-09-28T03:00:00.021134] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-28T03:00:00.024466] [INFO ] [MAIN ] Derivative Progress: 202/2211 symbols completed. BBAI took 1.2s. Estimated remaining: 13m 40s. Rate: 147.0 symbols/min [2025-09-28T03:00:00.026236] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:00.040804] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:00.041769] [INFO ] [MAIN ] BBAR: Generated 1820 derivative records from 41988 primary records. [2025-09-28T03:00:00.042389] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-28T03:00:00.060751] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1820 records). [2025-09-28T03:00:00.062220] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-28T03:00:00.065617] [INFO ] [MAIN ] Derivative Progress: 203/2211 symbols completed. BBAR took 1.2s. Estimated remaining: 13m 36s. Rate: 147.7 symbols/min [2025-09-28T03:00:00.075371] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:00.089570] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:00.090673] [INFO ] [MAIN ] BBD: Generated 1820 derivative records from 53959 primary records. [2025-09-28T03:00:00.093153] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-28T03:00:00.108179] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-28T03:00:00.108750] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-28T03:00:00.108923] [INFO ] [MAIN ] BBDC: Loaded 33756 primary data records. [2025-09-28T03:00:00.109283] [INFO ] [MAIN ] BBDO: Loaded 5051 primary data records. [2025-09-28T03:00:00.346230] [DEBUG] [LOCAL ] BBD: Derivative data saved (1820 records). [2025-09-28T03:00:00.353854] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-28T03:00:00.367587] [INFO ] [MAIN ] Derivative Progress: 204/2211 symbols completed. BBD took 1.4s. Estimated remaining: 13m 34s. Rate: 147.9 symbols/min [2025-09-28T03:00:00.457435] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:00.833241] [DEBUG] [LOCAL ] BBN: Loaded 18193 existing records from primary storage. [2025-09-28T03:00:00.833991] [INFO ] [MAIN ] BBN: Loaded 18193 primary data records. [2025-09-28T03:00:00.992010] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:01.031756] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:01.032627] [INFO ] [MAIN ] BBDO: Generated 1820 derivative records from 5051 primary records. [2025-09-28T03:00:01.039507] [INFO ] [MAIN ] BBDC: Generated 1820 derivative records from 33756 primary records. [2025-09-28T03:00:01.204209] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-28T03:00:01.213741] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-28T03:00:01.247128] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1820 records). [2025-09-28T03:00:01.249524] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1820 records). [2025-09-28T03:00:01.250481] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-28T03:00:01.250388] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-28T03:00:01.253293] [INFO ] [MAIN ] Derivative Progress: 205/2211 symbols completed. BBDC took 1.2s. Estimated remaining: 13m 39s. Rate: 147.0 symbols/min [2025-09-28T03:00:01.254133] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:01.256858] [INFO ] [MAIN ] Derivative Progress: 206/2211 symbols completed. BBDO took 1.2s. Estimated remaining: 13m 34s. Rate: 147.7 symbols/min [2025-09-28T03:00:01.257971] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:01.267382] [DEBUG] [LOCAL ] BBU: Loaded 4478 existing records from primary storage. [2025-09-28T03:00:01.268442] [INFO ] [MAIN ] BBU: Loaded 4478 primary data records. [2025-09-28T03:00:01.394563] [DEBUG] [LOCAL ] BBUC: Loaded 13503 existing records from primary storage. [2025-09-28T03:00:01.417167] [INFO ] [MAIN ] BBUC: Loaded 13503 primary data records. [2025-09-28T03:00:01.720803] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:01.740347] [INFO ] [MAIN ] BBN: Generated 1820 derivative records from 18193 primary records. [2025-09-28T03:00:01.752981] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-28T03:00:01.990215] [DEBUG] [LOCAL ] BBN: Derivative data saved (1820 records). [2025-09-28T03:00:01.990849] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-28T03:00:01.994132] [INFO ] [MAIN ] Derivative Progress: 207/2211 symbols completed. BBN took 1.5s. Estimated remaining: 13m 37s. Rate: 147.2 symbols/min [2025-09-28T03:00:01.994779] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:02.017023] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-28T03:00:02.019454] [INFO ] [MAIN ] BBU: Generated 1819 derivative records from 4478 primary records. [2025-09-28T03:00:02.019574] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-28T03:00:02.037858] [DEBUG] [LOCAL ] BBU: Derivative data saved (1819 records). [2025-09-28T03:00:02.038515] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-28T03:00:02.041441] [INFO ] [MAIN ] Derivative Progress: 208/2211 symbols completed. BBU took 0.8s. Estimated remaining: 13m 33s. Rate: 147.8 symbols/min [2025-09-28T03:00:02.059424] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:02.060205] [INFO ] [MAIN ] BBUC: Generated 1820 derivative records from 13503 primary records. [2025-09-28T03:00:02.060332] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-28T03:00:02.088129] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1820 records). [2025-09-28T03:00:02.088299] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-28T03:00:02.090915] [INFO ] [MAIN ] Derivative Progress: 209/2211 symbols completed. BBUC took 0.8s. Estimated remaining: 13m 29s. Rate: 148.4 symbols/min [2025-09-28T03:00:02.107909] [DEBUG] [LOCAL ] BBVA: Loaded 50167 existing records from primary storage. [2025-09-28T03:00:02.108092] [INFO ] [MAIN ] BBVA: Loaded 50167 primary data records. [2025-09-28T03:00:02.434350] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:02.435178] [INFO ] [MAIN ] BBVA: Generated 1820 derivative records from 50167 primary records. [2025-09-28T03:00:02.435286] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-28T03:00:02.452349] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1820 records). [2025-09-28T03:00:02.452507] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-28T03:00:02.454707] [INFO ] [MAIN ] Derivative Progress: 210/2211 symbols completed. BBVA took 0.5s. Estimated remaining: 13m 29s. Rate: 148.5 symbols/min [2025-09-28T03:00:02.455327] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:02.455183] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:02.455253] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:02.496614] [DEBUG] [LOCAL ] BBW: Loaded 27177 existing records from primary storage. [2025-09-28T03:00:02.497004] [INFO ] [MAIN ] BBW: Loaded 27177 primary data records. [2025-09-28T03:00:02.727188] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-09-28T03:00:02.907120] [INFO ] [MAIN ] BBWI: Loaded 54360 primary data records. [2025-09-28T03:00:02.923392] [DEBUG] [LOCAL ] BBY: Loaded 54253 existing records from primary storage. [2025-09-28T03:00:02.954279] [INFO ] [MAIN ] BBY: Loaded 54253 primary data records. [2025-09-28T03:00:03.614930] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:03.616328] [INFO ] [MAIN ] BBW: Generated 1820 derivative records from 27177 primary records. [2025-09-28T03:00:03.617930] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-28T03:00:03.638131] [DEBUG] [LOCAL ] BBW: Derivative data saved (1820 records). [2025-09-28T03:00:03.638805] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-28T03:00:03.641574] [INFO ] [MAIN ] Derivative Progress: 211/2211 symbols completed. BBW took 1.2s. Estimated remaining: 13m 36s. Rate: 147.1 symbols/min [2025-09-28T03:00:03.642241] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:03.660799] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:03.661826] [INFO ] [MAIN ] BBWI: Generated 1820 derivative records from 54360 primary records. [2025-09-28T03:00:03.662157] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-28T03:00:03.693857] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:03.695875] [INFO ] [MAIN ] BBY: Generated 1820 derivative records from 54253 primary records. [2025-09-28T03:00:03.696356] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-28T03:00:03.708998] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1820 records). [2025-09-28T03:00:03.716356] [DEBUG] [LOCAL ] BBY: Derivative data saved (1820 records). [2025-09-28T03:00:03.716778] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-28T03:00:03.716623] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-28T03:00:03.720120] [INFO ] [MAIN ] Derivative Progress: 212/2211 symbols completed. BBWI took 1.3s. Estimated remaining: 13m 32s. Rate: 147.7 symbols/min [2025-09-28T03:00:03.722954] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:03.723177] [INFO ] [MAIN ] Derivative Progress: 213/2211 symbols completed. BBY took 1.3s. Estimated remaining: 13m 28s. Rate: 148.4 symbols/min [2025-09-28T03:00:03.723809] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:03.759498] [DEBUG] [LOCAL ] BC: Loaded 45020 existing records from primary storage. [2025-09-28T03:00:03.760510] [INFO ] [MAIN ] BC: Loaded 45020 primary data records. [2025-09-28T03:00:03.910540] [DEBUG] [LOCAL ] BCC: Loaded 28735 existing records from primary storage. [2025-09-28T03:00:03.996437] [DEBUG] [LOCAL ] BCAT: Loaded 34910 existing records from primary storage. [2025-09-28T03:00:03.973851] [INFO ] [MAIN ] BCC: Loaded 28735 primary data records. [2025-09-28T03:00:03.996749] [INFO ] [MAIN ] BCAT: Loaded 34910 primary data records. [2025-09-28T03:00:04.889710] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:04.890884] [INFO ] [MAIN ] BC: Generated 1820 derivative records from 45020 primary records. [2025-09-28T03:00:04.891012] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-28T03:00:04.910673] [DEBUG] [LOCAL ] BC: Derivative data saved (1820 records). [2025-09-28T03:00:04.911300] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-28T03:00:04.914274] [INFO ] [MAIN ] Derivative Progress: 214/2211 symbols completed. BC took 1.3s. Estimated remaining: 13m 35s. Rate: 147.0 symbols/min [2025-09-28T03:00:04.914662] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:04.936399] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:04.949616] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:04.950604] [INFO ] [MAIN ] BCAT: Generated 1820 derivative records from 34910 primary records. [2025-09-28T03:00:04.950740] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-28T03:00:04.951354] [INFO ] [MAIN ] BCC: Generated 1820 derivative records from 28735 primary records. [2025-09-28T03:00:04.951530] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-28T03:00:04.985003] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1820 records). [2025-09-28T03:00:04.987338] [DEBUG] [LOCAL ] BCC: Derivative data saved (1820 records). [2025-09-28T03:00:04.986311] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-28T03:00:04.987449] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-28T03:00:04.989986] [INFO ] [MAIN ] Derivative Progress: 215/2211 symbols completed. BCC took 1.3s. Estimated remaining: 13m 31s. Rate: 147.6 symbols/min [2025-09-28T03:00:04.992803] [INFO ] [MAIN ] Derivative Progress: 216/2211 symbols completed. BCAT took 1.3s. Estimated remaining: 13m 27s. Rate: 148.3 symbols/min [2025-09-28T03:00:04.992747] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:04.993128] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:05.041298] [DEBUG] [LOCAL ] BCE: Loaded 53072 existing records from primary storage. [2025-09-28T03:00:05.041878] [INFO ] [MAIN ] BCE: Loaded 53072 primary data records. [2025-09-28T03:00:05.136015] [DEBUG] [LOCAL ] BCH: Loaded 30039 existing records from primary storage. [2025-09-28T03:00:05.155264] [INFO ] [MAIN ] BCH: Loaded 30039 primary data records. [2025-09-28T03:00:05.251977] [DEBUG] [LOCAL ] BCO: Loaded 26740 existing records from primary storage. [2025-09-28T03:00:05.299070] [INFO ] [MAIN ] BCO: Loaded 26740 primary data records. [2025-09-28T03:00:06.112446] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:06.113469] [INFO ] [MAIN ] BCE: Generated 1820 derivative records from 53072 primary records. [2025-09-28T03:00:06.114542] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-28T03:00:06.147171] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:06.149019] [INFO ] [MAIN ] BCH: Generated 1820 derivative records from 30039 primary records. [2025-09-28T03:00:06.149137] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-28T03:00:06.166522] [DEBUG] [LOCAL ] BCE: Derivative data saved (1820 records). [2025-09-28T03:00:06.169669] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-28T03:00:06.172139] [INFO ] [MAIN ] Derivative Progress: 217/2211 symbols completed. BCE took 1.3s. Estimated remaining: 13m 34s. Rate: 147.0 symbols/min [2025-09-28T03:00:06.169587] [DEBUG] [LOCAL ] BCH: Derivative data saved (1820 records). [2025-09-28T03:00:06.172592] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:06.172502] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-28T03:00:06.186004] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:06.189977] [INFO ] [MAIN ] BCO: Generated 1820 derivative records from 26740 primary records. [2025-09-28T03:00:06.188788] [INFO ] [MAIN ] Derivative Progress: 218/2211 symbols completed. BCH took 1.2s. Estimated remaining: 13m 30s. Rate: 147.6 symbols/min [2025-09-28T03:00:06.190109] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-28T03:00:06.190280] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:06.207624] [DEBUG] [LOCAL ] BCO: Derivative data saved (1820 records). [2025-09-28T03:00:06.207930] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-28T03:00:06.210395] [INFO ] [MAIN ] Derivative Progress: 219/2211 symbols completed. BCO took 1.2s. Estimated remaining: 13m 26s. Rate: 148.3 symbols/min [2025-09-28T03:00:06.210751] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:06.246071] [DEBUG] [LOCAL ] BCSF: Loaded 28231 existing records from primary storage. [2025-09-28T03:00:06.253245] [INFO ] [MAIN ] BCSF: Loaded 28231 primary data records. [2025-09-28T03:00:06.267963] [DEBUG] [LOCAL ] BCX: Loaded 21920 existing records from primary storage. [2025-09-28T03:00:06.280055] [INFO ] [MAIN ] BCX: Loaded 21920 primary data records. [2025-09-28T03:00:06.485745] [DEBUG] [LOCAL ] BCS: Loaded 54242 existing records from primary storage. [2025-09-28T03:00:06.505498] [INFO ] [MAIN ] BCS: Loaded 54242 primary data records. [2025-09-28T03:00:07.368499] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:07.369573] [INFO ] [MAIN ] BCSF: Generated 1820 derivative records from 28231 primary records. [2025-09-28T03:00:07.377478] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-28T03:00:07.391549] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:07.396258] [INFO ] [MAIN ] BCX: Generated 1820 derivative records from 21920 primary records. [2025-09-28T03:00:07.399079] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-28T03:00:07.401712] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1820 records). [2025-09-28T03:00:07.401835] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-28T03:00:07.404448] [INFO ] [MAIN ] Derivative Progress: 220/2211 symbols completed. BCSF took 1.2s. Estimated remaining: 13m 33s. Rate: 147.0 symbols/min [2025-09-28T03:00:07.415689] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:07.420619] [DEBUG] [LOCAL ] BCX: Derivative data saved (1820 records). [2025-09-28T03:00:07.422987] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-28T03:00:07.425710] [INFO ] [MAIN ] Derivative Progress: 221/2211 symbols completed. BCX took 1.2s. Estimated remaining: 13m 29s. Rate: 147.6 symbols/min [2025-09-28T03:00:07.426208] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:07.440117] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:07.441008] [INFO ] [MAIN ] BCS: Generated 1820 derivative records from 54242 primary records. [2025-09-28T03:00:07.441141] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-28T03:00:07.459033] [DEBUG] [LOCAL ] BCS: Derivative data saved (1820 records). [2025-09-28T03:00:07.465607] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-28T03:00:07.468438] [INFO ] [MAIN ] Derivative Progress: 222/2211 symbols completed. BCS took 1.3s. Estimated remaining: 13m 25s. Rate: 148.2 symbols/min [2025-09-28T03:00:07.468873] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:07.488879] [DEBUG] [LOCAL ] BDC: Loaded 25073 existing records from primary storage. [2025-09-28T03:00:07.489161] [INFO ] [MAIN ] BDC: Loaded 25073 primary data records. [2025-09-28T03:00:07.593379] [DEBUG] [LOCAL ] BDJ: Loaded 29325 existing records from primary storage. [2025-09-28T03:00:07.607561] [INFO ] [MAIN ] BDJ: Loaded 29325 primary data records. [2025-09-28T03:00:07.869868] [DEBUG] [LOCAL ] BDN: Loaded 48230 existing records from primary storage. [2025-09-28T03:00:08.019042] [INFO ] [MAIN ] BDN: Loaded 48230 primary data records. [2025-09-28T03:00:08.555714] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:08.556565] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:08.557732] [INFO ] [MAIN ] BDJ: Generated 1820 derivative records from 29325 primary records. [2025-09-28T03:00:08.558804] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-28T03:00:08.558411] [INFO ] [MAIN ] BDC: Generated 1820 derivative records from 25073 primary records. [2025-09-28T03:00:08.559668] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-28T03:00:08.589920] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1820 records). [2025-09-28T03:00:08.590999] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-28T03:00:08.594304] [INFO ] [MAIN ] Derivative Progress: 223/2211 symbols completed. BDJ took 1.2s. Estimated remaining: 13m 31s. Rate: 147.0 symbols/min [2025-09-28T03:00:08.614479] [DEBUG] [LOCAL ] BDC: Derivative data saved (1820 records). [2025-09-28T03:00:08.614406] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:08.615461] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-28T03:00:08.615563] [INFO ] [MAIN ] BDN: Generated 1820 derivative records from 48230 primary records. [2025-09-28T03:00:08.618323] [INFO ] [MAIN ] Derivative Progress: 224/2211 symbols completed. BDC took 1.2s. Estimated remaining: 13m 27s. Rate: 147.7 symbols/min [2025-09-28T03:00:08.618421] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-28T03:00:08.635274] [DEBUG] [LOCAL ] BDN: Derivative data saved (1820 records). [2025-09-28T03:00:08.635380] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-28T03:00:08.638922] [INFO ] [MAIN ] Derivative Progress: 225/2211 symbols completed. BDN took 1.2s. Estimated remaining: 13m 24s. Rate: 148.3 symbols/min [2025-09-28T03:00:08.639418] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:08.639342] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:08.640097] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:08.734903] [DEBUG] [LOCAL ] BEKE: Loaded 54025 existing records from primary storage. [2025-09-28T03:00:08.735259] [INFO ] [MAIN ] BEKE: Loaded 54025 primary data records. [2025-09-28T03:00:08.911220] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-28T03:00:08.884325] [DEBUG] [LOCAL ] BDX: Loaded 53191 existing records from primary storage. [2025-09-28T03:00:08.938681] [INFO ] [MAIN ] BE: Loaded 54433 primary data records. [2025-09-28T03:00:08.963125] [INFO ] [MAIN ] BDX: Loaded 53191 primary data records. [2025-09-28T03:00:09.816925] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:09.818134] [INFO ] [MAIN ] BEKE: Generated 1820 derivative records from 54025 primary records. [2025-09-28T03:00:09.818615] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-28T03:00:09.856324] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1820 records). [2025-09-28T03:00:09.856881] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:09.857770] [INFO ] [MAIN ] BE: Generated 1820 derivative records from 54433 primary records. [2025-09-28T03:00:09.857022] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-28T03:00:09.857936] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-28T03:00:09.860961] [INFO ] [MAIN ] Derivative Progress: 226/2211 symbols completed. BEKE took 1.2s. Estimated remaining: 13m 30s. Rate: 147.0 symbols/min [2025-09-28T03:00:09.863461] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:09.882280] [DEBUG] [LOCAL ] BE: Derivative data saved (1820 records). [2025-09-28T03:00:09.882979] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-28T03:00:09.891191] [INFO ] [MAIN ] Derivative Progress: 227/2211 symbols completed. BE took 1.3s. Estimated remaining: 13m 27s. Rate: 147.6 symbols/min [2025-09-28T03:00:09.891635] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:09.901525] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:09.902327] [INFO ] [MAIN ] BDX: Generated 1820 derivative records from 53191 primary records. [2025-09-28T03:00:09.902428] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-28T03:00:09.921370] [DEBUG] [LOCAL ] BDX: Derivative data saved (1820 records). [2025-09-28T03:00:09.921663] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-28T03:00:09.924887] [INFO ] [MAIN ] Derivative Progress: 228/2211 symbols completed. BDX took 1.3s. Estimated remaining: 13m 23s. Rate: 148.2 symbols/min [2025-09-28T03:00:09.925219] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:09.973154] [DEBUG] [LOCAL ] BEP: Loaded 39244 existing records from primary storage. [2025-09-28T03:00:09.988814] [INFO ] [MAIN ] BEP: Loaded 39244 primary data records. [2025-09-28T03:00:10.025397] [DEBUG] [LOCAL ] BEN: Loaded 53833 existing records from primary storage. [2025-09-28T03:00:10.043957] [INFO ] [MAIN ] BEN: Loaded 53833 primary data records. [2025-09-28T03:00:10.533124] [DEBUG] [LOCAL ] BEPC: Loaded 47209 existing records from primary storage. [2025-09-28T03:00:10.573859] [INFO ] [MAIN ] BEPC: Loaded 47209 primary data records. [2025-09-28T03:00:11.070959] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:11.085194] [INFO ] [MAIN ] BEP: Generated 1820 derivative records from 39244 primary records. [2025-09-28T03:00:11.085865] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:11.086696] [INFO ] [MAIN ] BEN: Generated 1820 derivative records from 53833 primary records. [2025-09-28T03:00:11.086042] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-28T03:00:11.087046] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-28T03:00:11.114597] [DEBUG] [LOCAL ] BEP: Derivative data saved (1820 records). [2025-09-28T03:00:11.116510] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-28T03:00:11.118746] [INFO ] [MAIN ] Derivative Progress: 229/2211 symbols completed. BEP took 1.2s. Estimated remaining: 13m 29s. Rate: 146.9 symbols/min [2025-09-28T03:00:11.121744] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:11.127044] [DEBUG] [LOCAL ] BEN: Derivative data saved (1820 records). [2025-09-28T03:00:11.127584] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-28T03:00:11.130775] [INFO ] [MAIN ] Derivative Progress: 230/2211 symbols completed. BEN took 1.3s. Estimated remaining: 13m 26s. Rate: 147.5 symbols/min [2025-09-28T03:00:11.131217] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:11.157260] [DEBUG] [LOCAL ] BEPI: Loaded 3487 existing records from primary storage. [2025-09-28T03:00:11.158320] [INFO ] [MAIN ] BEPI: Loaded 3487 primary data records. [2025-09-28T03:00:11.158210] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:11.158457] [DEBUG] [LOCAL ] BEPH: Loaded 5208 existing records from primary storage. [2025-09-28T03:00:11.171461] [INFO ] [MAIN ] BEPC: Generated 1820 derivative records from 47209 primary records. [2025-09-28T03:00:11.171592] [INFO ] [MAIN ] BEPH: Loaded 5208 primary data records. [2025-09-28T03:00:11.181777] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-28T03:00:11.384736] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1820 records). [2025-09-28T03:00:11.423505] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-28T03:00:11.443194] [INFO ] [MAIN ] Derivative Progress: 231/2211 symbols completed. BEPC took 1.5s. Estimated remaining: 13m 24s. Rate: 147.7 symbols/min [2025-09-28T03:00:11.464257] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:11.915557] [DEBUG] [LOCAL ] BEPJ: Loaded 3268 existing records from primary storage. [2025-09-28T03:00:11.917774] [INFO ] [MAIN ] BEPJ: Loaded 3268 primary data records. [2025-09-28T03:00:12.288947] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:12.294626] [INFO ] [MAIN ] BEPI: Generated 1820 derivative records from 3487 primary records. [2025-09-28T03:00:12.295024] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:12.295725] [INFO ] [MAIN ] BEPH: Generated 1820 derivative records from 5208 primary records. [2025-09-28T03:00:12.296014] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-28T03:00:12.295860] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-28T03:00:12.319267] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1820 records). [2025-09-28T03:00:12.319560] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-28T03:00:12.322768] [INFO ] [MAIN ] Derivative Progress: 232/2211 symbols completed. BEPH took 1.2s. Estimated remaining: 13m 28s. Rate: 146.9 symbols/min [2025-09-28T03:00:12.323027] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:12.330608] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1820 records). [2025-09-28T03:00:12.330724] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-28T03:00:12.333704] [INFO ] [MAIN ] Derivative Progress: 233/2211 symbols completed. BEPI took 1.2s. Estimated remaining: 13m 24s. Rate: 147.6 symbols/min [2025-09-28T03:00:12.334094] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:12.352983] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:12.353846] [INFO ] [MAIN ] BEPJ: Generated 1820 derivative records from 3268 primary records. [2025-09-28T03:00:12.354162] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-28T03:00:12.371931] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1820 records). [2025-09-28T03:00:12.381550] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-28T03:00:12.383849] [INFO ] [MAIN ] Derivative Progress: 234/2211 symbols completed. BEPJ took 0.9s. Estimated remaining: 13m 21s. Rate: 148.1 symbols/min [2025-09-28T03:00:12.384209] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:12.414710] [DEBUG] [LOCAL ] BFAM: Loaded 33519 existing records from primary storage. [2025-09-28T03:00:12.426948] [INFO ] [MAIN ] BFAM: Loaded 33519 primary data records. [2025-09-28T03:00:12.428129] [DEBUG] [LOCAL ] BFH: Loaded 42308 existing records from primary storage. [2025-09-28T03:00:12.444352] [INFO ] [MAIN ] BFH: Loaded 42308 primary data records. [2025-09-28T03:00:12.475532] [DEBUG] [LOCAL ] BFK: Loaded 14145 existing records from primary storage. [2025-09-28T03:00:12.549812] [INFO ] [MAIN ] BFK: Loaded 14145 primary data records. [2025-09-28T03:00:13.477296] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:13.479923] [INFO ] [MAIN ] BFAM: Generated 1820 derivative records from 33519 primary records. [2025-09-28T03:00:13.492506] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-28T03:00:13.502302] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:13.516594] [INFO ] [MAIN ] BFK: Generated 1820 derivative records from 14145 primary records. [2025-09-28T03:00:13.517087] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:13.517945] [INFO ] [MAIN ] BFH: Generated 1820 derivative records from 42308 primary records. [2025-09-28T03:00:13.518044] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-28T03:00:13.522051] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-28T03:00:13.527683] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1820 records). [2025-09-28T03:00:13.538988] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-28T03:00:13.557781] [DEBUG] [LOCAL ] BFH: Derivative data saved (1820 records). [2025-09-28T03:00:13.561055] [DEBUG] [LOCAL ] BFK: Derivative data saved (1820 records). [2025-09-28T03:00:13.556569] [INFO ] [MAIN ] Derivative Progress: 235/2211 symbols completed. BFAM took 1.2s. Estimated remaining: 13m 27s. Rate: 146.9 symbols/min [2025-09-28T03:00:13.557917] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-28T03:00:13.563520] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-28T03:00:13.566230] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:13.566302] [INFO ] [MAIN ] Derivative Progress: 236/2211 symbols completed. BFH took 1.2s. Estimated remaining: 13m 23s. Rate: 147.5 symbols/min [2025-09-28T03:00:13.566682] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:13.566891] [INFO ] [MAIN ] Derivative Progress: 237/2211 symbols completed. BFK took 1.2s. Estimated remaining: 13m 19s. Rate: 148.2 symbols/min [2025-09-28T03:00:13.567735] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:13.585984] [DEBUG] [LOCAL ] BFS: Loaded 9240 existing records from primary storage. [2025-09-28T03:00:13.591681] [DEBUG] [LOCAL ] BFZ: Loaded 12223 existing records from primary storage. [2025-09-28T03:00:13.591962] [INFO ] [MAIN ] BFS: Loaded 9240 primary data records. [2025-09-28T03:00:13.592055] [INFO ] [MAIN ] BFZ: Loaded 12223 primary data records. [2025-09-28T03:00:14.006154] [DEBUG] [LOCAL ] BFLY: Loaded 52590 existing records from primary storage. [2025-09-28T03:00:14.259041] [INFO ] [MAIN ] BFLY: Loaded 52590 primary data records. [2025-09-28T03:00:14.627713] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:14.627331] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:14.629069] [INFO ] [MAIN ] BFZ: Generated 1820 derivative records from 12223 primary records. [2025-09-28T03:00:14.629609] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-28T03:00:14.631808] [INFO ] [MAIN ] BFS: Generated 1820 derivative records from 9240 primary records. [2025-09-28T03:00:14.632327] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-28T03:00:14.660099] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1820 records). [2025-09-28T03:00:14.663227] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-28T03:00:14.665720] [INFO ] [MAIN ] Derivative Progress: 238/2211 symbols completed. BFZ took 1.1s. Estimated remaining: 13m 25s. Rate: 147.1 symbols/min [2025-09-28T03:00:14.667298] [DEBUG] [LOCAL ] BFS: Derivative data saved (1820 records). [2025-09-28T03:00:14.667542] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-28T03:00:14.669797] [INFO ] [MAIN ] Derivative Progress: 239/2211 symbols completed. BFS took 1.1s. Estimated remaining: 13m 21s. Rate: 147.7 symbols/min [2025-09-28T03:00:14.686294] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:14.687008] [INFO ] [MAIN ] BFLY: Generated 1820 derivative records from 52590 primary records. [2025-09-28T03:00:14.687095] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-28T03:00:14.702406] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1820 records). [2025-09-28T03:00:14.702499] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-28T03:00:14.704915] [INFO ] [MAIN ] Derivative Progress: 240/2211 symbols completed. BFLY took 1.1s. Estimated remaining: 13m 18s. Rate: 148.3 symbols/min [2025-09-28T03:00:14.705367] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:14.705429] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:14.705319] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:14.724884] [DEBUG] [LOCAL ] BGH: Loaded 16728 existing records from primary storage. [2025-09-28T03:00:14.725043] [INFO ] [MAIN ] BGH: Loaded 16728 primary data records. [2025-09-28T03:00:14.821768] [DEBUG] [LOCAL ] BGB: Loaded 17621 existing records from primary storage. [2025-09-28T03:00:14.845156] [INFO ] [MAIN ] BGB: Loaded 17621 primary data records. [2025-09-28T03:00:15.205205] [DEBUG] [LOCAL ] BG: Loaded 51118 existing records from primary storage. [2025-09-28T03:00:15.264511] [INFO ] [MAIN ] BG: Loaded 51118 primary data records. [2025-09-28T03:00:15.788002] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:15.790033] [INFO ] [MAIN ] BGH: Generated 1820 derivative records from 16728 primary records. [2025-09-28T03:00:15.790220] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-28T03:00:15.806102] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:15.814707] [INFO ] [MAIN ] BGB: Generated 1820 derivative records from 17621 primary records. [2025-09-28T03:00:15.819835] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-28T03:00:15.824839] [DEBUG] [LOCAL ] BGH: Derivative data saved (1820 records). [2025-09-28T03:00:15.824934] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-28T03:00:15.827478] [INFO ] [MAIN ] Derivative Progress: 241/2211 symbols completed. BGH took 1.1s. Estimated remaining: 13m 23s. Rate: 147.2 symbols/min [2025-09-28T03:00:15.835241] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:15.844759] [DEBUG] [LOCAL ] BGB: Derivative data saved (1820 records). [2025-09-28T03:00:15.845562] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-28T03:00:15.848803] [INFO ] [MAIN ] Derivative Progress: 242/2211 symbols completed. BGB took 1.1s. Estimated remaining: 13m 19s. Rate: 147.8 symbols/min [2025-09-28T03:00:15.853945] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:15.864005] [DEBUG] [LOCAL ] BGR: Loaded 13658 existing records from primary storage. [2025-09-28T03:00:15.864522] [INFO ] [MAIN ] BGR: Loaded 13658 primary data records. [2025-09-28T03:00:15.927091] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:15.968527] [INFO ] [MAIN ] BG: Generated 1820 derivative records from 51118 primary records. [2025-09-28T03:00:15.987005] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-28T03:00:16.071824] [DEBUG] [LOCAL ] BG: Derivative data saved (1820 records). [2025-09-28T03:00:16.091701] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-28T03:00:16.097022] [INFO ] [MAIN ] Derivative Progress: 243/2211 symbols completed. BG took 1.4s. Estimated remaining: 13m 18s. Rate: 148.0 symbols/min [2025-09-28T03:00:16.255169] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:16.258816] [DEBUG] [LOCAL ] BGS: Loaded 51183 existing records from primary storage. [2025-09-28T03:00:16.259163] [INFO ] [MAIN ] BGS: Loaded 51183 primary data records. [2025-09-28T03:00:16.358745] [DEBUG] [LOCAL ] BGSF: Loaded 7050 existing records from primary storage. [2025-09-28T03:00:16.375018] [INFO ] [MAIN ] BGSF: Loaded 7050 primary data records. [2025-09-28T03:00:16.938611] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:16.941768] [INFO ] [MAIN ] BGR: Generated 1820 derivative records from 13658 primary records. [2025-09-28T03:00:16.943508] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-28T03:00:16.963406] [DEBUG] [LOCAL ] BGR: Derivative data saved (1820 records). [2025-09-28T03:00:16.964284] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-28T03:00:16.967213] [INFO ] [MAIN ] Derivative Progress: 244/2211 symbols completed. BGR took 1.1s. Estimated remaining: 13m 21s. Rate: 147.3 symbols/min [2025-09-28T03:00:16.969266] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:16.988466] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:16.990261] [INFO ] [MAIN ] BGS: Generated 1820 derivative records from 51183 primary records. [2025-09-28T03:00:16.994890] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-28T03:00:17.033839] [DEBUG] [LOCAL ] BGS: Derivative data saved (1820 records). [2025-09-28T03:00:17.035250] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-28T03:00:17.034955] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-28T03:00:17.038277] [INFO ] [MAIN ] Derivative Progress: 245/2211 symbols completed. BGS took 1.2s. Estimated remaining: 13m 18s. Rate: 147.8 symbols/min [2025-09-28T03:00:17.039071] [DEBUG] [LOCAL ] BGT: Loaded 16793 existing records from primary storage. [2025-09-28T03:00:17.039374] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:17.039669] [INFO ] [MAIN ] BGT: Loaded 16793 primary data records. [2025-09-28T03:00:17.041017] [INFO ] [MAIN ] BGSF: Generated 1818 derivative records from 7050 primary records. [2025-09-28T03:00:17.046856] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-28T03:00:17.171857] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1818 records). [2025-09-28T03:00:17.178759] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-28T03:00:17.195372] [INFO ] [MAIN ] Derivative Progress: 246/2211 symbols completed. BGSF took 0.9s. Estimated remaining: 13m 16s. Rate: 148.2 symbols/min [2025-09-28T03:00:17.206382] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:17.200986] [DEBUG] [LOCAL ] BGX: Loaded 10900 existing records from primary storage. [2025-09-28T03:00:17.231899] [INFO ] [MAIN ] BGX: Loaded 10900 primary data records. [2025-09-28T03:00:17.519616] [DEBUG] [LOCAL ] BGY: Loaded 22790 existing records from primary storage. [2025-09-28T03:00:17.524263] [INFO ] [MAIN ] BGY: Loaded 22790 primary data records. [2025-09-28T03:00:18.121315] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:18.122819] [INFO ] [MAIN ] BGT: Generated 1820 derivative records from 16793 primary records. [2025-09-28T03:00:18.125844] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-28T03:00:18.146958] [DEBUG] [LOCAL ] BGT: Derivative data saved (1820 records). [2025-09-28T03:00:18.147237] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-28T03:00:18.149763] [INFO ] [MAIN ] Derivative Progress: 247/2211 symbols completed. BGT took 1.2s. Estimated remaining: 13m 20s. Rate: 147.4 symbols/min [2025-09-28T03:00:18.150420] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:18.170726] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:18.177705] [INFO ] [MAIN ] BGX: Generated 1820 derivative records from 10900 primary records. [2025-09-28T03:00:18.178228] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-28T03:00:18.192317] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:18.200842] [DEBUG] [LOCAL ] BH: Loaded 15938 existing records from primary storage. [2025-09-28T03:00:18.201239] [INFO ] [MAIN ] BH: Loaded 15938 primary data records. [2025-09-28T03:00:18.199915] [INFO ] [MAIN ] BGY: Generated 1820 derivative records from 22790 primary records. [2025-09-28T03:00:18.216418] [DEBUG] [LOCAL ] BGX: Derivative data saved (1820 records). [2025-09-28T03:00:18.212164] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-28T03:00:18.237580] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-28T03:00:18.293463] [INFO ] [MAIN ] Derivative Progress: 248/2211 symbols completed. BGX took 1.3s. Estimated remaining: 13m 17s. Rate: 147.8 symbols/min [2025-09-28T03:00:18.315075] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:18.344939] [DEBUG] [LOCAL ] BGY: Derivative data saved (1820 records). [2025-09-28T03:00:18.366374] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-28T03:00:18.407498] [INFO ] [MAIN ] Derivative Progress: 249/2211 symbols completed. BGY took 1.2s. Estimated remaining: 13m 14s. Rate: 148.2 symbols/min [2025-09-28T03:00:18.550114] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:18.595465] [DEBUG] [LOCAL ] BHC: Loaded 47495 existing records from primary storage. [2025-09-28T03:00:18.596136] [INFO ] [MAIN ] BHC: Loaded 47495 primary data records. [2025-09-28T03:00:18.707779] [DEBUG] [LOCAL ] BHE: Loaded 25353 existing records from primary storage. [2025-09-28T03:00:18.721110] [INFO ] [MAIN ] BHE: Loaded 25353 primary data records. [2025-09-28T03:00:18.834918] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:18.895631] [INFO ] [MAIN ] BH: Generated 1820 derivative records from 15938 primary records. [2025-09-28T03:00:19.056921] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-28T03:00:19.160070] [DEBUG] [LOCAL ] BH: Derivative data saved (1820 records). [2025-09-28T03:00:19.274405] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-28T03:00:19.286498] [INFO ] [MAIN ] Derivative Progress: 250/2211 symbols completed. BH took 1.1s. Estimated remaining: 13m 18s. Rate: 147.5 symbols/min [2025-09-28T03:00:19.287621] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:19.325136] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:19.326434] [INFO ] [MAIN ] BHC: Generated 1820 derivative records from 47495 primary records. [2025-09-28T03:00:19.335386] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-28T03:00:19.337099] [DEBUG] [LOCAL ] BHK: Loaded 22922 existing records from primary storage. [2025-09-28T03:00:19.338306] [INFO ] [MAIN ] BHK: Loaded 22922 primary data records. [2025-09-28T03:00:19.475749] [DEBUG] [LOCAL ] BHC: Derivative data saved (1820 records). [2025-09-28T03:00:19.457047] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:19.489264] [INFO ] [MAIN ] BHE: Generated 1820 derivative records from 25353 primary records. [2025-09-28T03:00:19.489611] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-28T03:00:19.489555] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-28T03:00:19.508341] [INFO ] [MAIN ] Derivative Progress: 251/2211 symbols completed. BHC took 1.2s. Estimated remaining: 13m 16s. Rate: 147.8 symbols/min [2025-09-28T03:00:19.544436] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:19.769707] [DEBUG] [LOCAL ] BHE: Derivative data saved (1820 records). [2025-09-28T03:00:19.770301] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-28T03:00:19.772760] [INFO ] [MAIN ] Derivative Progress: 252/2211 symbols completed. BHE took 1.2s. Estimated remaining: 13m 14s. Rate: 148.0 symbols/min [2025-09-28T03:00:19.773097] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:19.806500] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:19.807435] [INFO ] [MAIN ] BHK: Generated 1820 derivative records from 22922 primary records. [2025-09-28T03:00:19.816090] [DEBUG] [LOCAL ] BHR: Loaded 21771 existing records from primary storage. [2025-09-28T03:00:19.816221] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-28T03:00:19.816475] [INFO ] [MAIN ] BHR: Loaded 21771 primary data records. [2025-09-28T03:00:19.919498] [DEBUG] [LOCAL ] BHK: Derivative data saved (1820 records). [2025-09-28T03:00:19.932881] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-28T03:00:19.962774] [INFO ] [MAIN ] Derivative Progress: 253/2211 symbols completed. BHK took 0.7s. Estimated remaining: 13m 12s. Rate: 148.3 symbols/min [2025-09-28T03:00:19.995557] [DEBUG] [LOCAL ] BHP: Loaded 54153 existing records from primary storage. [2025-09-28T03:00:20.011286] [INFO ] [MAIN ] BHP: Loaded 54153 primary data records. [2025-09-28T03:00:20.572893] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:20.573791] [INFO ] [MAIN ] BHR: Generated 1820 derivative records from 21771 primary records. [2025-09-28T03:00:20.573990] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-28T03:00:20.593158] [DEBUG] [LOCAL ] BHR: Derivative data saved (1820 records). [2025-09-28T03:00:20.593990] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-28T03:00:20.596662] [INFO ] [MAIN ] Derivative Progress: 254/2211 symbols completed. BHR took 0.8s. Estimated remaining: 13m 14s. Rate: 148.0 symbols/min [2025-09-28T03:00:20.609818] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:20.610606] [INFO ] [MAIN ] BHP: Generated 1820 derivative records from 54153 primary records. [2025-09-28T03:00:20.610722] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-28T03:00:20.627584] [DEBUG] [LOCAL ] BHP: Derivative data saved (1820 records). [2025-09-28T03:00:20.627780] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-28T03:00:20.630992] [INFO ] [MAIN ] Derivative Progress: 255/2211 symbols completed. BHP took 1.1s. Estimated remaining: 13m 10s. Rate: 148.5 symbols/min [2025-09-28T03:00:20.631833] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:20.631618] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:20.631773] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:20.666969] [DEBUG] [LOCAL ] BIO: Loaded 25533 existing records from primary storage. [2025-09-28T03:00:20.667144] [INFO ] [MAIN ] BIO: Loaded 25533 primary data records. [2025-09-28T03:00:20.912182] [DEBUG] [LOCAL ] BILL: Loaded 53105 existing records from primary storage. [2025-09-28T03:00:20.923021] [DEBUG] [LOCAL ] BHVN: Loaded 50401 existing records from primary storage. [2025-09-28T03:00:20.921469] [INFO ] [MAIN ] BILL: Loaded 53105 primary data records. [2025-09-28T03:00:20.941168] [INFO ] [MAIN ] BHVN: Loaded 50401 primary data records. [2025-09-28T03:00:21.787813] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:21.789469] [INFO ] [MAIN ] BIO: Generated 1820 derivative records from 25533 primary records. [2025-09-28T03:00:21.789881] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-28T03:00:21.809668] [DEBUG] [LOCAL ] BIO: Derivative data saved (1820 records). [2025-09-28T03:00:21.810569] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-28T03:00:21.813067] [INFO ] [MAIN ] Derivative Progress: 256/2211 symbols completed. BIO took 1.2s. Estimated remaining: 13m 16s. Rate: 147.4 symbols/min [2025-09-28T03:00:21.813449] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:21.835341] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:21.838587] [INFO ] [MAIN ] BILL: Generated 1820 derivative records from 53105 primary records. [2025-09-28T03:00:21.838915] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-28T03:00:21.860482] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:21.868970] [INFO ] [MAIN ] BHVN: Generated 1820 derivative records from 50401 primary records. [2025-09-28T03:00:21.869897] [DEBUG] [LOCAL ] BILL: Derivative data saved (1820 records). [2025-09-28T03:00:21.870096] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-28T03:00:21.870518] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-28T03:00:21.874661] [INFO ] [MAIN ] Derivative Progress: 257/2211 symbols completed. BILL took 1.2s. Estimated remaining: 13m 13s. Rate: 147.9 symbols/min [2025-09-28T03:00:21.875173] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:21.901140] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1820 records). [2025-09-28T03:00:21.901639] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-28T03:00:21.903927] [INFO ] [MAIN ] Derivative Progress: 258/2211 symbols completed. BHVN took 1.3s. Estimated remaining: 13m 10s. Rate: 148.4 symbols/min [2025-09-28T03:00:21.904205] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:21.910665] [DEBUG] [LOCAL ] BIPH: Loaded 2632 existing records from primary storage. [2025-09-28T03:00:21.911018] [INFO ] [MAIN ] BIPH: Loaded 2632 primary data records. [2025-09-28T03:00:22.028800] [DEBUG] [LOCAL ] BIP: Loaded 40240 existing records from primary storage. [2025-09-28T03:00:22.051809] [INFO ] [MAIN ] BIP: Loaded 40240 primary data records. [2025-09-28T03:00:22.382882] [DEBUG] [LOCAL ] BIPC: Loaded 42317 existing records from primary storage. [2025-09-28T03:00:22.401132] [INFO ] [MAIN ] BIPC: Loaded 42317 primary data records. [2025-09-28T03:00:22.955611] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:22.956815] [INFO ] [MAIN ] BIPH: Generated 1820 derivative records from 2632 primary records. [2025-09-28T03:00:22.957306] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-28T03:00:22.976287] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1820 records). [2025-09-28T03:00:22.976919] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-28T03:00:22.979249] [INFO ] [MAIN ] Derivative Progress: 259/2211 symbols completed. BIPH took 1.1s. Estimated remaining: 13m 14s. Rate: 147.5 symbols/min [2025-09-28T03:00:22.979749] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:22.995837] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:22.997114] [INFO ] [MAIN ] BIP: Generated 1820 derivative records from 40240 primary records. [2025-09-28T03:00:22.999835] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-28T03:00:23.000059] [DEBUG] [LOCAL ] BIPI: Loaded 3282 existing records from primary storage. [2025-09-28T03:00:23.001196] [INFO ] [MAIN ] BIPI: Loaded 3282 primary data records. [2025-09-28T03:00:23.105583] [DEBUG] [LOCAL ] BIP: Derivative data saved (1820 records). [2025-09-28T03:00:23.131912] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-28T03:00:23.157281] [INFO ] [MAIN ] Derivative Progress: 260/2211 symbols completed. BIP took 1.3s. Estimated remaining: 13m 12s. Rate: 147.8 symbols/min [2025-09-28T03:00:23.177512] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:23.219346] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:23.243105] [INFO ] [MAIN ] BIPC: Generated 1820 derivative records from 42317 primary records. [2025-09-28T03:00:23.300632] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-28T03:00:23.376458] [DEBUG] [LOCAL ] BIPJ: Loaded 3026 existing records from primary storage. [2025-09-28T03:00:23.381739] [INFO ] [MAIN ] BIPJ: Loaded 3026 primary data records. [2025-09-28T03:00:23.419671] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1820 records). [2025-09-28T03:00:23.432639] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-28T03:00:23.435965] [INFO ] [MAIN ] Derivative Progress: 261/2211 symbols completed. BIPC took 1.6s. Estimated remaining: 13m 11s. Rate: 148.0 symbols/min [2025-09-28T03:00:23.460044] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:23.794865] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:23.796959] [INFO ] [MAIN ] BIPI: Generated 1820 derivative records from 3282 primary records. [2025-09-28T03:00:23.797371] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-28T03:00:23.833897] [DEBUG] [LOCAL ] BIRK: Loaded 51674 existing records from primary storage. [2025-09-28T03:00:23.834436] [INFO ] [MAIN ] BIRK: Loaded 51674 primary data records. [2025-09-28T03:00:23.897701] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1820 records). [2025-09-28T03:00:23.993061] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-28T03:00:24.021445] [INFO ] [MAIN ] Derivative Progress: 262/2211 symbols completed. BIPI took 1.0s. Estimated remaining: 13m 12s. Rate: 147.7 symbols/min [2025-09-28T03:00:24.045098] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:24.117547] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:24.243422] [INFO ] [MAIN ] BIPJ: Generated 1820 derivative records from 3026 primary records. [2025-09-28T03:00:24.244531] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-28T03:00:24.267381] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1820 records). [2025-09-28T03:00:24.267780] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-28T03:00:24.270472] [INFO ] [MAIN ] Derivative Progress: 263/2211 symbols completed. BIPJ took 1.1s. Estimated remaining: 13m 10s. Rate: 147.9 symbols/min [2025-09-28T03:00:24.270888] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:24.282378] [DEBUG] [LOCAL ] BIT: Loaded 22765 existing records from primary storage. [2025-09-28T03:00:24.282829] [INFO ] [MAIN ] BIT: Loaded 22765 primary data records. [2025-09-28T03:00:24.633878] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:24.634635] [INFO ] [MAIN ] BIRK: Generated 1820 derivative records from 51674 primary records. [2025-09-28T03:00:24.635489] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-28T03:00:24.672245] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1820 records). [2025-09-28T03:00:24.673822] [DEBUG] [LOCAL ] BJ: Loaded 52156 existing records from primary storage. [2025-09-28T03:00:24.674028] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-28T03:00:24.674181] [INFO ] [MAIN ] BJ: Loaded 52156 primary data records. [2025-09-28T03:00:24.677479] [INFO ] [MAIN ] Derivative Progress: 264/2211 symbols completed. BIRK took 1.2s. Estimated remaining: 13m 10s. Rate: 147.9 symbols/min [2025-09-28T03:00:24.726847] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:25.030989] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:25.031828] [INFO ] [MAIN ] BIT: Generated 1820 derivative records from 22765 primary records. [2025-09-28T03:00:25.032965] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-28T03:00:25.058262] [DEBUG] [LOCAL ] BIT: Derivative data saved (1820 records). [2025-09-28T03:00:25.077485] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-28T03:00:25.079975] [INFO ] [MAIN ] Derivative Progress: 265/2211 symbols completed. BIT took 1.0s. Estimated remaining: 13m 9s. Rate: 147.9 symbols/min [2025-09-28T03:00:25.080385] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:25.124185] [DEBUG] [LOCAL ] BK: Loaded 54319 existing records from primary storage. [2025-09-28T03:00:25.124610] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:25.125141] [INFO ] [MAIN ] BK: Loaded 54319 primary data records. [2025-09-28T03:00:25.126187] [INFO ] [MAIN ] BJ: Generated 1820 derivative records from 52156 primary records. [2025-09-28T03:00:25.149958] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-28T03:00:25.280864] [DEBUG] [LOCAL ] BJ: Derivative data saved (1820 records). [2025-09-28T03:00:25.293051] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-28T03:00:25.301500] [INFO ] [MAIN ] Derivative Progress: 266/2211 symbols completed. BJ took 1.0s. Estimated remaining: 13m 8s. Rate: 148.2 symbols/min [2025-09-28T03:00:25.316239] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:25.499953] [DEBUG] [LOCAL ] BKD: Loaded 50889 existing records from primary storage. [2025-09-28T03:00:25.500443] [INFO ] [MAIN ] BKD: Loaded 50889 primary data records. [2025-09-28T03:00:25.848687] [DEBUG] [LOCAL ] BKE: Loaded 35206 existing records from primary storage. [2025-09-28T03:00:25.849147] [INFO ] [MAIN ] BKE: Loaded 35206 primary data records. [2025-09-28T03:00:25.961498] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:25.981543] [INFO ] [MAIN ] BK: Generated 1820 derivative records from 54319 primary records. [2025-09-28T03:00:26.009187] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-28T03:00:26.260121] [DEBUG] [LOCAL ] BK: Derivative data saved (1820 records). [2025-09-28T03:00:26.262985] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-28T03:00:26.265942] [INFO ] [MAIN ] Derivative Progress: 267/2211 symbols completed. BK took 1.5s. Estimated remaining: 13m 11s. Rate: 147.4 symbols/min [2025-09-28T03:00:26.268618] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:26.284045] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:26.285214] [INFO ] [MAIN ] BKD: Generated 1820 derivative records from 50889 primary records. [2025-09-28T03:00:26.285394] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-28T03:00:26.306765] [DEBUG] [LOCAL ] BKD: Derivative data saved (1820 records). [2025-09-28T03:00:26.307259] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-28T03:00:26.309300] [INFO ] [MAIN ] Derivative Progress: 268/2211 symbols completed. BKD took 1.2s. Estimated remaining: 13m 8s. Rate: 147.9 symbols/min [2025-09-28T03:00:26.329085] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:26.329950] [INFO ] [MAIN ] BKE: Generated 1820 derivative records from 35206 primary records. [2025-09-28T03:00:26.330196] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-28T03:00:26.357556] [DEBUG] [LOCAL ] BKE: Derivative data saved (1820 records). [2025-09-28T03:00:26.357890] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-28T03:00:26.360838] [INFO ] [MAIN ] Derivative Progress: 269/2211 symbols completed. BKE took 1.0s. Estimated remaining: 13m 5s. Rate: 148.4 symbols/min [2025-09-28T03:00:26.377032] [DEBUG] [LOCAL ] BKH: Loaded 37133 existing records from primary storage. [2025-09-28T03:00:26.377231] [INFO ] [MAIN ] BKH: Loaded 37133 primary data records. [2025-09-28T03:00:26.711247] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:26.712001] [INFO ] [MAIN ] BKH: Generated 1820 derivative records from 37133 primary records. [2025-09-28T03:00:26.712088] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-28T03:00:26.727930] [DEBUG] [LOCAL ] BKH: Derivative data saved (1820 records). [2025-09-28T03:00:26.728028] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-28T03:00:26.730779] [INFO ] [MAIN ] Derivative Progress: 270/2211 symbols completed. BKH took 0.5s. Estimated remaining: 13m 5s. Rate: 148.4 symbols/min [2025-09-28T03:00:26.731529] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:26.731639] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:26.731735] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:26.746446] [DEBUG] [LOCAL ] BKN: Loaded 7853 existing records from primary storage. [2025-09-28T03:00:26.746818] [INFO ] [MAIN ] BKN: Loaded 7853 primary data records. [2025-09-28T03:00:26.935756] [DEBUG] [LOCAL ] BKKT: Loaded 35164 existing records from primary storage. [2025-09-28T03:00:26.979003] [INFO ] [MAIN ] BKKT: Loaded 35164 primary data records. [2025-09-28T03:00:27.160209] [DEBUG] [LOCAL ] BKSY: Loaded 48993 existing records from primary storage. [2025-09-28T03:00:27.184627] [INFO ] [MAIN ] BKSY: Loaded 48993 primary data records. [2025-09-28T03:00:27.801953] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:27.803432] [INFO ] [MAIN ] BKN: Generated 1820 derivative records from 7853 primary records. [2025-09-28T03:00:27.803600] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-28T03:00:27.823195] [DEBUG] [LOCAL ] BKN: Derivative data saved (1820 records). [2025-09-28T03:00:27.824027] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-28T03:00:27.826796] [INFO ] [MAIN ] Derivative Progress: 271/2211 symbols completed. BKN took 1.1s. Estimated remaining: 13m 9s. Rate: 147.5 symbols/min [2025-09-28T03:00:27.827326] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:27.846332] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:27.847360] [INFO ] [MAIN ] BKKT: Generated 1820 derivative records from 35164 primary records. [2025-09-28T03:00:27.847539] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-28T03:00:27.875021] [DEBUG] [LOCAL ] BKT: Loaded 11125 existing records from primary storage. [2025-09-28T03:00:27.876493] [INFO ] [MAIN ] BKT: Loaded 11125 primary data records. [2025-09-28T03:00:27.876350] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1820 records). [2025-09-28T03:00:27.888253] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-28T03:00:27.901039] [INFO ] [MAIN ] Derivative Progress: 272/2211 symbols completed. BKKT took 1.2s. Estimated remaining: 13m 6s. Rate: 148.0 symbols/min [2025-09-28T03:00:27.971735] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:27.977242] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:28.002325] [INFO ] [MAIN ] BKSY: Generated 1820 derivative records from 48993 primary records. [2025-09-28T03:00:28.024081] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-28T03:00:28.269954] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1820 records). [2025-09-28T03:00:28.270307] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-28T03:00:28.273050] [INFO ] [MAIN ] Derivative Progress: 273/2211 symbols completed. BKSY took 1.5s. Estimated remaining: 13m 6s. Rate: 148.0 symbols/min [2025-09-28T03:00:28.284014] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:28.305973] [DEBUG] [LOCAL ] BKU: Loaded 42412 existing records from primary storage. [2025-09-28T03:00:28.306744] [INFO ] [MAIN ] BKU: Loaded 42412 primary data records. [2025-09-28T03:00:28.489457] [DEBUG] [LOCAL ] BKV: Loaded 30278 existing records from primary storage. [2025-09-28T03:00:28.527400] [INFO ] [MAIN ] BKV: Loaded 30278 primary data records. [2025-09-28T03:00:28.712058] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:28.741428] [INFO ] [MAIN ] BKT: Generated 1820 derivative records from 11125 primary records. [2025-09-28T03:00:28.770498] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-28T03:00:28.854187] [DEBUG] [LOCAL ] BKT: Derivative data saved (1820 records). [2025-09-28T03:00:28.897168] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-28T03:00:29.032159] [INFO ] [MAIN ] Derivative Progress: 274/2211 symbols completed. BKT took 1.2s. Estimated remaining: 13m 8s. Rate: 147.5 symbols/min [2025-09-28T03:00:29.035074] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:29.059247] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:29.060559] [INFO ] [MAIN ] BKU: Generated 1820 derivative records from 42412 primary records. [2025-09-28T03:00:29.060891] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-28T03:00:29.088620] [DEBUG] [LOCAL ] BKU: Derivative data saved (1820 records). [2025-09-28T03:00:29.088837] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-28T03:00:29.091358] [INFO ] [MAIN ] Derivative Progress: 275/2211 symbols completed. BKU took 1.1s. Estimated remaining: 13m 5s. Rate: 148.0 symbols/min [2025-09-28T03:00:29.091939] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:29.122966] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:29.122270] [DEBUG] [LOCAL ] BLCO: Loaded 36110 existing records from primary storage. [2025-09-28T03:00:29.124070] [INFO ] [MAIN ] BKV: Generated 1820 derivative records from 30278 primary records. [2025-09-28T03:00:29.123288] [INFO ] [MAIN ] BLCO: Loaded 36110 primary data records. [2025-09-28T03:00:29.124262] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-28T03:00:29.275658] [DEBUG] [LOCAL ] BKV: Derivative data saved (1820 records). [2025-09-28T03:00:29.276768] [DEBUG] [LOCAL ] BLD: Loaded 28408 existing records from primary storage. [2025-09-28T03:00:29.292559] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-28T03:00:29.292683] [INFO ] [MAIN ] BLD: Loaded 28408 primary data records. [2025-09-28T03:00:29.295588] [INFO ] [MAIN ] Derivative Progress: 276/2211 symbols completed. BKV took 1.0s. Estimated remaining: 13m 3s. Rate: 148.3 symbols/min [2025-09-28T03:00:29.402289] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:29.866092] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:29.867624] [INFO ] [MAIN ] BLCO: Generated 1820 derivative records from 36110 primary records. [2025-09-28T03:00:29.867785] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-28T03:00:29.902966] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1820 records). [2025-09-28T03:00:29.902864] [DEBUG] [LOCAL ] BLDR: Loaded 52403 existing records from primary storage. [2025-09-28T03:00:29.903332] [INFO ] [MAIN ] BLDR: Loaded 52403 primary data records. [2025-09-28T03:00:29.903402] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-28T03:00:29.928311] [INFO ] [MAIN ] Derivative Progress: 277/2211 symbols completed. BLCO took 0.9s. Estimated remaining: 13m 4s. Rate: 148.0 symbols/min [2025-09-28T03:00:29.947043] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:29.998754] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:30.019720] [INFO ] [MAIN ] BLD: Generated 1820 derivative records from 28408 primary records. [2025-09-28T03:00:30.037628] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-28T03:00:30.110331] [DEBUG] [LOCAL ] BLD: Derivative data saved (1820 records). [2025-09-28T03:00:30.209612] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-28T03:00:30.313068] [DEBUG] [LOCAL ] BLE: Loaded 14718 existing records from primary storage. [2025-09-28T03:00:30.316030] [INFO ] [MAIN ] BLE: Loaded 14718 primary data records. [2025-09-28T03:00:30.315680] [INFO ] [MAIN ] Derivative Progress: 278/2211 symbols completed. BLD took 1.2s. Estimated remaining: 13m 4s. Rate: 148.0 symbols/min [2025-09-28T03:00:30.321574] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:30.696628] [DEBUG] [LOCAL ] BLK: Loaded 35240 existing records from primary storage. [2025-09-28T03:00:30.697849] [INFO ] [MAIN ] BLK: Loaded 35240 primary data records. [2025-09-28T03:00:30.738978] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:30.772752] [INFO ] [MAIN ] BLDR: Generated 1820 derivative records from 52403 primary records. [2025-09-28T03:00:30.781419] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-28T03:00:30.856792] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1820 records). [2025-09-28T03:00:30.865259] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-28T03:00:30.873960] [INFO ] [MAIN ] Derivative Progress: 279/2211 symbols completed. BLDR took 1.5s. Estimated remaining: 13m 4s. Rate: 147.8 symbols/min [2025-09-28T03:00:30.885170] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:30.939987] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:31.082165] [INFO ] [MAIN ] BLE: Generated 1820 derivative records from 14718 primary records. [2025-09-28T03:00:31.082830] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-28T03:00:31.110494] [DEBUG] [LOCAL ] BLE: Derivative data saved (1820 records). [2025-09-28T03:00:31.111544] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-28T03:00:31.113549] [INFO ] [MAIN ] Derivative Progress: 280/2211 symbols completed. BLE took 1.2s. Estimated remaining: 13m 3s. Rate: 148.0 symbols/min [2025-09-28T03:00:31.114390] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:31.151968] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:31.157447] [DEBUG] [LOCAL ] BLW: Loaded 13044 existing records from primary storage. [2025-09-28T03:00:31.158316] [INFO ] [MAIN ] BLK: Generated 1820 derivative records from 35240 primary records. [2025-09-28T03:00:31.158528] [INFO ] [MAIN ] BLW: Loaded 13044 primary data records. [2025-09-28T03:00:31.159540] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-28T03:00:31.231675] [DEBUG] [LOCAL ] BLND: Loaded 50107 existing records from primary storage. [2025-09-28T03:00:31.264808] [INFO ] [MAIN ] BLND: Loaded 50107 primary data records. [2025-09-28T03:00:31.331265] [DEBUG] [LOCAL ] BLK: Derivative data saved (1820 records). [2025-09-28T03:00:31.385823] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-28T03:00:31.438440] [INFO ] [MAIN ] Derivative Progress: 281/2211 symbols completed. BLK took 1.1s. Estimated remaining: 13m 2s. Rate: 148.1 symbols/min [2025-09-28T03:00:31.438785] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:31.866153] [DEBUG] [LOCAL ] BLX: Loaded 15880 existing records from primary storage. [2025-09-28T03:00:31.867920] [INFO ] [MAIN ] BLX: Loaded 15880 primary data records. [2025-09-28T03:00:32.219536] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:32.223052] [INFO ] [MAIN ] BLW: Generated 1820 derivative records from 13044 primary records. [2025-09-28T03:00:32.223818] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-28T03:00:32.239822] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:32.249537] [INFO ] [MAIN ] BLND: Generated 1820 derivative records from 50107 primary records. [2025-09-28T03:00:32.252563] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-28T03:00:32.276118] [DEBUG] [LOCAL ] BLND: Derivative data saved (1820 records). [2025-09-28T03:00:32.276381] [DEBUG] [LOCAL ] BLW: Derivative data saved (1820 records). [2025-09-28T03:00:32.276934] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-28T03:00:32.276780] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-28T03:00:32.279532] [INFO ] [MAIN ] Derivative Progress: 282/2211 symbols completed. BLW took 1.2s. Estimated remaining: 13m 4s. Rate: 147.5 symbols/min [2025-09-28T03:00:32.282408] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:32.282510] [INFO ] [MAIN ] Derivative Progress: 283/2211 symbols completed. BLND took 1.4s. Estimated remaining: 13m 1s. Rate: 148.1 symbols/min [2025-09-28T03:00:32.299663] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:32.300404] [INFO ] [MAIN ] BLX: Generated 1820 derivative records from 15880 primary records. [2025-09-28T03:00:32.300530] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-28T03:00:32.318097] [DEBUG] [LOCAL ] BLX: Derivative data saved (1820 records). [2025-09-28T03:00:32.318372] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-28T03:00:32.320786] [INFO ] [MAIN ] Derivative Progress: 284/2211 symbols completed. BLX took 0.9s. Estimated remaining: 12m 58s. Rate: 148.5 symbols/min [2025-09-28T03:00:32.345280] [DEBUG] [LOCAL ] BMA: Loaded 35645 existing records from primary storage. [2025-09-28T03:00:32.345458] [INFO ] [MAIN ] BMA: Loaded 35645 primary data records. [2025-09-28T03:00:32.688664] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:32.689414] [INFO ] [MAIN ] BMA: Generated 1820 derivative records from 35645 primary records. [2025-09-28T03:00:32.689505] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-28T03:00:32.705040] [DEBUG] [LOCAL ] BMA: Derivative data saved (1820 records). [2025-09-28T03:00:32.705181] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-28T03:00:32.711756] [INFO ] [MAIN ] Derivative Progress: 285/2211 symbols completed. BMA took 0.4s. Estimated remaining: 12m 58s. Rate: 148.5 symbols/min [2025-09-28T03:00:32.712630] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:32.712567] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:32.712438] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:32.731770] [DEBUG] [LOCAL ] BME: Loaded 10968 existing records from primary storage. [2025-09-28T03:00:32.731951] [INFO ] [MAIN ] BME: Loaded 10968 primary data records. [2025-09-28T03:00:32.830281] [DEBUG] [LOCAL ] BMI: Loaded 24611 existing records from primary storage. [2025-09-28T03:00:32.856976] [DEBUG] [LOCAL ] BMEZ: Loaded 26421 existing records from primary storage. [2025-09-28T03:00:32.857121] [INFO ] [MAIN ] BMI: Loaded 24611 primary data records. [2025-09-28T03:00:32.877339] [INFO ] [MAIN ] BMEZ: Loaded 26421 primary data records. [2025-09-28T03:00:33.759316] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:33.760440] [INFO ] [MAIN ] BME: Generated 1820 derivative records from 10968 primary records. [2025-09-28T03:00:33.760736] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-28T03:00:33.784375] [DEBUG] [LOCAL ] BME: Derivative data saved (1820 records). [2025-09-28T03:00:33.799446] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-28T03:00:33.802398] [INFO ] [MAIN ] Derivative Progress: 286/2211 symbols completed. BME took 1.1s. Estimated remaining: 13m 2s. Rate: 147.7 symbols/min [2025-09-28T03:00:33.810411] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:33.799788] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:33.816520] [INFO ] [MAIN ] BMEZ: Generated 1820 derivative records from 26421 primary records. [2025-09-28T03:00:33.817271] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:33.817331] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-28T03:00:33.818138] [INFO ] [MAIN ] BMI: Generated 1820 derivative records from 24611 primary records. [2025-09-28T03:00:33.820000] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-28T03:00:33.855089] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1820 records). [2025-09-28T03:00:33.851786] [DEBUG] [LOCAL ] BMN: Loaded 2548 existing records from primary storage. [2025-09-28T03:00:33.855684] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-28T03:00:33.856764] [DEBUG] [LOCAL ] BMI: Derivative data saved (1820 records). [2025-09-28T03:00:33.855563] [INFO ] [MAIN ] BMN: Loaded 2548 primary data records. [2025-09-28T03:00:33.859051] [INFO ] [MAIN ] Derivative Progress: 287/2211 symbols completed. BMEZ took 1.1s. Estimated remaining: 12m 59s. Rate: 148.1 symbols/min [2025-09-28T03:00:33.856920] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-28T03:00:33.859244] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:33.867103] [INFO ] [MAIN ] Derivative Progress: 288/2211 symbols completed. BMI took 1.2s. Estimated remaining: 12m 56s. Rate: 148.6 symbols/min [2025-09-28T03:00:33.897121] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:34.248346] [DEBUG] [LOCAL ] BMO: Loaded 41940 existing records from primary storage. [2025-09-28T03:00:34.248726] [INFO ] [MAIN ] BMO: Loaded 41940 primary data records. [2025-09-28T03:00:34.369549] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-28T03:00:34.386302] [INFO ] [MAIN ] BMY: Loaded 54537 primary data records. [2025-09-28T03:00:34.755709] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:34.770150] [INFO ] [MAIN ] BMN: Generated 1820 derivative records from 2548 primary records. [2025-09-28T03:00:34.782253] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-28T03:00:35.021993] [DEBUG] [LOCAL ] BMN: Derivative data saved (1820 records). [2025-09-28T03:00:35.022415] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-28T03:00:35.025157] [INFO ] [MAIN ] Derivative Progress: 289/2211 symbols completed. BMN took 1.2s. Estimated remaining: 13m 1s. Rate: 147.7 symbols/min [2025-09-28T03:00:35.025984] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:35.049472] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:35.050379] [INFO ] [MAIN ] BMO: Generated 1820 derivative records from 41940 primary records. [2025-09-28T03:00:35.050629] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-28T03:00:35.075391] [DEBUG] [LOCAL ] BMO: Derivative data saved (1820 records). [2025-09-28T03:00:35.089074] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:35.088788] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-28T03:00:35.090022] [INFO ] [MAIN ] BMY: Generated 1820 derivative records from 54537 primary records. [2025-09-28T03:00:35.092340] [INFO ] [MAIN ] Derivative Progress: 290/2211 symbols completed. BMO took 1.2s. Estimated remaining: 12m 58s. Rate: 148.1 symbols/min [2025-09-28T03:00:35.092845] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:35.092630] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-28T03:00:35.110722] [DEBUG] [LOCAL ] BMY: Derivative data saved (1820 records). [2025-09-28T03:00:35.110993] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-28T03:00:35.114076] [INFO ] [MAIN ] Derivative Progress: 291/2211 symbols completed. BMY took 1.2s. Estimated remaining: 12m 55s. Rate: 148.6 symbols/min [2025-09-28T03:00:35.114337] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:35.145815] [DEBUG] [LOCAL ] BNH: Loaded 4926 existing records from primary storage. [2025-09-28T03:00:35.145998] [INFO ] [MAIN ] BNH: Loaded 4926 primary data records. [2025-09-28T03:00:35.258341] [DEBUG] [LOCAL ] BN: Loaded 53774 existing records from primary storage. [2025-09-28T03:00:35.281323] [INFO ] [MAIN ] BN: Loaded 53774 primary data records. [2025-09-28T03:00:35.397582] [DEBUG] [LOCAL ] BNED: Loaded 30226 existing records from primary storage. [2025-09-28T03:00:35.456959] [INFO ] [MAIN ] BNED: Loaded 30226 primary data records. [2025-09-28T03:00:36.163066] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:36.165069] [INFO ] [MAIN ] BNH: Generated 1820 derivative records from 4926 primary records. [2025-09-28T03:00:36.165351] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-28T03:00:36.189979] [DEBUG] [LOCAL ] BNH: Derivative data saved (1820 records). [2025-09-28T03:00:36.204493] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-28T03:00:36.207327] [INFO ] [MAIN ] Derivative Progress: 292/2211 symbols completed. BNH took 1.1s. Estimated remaining: 12m 60s. Rate: 147.7 symbols/min [2025-09-28T03:00:36.207953] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:36.208121] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:36.209275] [INFO ] [MAIN ] BN: Generated 1820 derivative records from 53774 primary records. [2025-09-28T03:00:36.217415] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-28T03:00:36.223146] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:36.225873] [INFO ] [MAIN ] BNED: Generated 1820 derivative records from 30226 primary records. [2025-09-28T03:00:36.233753] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-28T03:00:36.244240] [DEBUG] [LOCAL ] BNJ: Loaded 2631 existing records from primary storage. [2025-09-28T03:00:36.245592] [INFO ] [MAIN ] BNJ: Loaded 2631 primary data records. [2025-09-28T03:00:36.245492] [DEBUG] [LOCAL ] BN: Derivative data saved (1820 records). [2025-09-28T03:00:36.290576] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-28T03:00:36.305735] [INFO ] [MAIN ] Derivative Progress: 293/2211 symbols completed. BN took 1.3s. Estimated remaining: 12m 57s. Rate: 148.1 symbols/min [2025-09-28T03:00:36.311156] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:36.365410] [DEBUG] [LOCAL ] BNED: Derivative data saved (1820 records). [2025-09-28T03:00:36.374070] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-28T03:00:36.381081] [INFO ] [MAIN ] Derivative Progress: 294/2211 symbols completed. BNED took 1.3s. Estimated remaining: 12m 55s. Rate: 148.5 symbols/min [2025-09-28T03:00:36.393116] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:36.677021] [DEBUG] [LOCAL ] BNL: Loaded 47577 existing records from primary storage. [2025-09-28T03:00:36.677781] [INFO ] [MAIN ] BNL: Loaded 47577 primary data records. [2025-09-28T03:00:36.840009] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:36.857301] [DEBUG] [LOCAL ] BNS: Loaded 52212 existing records from primary storage. [2025-09-28T03:00:36.892311] [INFO ] [MAIN ] BNS: Loaded 52212 primary data records. [2025-09-28T03:00:36.892180] [INFO ] [MAIN ] BNJ: Generated 1820 derivative records from 2631 primary records. [2025-09-28T03:00:37.044125] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-28T03:00:37.148953] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1820 records). [2025-09-28T03:00:37.168752] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-28T03:00:37.195529] [INFO ] [MAIN ] Derivative Progress: 295/2211 symbols completed. BNJ took 1.0s. Estimated remaining: 12m 57s. Rate: 148.0 symbols/min [2025-09-28T03:00:37.202110] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:37.288896] [DEBUG] [LOCAL ] BNT: Loaded 3473 existing records from primary storage. [2025-09-28T03:00:37.414403] [INFO ] [MAIN ] BNT: Loaded 3473 primary data records. [2025-09-28T03:00:37.576375] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:37.588551] [INFO ] [MAIN ] BNL: Generated 1820 derivative records from 47577 primary records. [2025-09-28T03:00:37.636884] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-28T03:00:37.788511] [DEBUG] [LOCAL ] BNL: Derivative data saved (1820 records). [2025-09-28T03:00:37.789370] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-28T03:00:37.791834] [INFO ] [MAIN ] Derivative Progress: 296/2211 symbols completed. BNL took 1.5s. Estimated remaining: 12m 58s. Rate: 147.8 symbols/min [2025-09-28T03:00:37.792374] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:37.813067] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:37.814023] [INFO ] [MAIN ] BNS: Generated 1820 derivative records from 52212 primary records. [2025-09-28T03:00:37.816149] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-28T03:00:37.833755] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-28T03:00:37.835332] [INFO ] [MAIN ] BNY: Loaded 7446 primary data records. [2025-09-28T03:00:37.879131] [DEBUG] [LOCAL ] BNS: Derivative data saved (1820 records). [2025-09-28T03:00:37.887408] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-28T03:00:37.904856] [INFO ] [MAIN ] Derivative Progress: 297/2211 symbols completed. BNS took 1.5s. Estimated remaining: 12m 55s. Rate: 148.1 symbols/min [2025-09-28T03:00:37.927011] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:37.993803] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:38.023968] [INFO ] [MAIN ] BNT: Generated 1820 derivative records from 3473 primary records. [2025-09-28T03:00:38.055515] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-28T03:00:38.200781] [DEBUG] [LOCAL ] BNT: Derivative data saved (1820 records). [2025-09-28T03:00:38.206705] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-28T03:00:38.216183] [INFO ] [MAIN ] Derivative Progress: 298/2211 symbols completed. BNT took 1.0s. Estimated remaining: 12m 54s. Rate: 148.2 symbols/min [2025-09-28T03:00:38.218904] [DEBUG] [LOCAL ] BOC: Loaded 18626 existing records from primary storage. [2025-09-28T03:00:38.219179] [INFO ] [MAIN ] BOC: Loaded 18626 primary data records. [2025-09-28T03:00:38.596947] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:38.597936] [INFO ] [MAIN ] BNY: Generated 1820 derivative records from 7446 primary records. [2025-09-28T03:00:38.598070] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-28T03:00:38.616624] [DEBUG] [LOCAL ] BNY: Derivative data saved (1820 records). [2025-09-28T03:00:38.616840] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-28T03:00:38.619287] [INFO ] [MAIN ] Derivative Progress: 299/2211 symbols completed. BNY took 0.8s. Estimated remaining: 12m 54s. Rate: 148.2 symbols/min [2025-09-28T03:00:38.640338] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:38.641100] [INFO ] [MAIN ] BOC: Generated 1820 derivative records from 18626 primary records. [2025-09-28T03:00:38.641189] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-28T03:00:38.657248] [DEBUG] [LOCAL ] BOC: Derivative data saved (1820 records). [2025-09-28T03:00:38.657404] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-28T03:00:38.659617] [INFO ] [MAIN ] Derivative Progress: 300/2211 symbols completed. BOC took 0.7s. Estimated remaining: 12m 51s. Rate: 148.7 symbols/min [2025-09-28T03:00:38.660097] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:38.660308] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:38.660233] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:38.684118] [DEBUG] [LOCAL ] BOE: Loaded 17816 existing records from primary storage. [2025-09-28T03:00:38.684484] [INFO ] [MAIN ] BOE: Loaded 17816 primary data records. [2025-09-28T03:00:38.870118] [DEBUG] [LOCAL ] BOND: Loaded 32554 existing records from primary storage. [2025-09-28T03:00:38.864256] [DEBUG] [LOCAL ] BOH: Loaded 31676 existing records from primary storage. [2025-09-28T03:00:38.901869] [INFO ] [MAIN ] BOND: Loaded 32554 primary data records. [2025-09-28T03:00:38.972712] [INFO ] [MAIN ] BOH: Loaded 31676 primary data records. [2025-09-28T03:00:39.716987] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:39.719570] [INFO ] [MAIN ] BOE: Generated 1820 derivative records from 17816 primary records. [2025-09-28T03:00:39.720669] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-28T03:00:39.744744] [DEBUG] [LOCAL ] BOE: Derivative data saved (1820 records). [2025-09-28T03:00:39.745291] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-28T03:00:39.748813] [INFO ] [MAIN ] Derivative Progress: 301/2211 symbols completed. BOE took 1.1s. Estimated remaining: 12m 55s. Rate: 147.8 symbols/min [2025-09-28T03:00:39.749279] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:39.786543] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:39.788793] [INFO ] [MAIN ] BOND: Generated 1820 derivative records from 32554 primary records. [2025-09-28T03:00:39.787808] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:39.788944] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-28T03:00:39.790936] [INFO ] [MAIN ] BOH: Generated 1820 derivative records from 31676 primary records. [2025-09-28T03:00:39.791445] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-28T03:00:39.827363] [DEBUG] [LOCAL ] BOND: Derivative data saved (1820 records). [2025-09-28T03:00:39.827550] [DEBUG] [LOCAL ] BOH: Derivative data saved (1820 records). [2025-09-28T03:00:39.827938] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-28T03:00:39.831207] [INFO ] [MAIN ] Derivative Progress: 302/2211 symbols completed. BOH took 1.2s. Estimated remaining: 12m 53s. Rate: 148.2 symbols/min [2025-09-28T03:00:39.828007] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-28T03:00:39.845553] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:39.845665] [INFO ] [MAIN ] Derivative Progress: 303/2211 symbols completed. BOND took 1.2s. Estimated remaining: 12m 50s. Rate: 148.7 symbols/min [2025-09-28T03:00:39.846034] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:39.871822] [DEBUG] [LOCAL ] BOOT: Loaded 41409 existing records from primary storage. [2025-09-28T03:00:39.872870] [INFO ] [MAIN ] BOOT: Loaded 41409 primary data records. [2025-09-28T03:00:40.026204] [DEBUG] [LOCAL ] BOW: Loaded 23974 existing records from primary storage. [2025-09-28T03:00:40.031006] [INFO ] [MAIN ] BOW: Loaded 23974 primary data records. [2025-09-28T03:00:40.244762] [DEBUG] [LOCAL ] BORR: Loaded 51902 existing records from primary storage. [2025-09-28T03:00:40.298200] [INFO ] [MAIN ] BORR: Loaded 51902 primary data records. [2025-09-28T03:00:41.239791] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:41.241778] [INFO ] [MAIN ] BOOT: Generated 1820 derivative records from 41409 primary records. [2025-09-28T03:00:41.242498] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-28T03:00:41.278519] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1820 records). [2025-09-28T03:00:41.276936] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:41.279914] [INFO ] [MAIN ] BOW: Generated 1820 derivative records from 23974 primary records. [2025-09-28T03:00:41.278990] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-28T03:00:41.282793] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-28T03:00:41.282480] [INFO ] [MAIN ] Derivative Progress: 304/2211 symbols completed. BOOT took 1.5s. Estimated remaining: 12m 56s. Rate: 147.5 symbols/min [2025-09-28T03:00:41.284173] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:41.303888] [DEBUG] [LOCAL ] BOW: Derivative data saved (1820 records). [2025-09-28T03:00:41.304367] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-28T03:00:41.314709] [INFO ] [MAIN ] Derivative Progress: 305/2211 symbols completed. BOW took 1.5s. Estimated remaining: 12m 53s. Rate: 147.9 symbols/min [2025-09-28T03:00:41.320386] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:41.320625] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:41.321619] [INFO ] [MAIN ] BORR: Generated 1820 derivative records from 51902 primary records. [2025-09-28T03:00:41.322093] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-28T03:00:41.340322] [DEBUG] [LOCAL ] BORR: Derivative data saved (1820 records). [2025-09-28T03:00:41.340614] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-28T03:00:41.343549] [INFO ] [MAIN ] Derivative Progress: 306/2211 symbols completed. BORR took 1.5s. Estimated remaining: 12m 50s. Rate: 148.4 symbols/min [2025-09-28T03:00:41.343968] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:41.403365] [DEBUG] [LOCAL ] BOX: Loaded 51017 existing records from primary storage. [2025-09-28T03:00:41.403703] [INFO ] [MAIN ] BOX: Loaded 51017 primary data records. [2025-09-28T03:00:41.628579] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-28T03:00:41.759061] [INFO ] [MAIN ] BP: Loaded 54491 primary data records. [2025-09-28T03:00:41.636221] [DEBUG] [LOCAL ] BR: Loaded 35251 existing records from primary storage. [2025-09-28T03:00:41.759427] [INFO ] [MAIN ] BR: Loaded 35251 primary data records. [2025-09-28T03:00:42.480982] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:42.482040] [INFO ] [MAIN ] BOX: Generated 1820 derivative records from 51017 primary records. [2025-09-28T03:00:42.482352] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-28T03:00:42.503043] [DEBUG] [LOCAL ] BOX: Derivative data saved (1820 records). [2025-09-28T03:00:42.503621] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-28T03:00:42.506258] [INFO ] [MAIN ] Derivative Progress: 307/2211 symbols completed. BOX took 1.2s. Estimated remaining: 12m 55s. Rate: 147.5 symbols/min [2025-09-28T03:00:42.506943] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:42.541225] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:42.541035] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:42.542150] [INFO ] [MAIN ] BR: Generated 1820 derivative records from 35251 primary records. [2025-09-28T03:00:42.543001] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-28T03:00:42.542915] [INFO ] [MAIN ] BP: Generated 1820 derivative records from 54491 primary records. [2025-09-28T03:00:42.543962] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-28T03:00:42.575148] [DEBUG] [LOCAL ] BR: Derivative data saved (1820 records). [2025-09-28T03:00:42.578728] [DEBUG] [LOCAL ] BP: Derivative data saved (1820 records). [2025-09-28T03:00:42.578993] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-28T03:00:42.579116] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-28T03:00:42.581798] [INFO ] [MAIN ] Derivative Progress: 308/2211 symbols completed. BR took 1.2s. Estimated remaining: 12m 52s. Rate: 147.9 symbols/min [2025-09-28T03:00:42.582046] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:42.584414] [INFO ] [MAIN ] Derivative Progress: 309/2211 symbols completed. BP took 1.3s. Estimated remaining: 12m 49s. Rate: 148.3 symbols/min [2025-09-28T03:00:42.584845] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:42.620123] [DEBUG] [LOCAL ] BRC: Loaded 19567 existing records from primary storage. [2025-09-28T03:00:42.635679] [INFO ] [MAIN ] BRC: Loaded 19567 primary data records. [2025-09-28T03:00:42.660795] [DEBUG] [LOCAL ] BRBR: Loaded 51987 existing records from primary storage. [2025-09-28T03:00:42.732633] [INFO ] [MAIN ] BRBR: Loaded 51987 primary data records. [2025-09-28T03:00:42.851971] [DEBUG] [LOCAL ] BRCC: Loaded 40896 existing records from primary storage. [2025-09-28T03:00:42.937012] [INFO ] [MAIN ] BRCC: Loaded 40896 primary data records. [2025-09-28T03:00:43.700548] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:43.702754] [INFO ] [MAIN ] BRC: Generated 1820 derivative records from 19567 primary records. [2025-09-28T03:00:43.703591] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-28T03:00:43.738419] [DEBUG] [LOCAL ] BRC: Derivative data saved (1820 records). [2025-09-28T03:00:43.738838] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-28T03:00:43.739191] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:43.741407] [INFO ] [MAIN ] Derivative Progress: 310/2211 symbols completed. BRC took 1.2s. Estimated remaining: 12m 54s. Rate: 147.4 symbols/min [2025-09-28T03:00:43.742683] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:43.742518] [INFO ] [MAIN ] BRBR: Generated 1820 derivative records from 51987 primary records. [2025-09-28T03:00:43.743857] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-28T03:00:43.776739] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:43.776825] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1820 records). [2025-09-28T03:00:43.777895] [INFO ] [MAIN ] BRCC: Generated 1820 derivative records from 40896 primary records. [2025-09-28T03:00:43.778047] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-28T03:00:43.780884] [INFO ] [MAIN ] Derivative Progress: 311/2211 symbols completed. BRBR took 1.3s. Estimated remaining: 12m 51s. Rate: 147.9 symbols/min [2025-09-28T03:00:43.781015] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-28T03:00:43.782293] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:43.800777] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1820 records). [2025-09-28T03:00:43.800975] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-28T03:00:43.803226] [INFO ] [MAIN ] Derivative Progress: 312/2211 symbols completed. BRCC took 1.2s. Estimated remaining: 12m 48s. Rate: 148.3 symbols/min [2025-09-28T03:00:43.803555] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:43.848750] [DEBUG] [LOCAL ] BRO: Loaded 52664 existing records from primary storage. [2025-09-28T03:00:43.848945] [INFO ] [MAIN ] BRO: Loaded 52664 primary data records. [2025-09-28T03:00:44.047893] [DEBUG] [LOCAL ] BRSP: Loaded 37442 existing records from primary storage. [2025-09-28T03:00:44.104768] [INFO ] [MAIN ] BRSP: Loaded 37442 primary data records. [2025-09-28T03:00:44.227867] [DEBUG] [LOCAL ] BROS: Loaded 54067 existing records from primary storage. [2025-09-28T03:00:44.240738] [INFO ] [MAIN ] BROS: Loaded 54067 primary data records. [2025-09-28T03:00:44.891359] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:44.892249] [INFO ] [MAIN ] BRO: Generated 1820 derivative records from 52664 primary records. [2025-09-28T03:00:44.892442] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-28T03:00:44.912685] [DEBUG] [LOCAL ] BRO: Derivative data saved (1820 records). [2025-09-28T03:00:44.913921] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-28T03:00:44.917280] [INFO ] [MAIN ] Derivative Progress: 313/2211 symbols completed. BRO took 1.2s. Estimated remaining: 12m 52s. Rate: 147.5 symbols/min [2025-09-28T03:00:44.936470] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:44.937341] [INFO ] [MAIN ] BRSP: Generated 1820 derivative records from 37442 primary records. [2025-09-28T03:00:44.937451] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-28T03:00:44.956099] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1820 records). [2025-09-28T03:00:44.969316] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-28T03:00:44.969526] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:44.971608] [INFO ] [MAIN ] Derivative Progress: 314/2211 symbols completed. BRSP took 1.2s. Estimated remaining: 12m 50s. Rate: 147.9 symbols/min [2025-09-28T03:00:44.972457] [INFO ] [MAIN ] BROS: Generated 1820 derivative records from 54067 primary records. [2025-09-28T03:00:44.972770] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-28T03:00:44.988768] [DEBUG] [LOCAL ] BROS: Derivative data saved (1820 records). [2025-09-28T03:00:44.988866] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-28T03:00:44.991376] [INFO ] [MAIN ] Derivative Progress: 315/2211 symbols completed. BROS took 1.2s. Estimated remaining: 12m 47s. Rate: 148.4 symbols/min [2025-09-28T03:00:44.991937] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:44.991857] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:44.992141] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:45.007416] [DEBUG] [LOCAL ] BRT: Loaded 5034 existing records from primary storage. [2025-09-28T03:00:45.012950] [INFO ] [MAIN ] BRT: Loaded 5034 primary data records. [2025-09-28T03:00:45.099590] [DEBUG] [LOCAL ] BRW: Loaded 19862 existing records from primary storage. [2025-09-28T03:00:45.124764] [INFO ] [MAIN ] BRW: Loaded 19862 primary data records. [2025-09-28T03:00:45.566959] [DEBUG] [LOCAL ] BRX: Loaded 52462 existing records from primary storage. [2025-09-28T03:00:45.621115] [INFO ] [MAIN ] BRX: Loaded 52462 primary data records. [2025-09-28T03:00:46.121585] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:46.124569] [INFO ] [MAIN ] BRT: Generated 1820 derivative records from 5034 primary records. [2025-09-28T03:00:46.125714] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-28T03:00:46.155470] [DEBUG] [LOCAL ] BRT: Derivative data saved (1820 records). [2025-09-28T03:00:46.161574] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:46.162586] [INFO ] [MAIN ] BRW: Generated 1820 derivative records from 19862 primary records. [2025-09-28T03:00:46.161718] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-28T03:00:46.164960] [INFO ] [MAIN ] Derivative Progress: 316/2211 symbols completed. BRT took 1.2s. Estimated remaining: 12m 51s. Rate: 147.5 symbols/min [2025-09-28T03:00:46.165354] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:46.165696] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-28T03:00:46.202481] [DEBUG] [LOCAL ] BRW: Derivative data saved (1820 records). [2025-09-28T03:00:46.203387] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-28T03:00:46.203179] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:46.206918] [INFO ] [MAIN ] BRX: Generated 1820 derivative records from 52462 primary records. [2025-09-28T03:00:46.205886] [INFO ] [MAIN ] Derivative Progress: 317/2211 symbols completed. BRW took 1.2s. Estimated remaining: 12m 48s. Rate: 147.9 symbols/min [2025-09-28T03:00:46.207203] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-28T03:00:46.207382] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:46.234394] [DEBUG] [LOCAL ] BRX: Derivative data saved (1820 records). [2025-09-28T03:00:46.234740] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-28T03:00:46.237166] [INFO ] [MAIN ] Derivative Progress: 318/2211 symbols completed. BRX took 1.2s. Estimated remaining: 12m 46s. Rate: 148.3 symbols/min [2025-09-28T03:00:46.237498] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:46.252586] [DEBUG] [LOCAL ] BSAC: Loaded 33389 existing records from primary storage. [2025-09-28T03:00:46.261225] [INFO ] [MAIN ] BSAC: Loaded 33389 primary data records. [2025-09-28T03:00:46.328299] [DEBUG] [LOCAL ] BSL: Loaded 8196 existing records from primary storage. [2025-09-28T03:00:46.360604] [INFO ] [MAIN ] BSL: Loaded 8196 primary data records. [2025-09-28T03:00:46.426282] [DEBUG] [LOCAL ] BSBR: Loaded 35731 existing records from primary storage. [2025-09-28T03:00:46.487709] [INFO ] [MAIN ] BSBR: Loaded 35731 primary data records. [2025-09-28T03:00:47.365839] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:47.367313] [INFO ] [MAIN ] BSAC: Generated 1820 derivative records from 33389 primary records. [2025-09-28T03:00:47.367883] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-28T03:00:47.392365] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1820 records). [2025-09-28T03:00:47.392849] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-28T03:00:47.396050] [INFO ] [MAIN ] Derivative Progress: 319/2211 symbols completed. BSAC took 1.2s. Estimated remaining: 12m 50s. Rate: 147.5 symbols/min [2025-09-28T03:00:47.396411] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:47.424529] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:47.426177] [INFO ] [MAIN ] BSL: Generated 1820 derivative records from 8196 primary records. [2025-09-28T03:00:47.426427] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-28T03:00:47.424825] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:47.427942] [INFO ] [MAIN ] BSBR: Generated 1820 derivative records from 35731 primary records. [2025-09-28T03:00:47.428395] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-28T03:00:47.462481] [DEBUG] [LOCAL ] BSL: Derivative data saved (1820 records). [2025-09-28T03:00:47.462594] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1820 records). [2025-09-28T03:00:47.462993] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-28T03:00:47.462881] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-28T03:00:47.474157] [INFO ] [MAIN ] Derivative Progress: 320/2211 symbols completed. BSL took 1.2s. Estimated remaining: 12m 47s. Rate: 147.8 symbols/min [2025-09-28T03:00:47.477366] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:47.477480] [INFO ] [MAIN ] Derivative Progress: 321/2211 symbols completed. BSBR took 1.3s. Estimated remaining: 12m 45s. Rate: 148.3 symbols/min [2025-09-28T03:00:47.478274] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:47.493212] [DEBUG] [LOCAL ] BSM: Loaded 32809 existing records from primary storage. [2025-09-28T03:00:47.493385] [INFO ] [MAIN ] BSM: Loaded 32809 primary data records. [2025-09-28T03:00:47.630547] [DEBUG] [LOCAL ] BST: Loaded 19385 existing records from primary storage. [2025-09-28T03:00:47.672572] [INFO ] [MAIN ] BST: Loaded 19385 primary data records. [2025-09-28T03:00:47.709287] [DEBUG] [LOCAL ] BSTZ: Loaded 25188 existing records from primary storage. [2025-09-28T03:00:47.878313] [INFO ] [MAIN ] BSTZ: Loaded 25188 primary data records. [2025-09-28T03:00:48.556562] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:48.558604] [INFO ] [MAIN ] BSM: Generated 1820 derivative records from 32809 primary records. [2025-09-28T03:00:48.559202] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-28T03:00:48.577609] [DEBUG] [LOCAL ] BSM: Derivative data saved (1820 records). [2025-09-28T03:00:48.578275] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-28T03:00:48.580918] [INFO ] [MAIN ] Derivative Progress: 322/2211 symbols completed. BSM took 1.2s. Estimated remaining: 12m 48s. Rate: 147.5 symbols/min [2025-09-28T03:00:48.581244] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:48.601156] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:48.602033] [INFO ] [MAIN ] BSTZ: Generated 1820 derivative records from 25188 primary records. [2025-09-28T03:00:48.602418] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-28T03:00:48.636903] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:48.637335] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1820 records). [2025-09-28T03:00:48.637496] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-28T03:00:48.638350] [INFO ] [MAIN ] BST: Generated 1820 derivative records from 19385 primary records. [2025-09-28T03:00:48.640818] [INFO ] [MAIN ] Derivative Progress: 323/2211 symbols completed. BSTZ took 1.2s. Estimated remaining: 12m 46s. Rate: 147.9 symbols/min [2025-09-28T03:00:48.641148] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:48.641240] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-28T03:00:48.667348] [DEBUG] [LOCAL ] BTA: Loaded 5464 existing records from primary storage. [2025-09-28T03:00:48.663120] [DEBUG] [LOCAL ] BST: Derivative data saved (1820 records). [2025-09-28T03:00:48.667567] [INFO ] [MAIN ] BTA: Loaded 5464 primary data records. [2025-09-28T03:00:48.673026] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-28T03:00:48.743014] [INFO ] [MAIN ] Derivative Progress: 324/2211 symbols completed. BST took 1.3s. Estimated remaining: 12m 44s. Rate: 148.2 symbols/min [2025-09-28T03:00:48.791853] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:48.855598] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-28T03:00:48.897751] [INFO ] [MAIN ] BSX: Loaded 54468 primary data records. [2025-09-28T03:00:49.071565] [DEBUG] [LOCAL ] BTCM: Loaded 15122 existing records from primary storage. [2025-09-28T03:00:49.111987] [INFO ] [MAIN ] BTCM: Loaded 15122 primary data records. [2025-09-28T03:00:49.806311] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:49.808362] [INFO ] [MAIN ] BTA: Generated 1820 derivative records from 5464 primary records. [2025-09-28T03:00:49.808510] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-28T03:00:49.830392] [DEBUG] [LOCAL ] BTA: Derivative data saved (1820 records). [2025-09-28T03:00:49.830988] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-28T03:00:49.833206] [INFO ] [MAIN ] Derivative Progress: 325/2211 symbols completed. BTA took 1.2s. Estimated remaining: 12m 47s. Rate: 147.5 symbols/min [2025-09-28T03:00:49.833419] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:49.854605] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:49.856011] [INFO ] [MAIN ] BSX: Generated 1820 derivative records from 54468 primary records. [2025-09-28T03:00:49.871063] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:49.870560] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-28T03:00:49.873193] [INFO ] [MAIN ] BTCM: Generated 1820 derivative records from 15122 primary records. [2025-09-28T03:00:49.883073] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-28T03:00:49.910036] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1820 records). [2025-09-28T03:00:49.910169] [DEBUG] [LOCAL ] BSX: Derivative data saved (1820 records). [2025-09-28T03:00:49.910411] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-28T03:00:49.914259] [INFO ] [MAIN ] Derivative Progress: 326/2211 symbols completed. BSX took 1.3s. Estimated remaining: 12m 45s. Rate: 147.8 symbols/min [2025-09-28T03:00:49.910539] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-28T03:00:49.936843] [INFO ] [MAIN ] Derivative Progress: 327/2211 symbols completed. BTCM took 1.1s. Estimated remaining: 12m 42s. Rate: 148.3 symbols/min [2025-09-28T03:00:49.936692] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:49.937163] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:49.963216] [DEBUG] [LOCAL ] BTE: Loaded 53505 existing records from primary storage. [2025-09-28T03:00:49.969163] [DEBUG] [LOCAL ] BTO: Loaded 8982 existing records from primary storage. [2025-09-28T03:00:49.969272] [INFO ] [MAIN ] BTE: Loaded 53505 primary data records. [2025-09-28T03:00:49.969459] [INFO ] [MAIN ] BTO: Loaded 8982 primary data records. [2025-09-28T03:00:50.715975] [DEBUG] [LOCAL ] BTI: Loaded 54335 existing records from primary storage. [2025-09-28T03:00:50.716455] [INFO ] [MAIN ] BTI: Loaded 54335 primary data records. [2025-09-28T03:00:51.087958] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:51.087568] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:51.089149] [INFO ] [MAIN ] BTE: Generated 1820 derivative records from 53505 primary records. [2025-09-28T03:00:51.089850] [INFO ] [MAIN ] BTO: Generated 1820 derivative records from 8982 primary records. [2025-09-28T03:00:51.090139] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-28T03:00:51.090089] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-28T03:00:51.108532] [DEBUG] [LOCAL ] BTO: Derivative data saved (1820 records). [2025-09-28T03:00:51.109151] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-28T03:00:51.112302] [INFO ] [MAIN ] Derivative Progress: 328/2211 symbols completed. BTO took 1.2s. Estimated remaining: 12m 46s. Rate: 147.4 symbols/min [2025-09-28T03:00:51.129968] [DEBUG] [LOCAL ] BTE: Derivative data saved (1820 records). [2025-09-28T03:00:51.130364] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-28T03:00:51.132944] [INFO ] [MAIN ] Derivative Progress: 329/2211 symbols completed. BTE took 1.3s. Estimated remaining: 12m 44s. Rate: 147.8 symbols/min [2025-09-28T03:00:51.150591] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:51.151472] [INFO ] [MAIN ] BTI: Generated 1820 derivative records from 54335 primary records. [2025-09-28T03:00:51.151572] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-28T03:00:51.167874] [DEBUG] [LOCAL ] BTI: Derivative data saved (1820 records). [2025-09-28T03:00:51.168079] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-28T03:00:51.170908] [INFO ] [MAIN ] Derivative Progress: 330/2211 symbols completed. BTI took 1.2s. Estimated remaining: 12m 41s. Rate: 148.2 symbols/min [2025-09-28T03:00:51.171423] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:51.171553] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:51.171689] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:51.200867] [DEBUG] [LOCAL ] BTT: Loaded 16126 existing records from primary storage. [2025-09-28T03:00:51.201302] [INFO ] [MAIN ] BTT: Loaded 16126 primary data records. [2025-09-28T03:00:51.311588] [DEBUG] [LOCAL ] BTZ: Loaded 23002 existing records from primary storage. [2025-09-28T03:00:51.331497] [INFO ] [MAIN ] BTZ: Loaded 23002 primary data records. [2025-09-28T03:00:51.710997] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-28T03:00:51.743836] [INFO ] [MAIN ] BTU: Loaded 54082 primary data records. [2025-09-28T03:00:52.324050] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:52.325711] [INFO ] [MAIN ] BTT: Generated 1820 derivative records from 16126 primary records. [2025-09-28T03:00:52.325838] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-28T03:00:52.361104] [DEBUG] [LOCAL ] BTT: Derivative data saved (1820 records). [2025-09-28T03:00:52.361565] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-28T03:00:52.365106] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:52.366026] [INFO ] [MAIN ] BTZ: Generated 1820 derivative records from 23002 primary records. [2025-09-28T03:00:52.366392] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-28T03:00:52.364762] [INFO ] [MAIN ] Derivative Progress: 331/2211 symbols completed. BTT took 1.2s. Estimated remaining: 12m 45s. Rate: 147.4 symbols/min [2025-09-28T03:00:52.367615] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:52.383496] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1820 records). [2025-09-28T03:00:52.383715] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-28T03:00:52.386835] [INFO ] [MAIN ] Derivative Progress: 332/2211 symbols completed. BTZ took 1.2s. Estimated remaining: 12m 43s. Rate: 147.8 symbols/min [2025-09-28T03:00:52.387014] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:52.406085] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:52.407009] [INFO ] [MAIN ] BTU: Generated 1820 derivative records from 54082 primary records. [2025-09-28T03:00:52.410391] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-28T03:00:52.425338] [DEBUG] [LOCAL ] BUI: Loaded 11615 existing records from primary storage. [2025-09-28T03:00:52.429434] [INFO ] [MAIN ] BUI: Loaded 11615 primary data records. [2025-09-28T03:00:52.446595] [DEBUG] [LOCAL ] BTU: Derivative data saved (1820 records). [2025-09-28T03:00:52.468119] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-28T03:00:52.488466] [INFO ] [MAIN ] Derivative Progress: 333/2211 symbols completed. BTU took 1.3s. Estimated remaining: 12m 41s. Rate: 148.1 symbols/min [2025-09-28T03:00:52.496850] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:52.799636] [DEBUG] [LOCAL ] BUD: Loaded 53504 existing records from primary storage. [2025-09-28T03:00:52.800727] [INFO ] [MAIN ] BUD: Loaded 53504 primary data records. [2025-09-28T03:00:53.193336] [DEBUG] [LOCAL ] BUR: Loaded 45700 existing records from primary storage. [2025-09-28T03:00:53.193705] [INFO ] [MAIN ] BUR: Loaded 45700 primary data records. [2025-09-28T03:00:53.340479] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:53.397037] [INFO ] [MAIN ] BUI: Generated 1820 derivative records from 11615 primary records. [2025-09-28T03:00:53.403069] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-28T03:00:53.579510] [DEBUG] [LOCAL ] BUI: Derivative data saved (1820 records). [2025-09-28T03:00:53.580607] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-28T03:00:53.583638] [INFO ] [MAIN ] Derivative Progress: 334/2211 symbols completed. BUI took 1.2s. Estimated remaining: 12m 44s. Rate: 147.4 symbols/min [2025-09-28T03:00:53.584183] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:53.603673] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:53.604532] [INFO ] [MAIN ] BUD: Generated 1820 derivative records from 53504 primary records. [2025-09-28T03:00:53.604626] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-28T03:00:53.623805] [DEBUG] [LOCAL ] BUD: Derivative data saved (1820 records). [2025-09-28T03:00:53.624182] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-28T03:00:53.627727] [INFO ] [MAIN ] Derivative Progress: 335/2211 symbols completed. BUD took 1.3s. Estimated remaining: 12m 42s. Rate: 147.8 symbols/min [2025-09-28T03:00:53.627981] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:53.648594] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:53.649500] [INFO ] [MAIN ] BUR: Generated 1820 derivative records from 45700 primary records. [2025-09-28T03:00:53.649612] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-28T03:00:53.686964] [DEBUG] [LOCAL ] BUXX: Loaded 15364 existing records from primary storage. [2025-09-28T03:00:53.687757] [INFO ] [MAIN ] BUXX: Loaded 15364 primary data records. [2025-09-28T03:00:53.715679] [DEBUG] [LOCAL ] BUR: Derivative data saved (1820 records). [2025-09-28T03:00:53.780016] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-28T03:00:53.722076] [DEBUG] [LOCAL ] BURL: Loaded 46896 existing records from primary storage. [2025-09-28T03:00:53.795594] [INFO ] [MAIN ] Derivative Progress: 336/2211 symbols completed. BUR took 1.3s. Estimated remaining: 12m 40s. Rate: 148.0 symbols/min [2025-09-28T03:00:53.806070] [INFO ] [MAIN ] BURL: Loaded 46896 primary data records. [2025-09-28T03:00:53.825094] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:54.425719] [DEBUG] [LOCAL ] BV: Loaded 39048 existing records from primary storage. [2025-09-28T03:00:54.427013] [INFO ] [MAIN ] BV: Loaded 39048 primary data records. [2025-09-28T03:00:54.780402] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-28T03:00:54.782021] [INFO ] [MAIN ] BUXX: Generated 1819 derivative records from 15364 primary records. [2025-09-28T03:00:54.789763] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-28T03:00:54.795580] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:54.806110] [INFO ] [MAIN ] BURL: Generated 1820 derivative records from 46896 primary records. [2025-09-28T03:00:54.814922] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1819 records). [2025-09-28T03:00:54.815170] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-28T03:00:54.815224] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-28T03:00:54.819547] [INFO ] [MAIN ] Derivative Progress: 337/2211 symbols completed. BUXX took 1.2s. Estimated remaining: 12m 43s. Rate: 147.4 symbols/min [2025-09-28T03:00:54.827612] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:54.837769] [DEBUG] [LOCAL ] BURL: Derivative data saved (1820 records). [2025-09-28T03:00:54.838579] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-28T03:00:54.841998] [INFO ] [MAIN ] Derivative Progress: 338/2211 symbols completed. BURL took 1.3s. Estimated remaining: 12m 41s. Rate: 147.8 symbols/min [2025-09-28T03:00:54.842415] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:54.866301] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:54.867265] [INFO ] [MAIN ] BV: Generated 1820 derivative records from 39048 primary records. [2025-09-28T03:00:54.867463] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-28T03:00:54.886466] [DEBUG] [LOCAL ] BV: Derivative data saved (1820 records). [2025-09-28T03:00:54.904569] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-28T03:00:54.907406] [INFO ] [MAIN ] Derivative Progress: 339/2211 symbols completed. BV took 1.1s. Estimated remaining: 12m 38s. Rate: 148.1 symbols/min [2025-09-28T03:00:54.907828] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:54.939853] [DEBUG] [LOCAL ] BW: Loaded 40297 existing records from primary storage. [2025-09-28T03:00:54.941248] [INFO ] [MAIN ] BW: Loaded 40297 primary data records. [2025-09-28T03:00:54.941102] [DEBUG] [LOCAL ] BVN: Loaded 44520 existing records from primary storage. [2025-09-28T03:00:54.941484] [INFO ] [MAIN ] BVN: Loaded 44520 primary data records. [2025-09-28T03:00:55.621382] [DEBUG] [LOCAL ] BWA: Loaded 52976 existing records from primary storage. [2025-09-28T03:00:55.623017] [INFO ] [MAIN ] BWA: Loaded 52976 primary data records. [2025-09-28T03:00:56.037632] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:56.047697] [INFO ] [MAIN ] BVN: Generated 1820 derivative records from 44520 primary records. [2025-09-28T03:00:56.054244] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-28T03:00:56.068305] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:56.077955] [INFO ] [MAIN ] BW: Generated 1820 derivative records from 40297 primary records. [2025-09-28T03:00:56.080194] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-28T03:00:56.083386] [DEBUG] [LOCAL ] BVN: Derivative data saved (1820 records). [2025-09-28T03:00:56.083921] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-28T03:00:56.094262] [INFO ] [MAIN ] Derivative Progress: 340/2211 symbols completed. BVN took 1.3s. Estimated remaining: 12m 42s. Rate: 147.3 symbols/min [2025-09-28T03:00:56.100069] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:56.105361] [DEBUG] [LOCAL ] BW: Derivative data saved (1820 records). [2025-09-28T03:00:56.106092] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-28T03:00:56.109558] [INFO ] [MAIN ] Derivative Progress: 341/2211 symbols completed. BW took 1.3s. Estimated remaining: 12m 40s. Rate: 147.7 symbols/min [2025-09-28T03:00:56.109923] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:56.128144] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:56.129053] [INFO ] [MAIN ] BWA: Generated 1820 derivative records from 52976 primary records. [2025-09-28T03:00:56.129187] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-28T03:00:56.155323] [DEBUG] [LOCAL ] BWA: Derivative data saved (1820 records). [2025-09-28T03:00:56.155809] [DEBUG] [LOCAL ] BWG: Loaded 12478 existing records from primary storage. [2025-09-28T03:00:56.156080] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-28T03:00:56.158422] [INFO ] [MAIN ] Derivative Progress: 342/2211 symbols completed. BWA took 1.3s. Estimated remaining: 12m 37s. Rate: 148.1 symbols/min [2025-09-28T03:00:56.158906] [INFO ] [MAIN ] BWG: Loaded 12478 primary data records. [2025-09-28T03:00:56.158607] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:56.278262] [DEBUG] [LOCAL ] BWMX: Loaded 7676 existing records from primary storage. [2025-09-28T03:00:56.308211] [INFO ] [MAIN ] BWMX: Loaded 7676 primary data records. [2025-09-28T03:00:56.309214] [DEBUG] [LOCAL ] BWLP: Loaded 33185 existing records from primary storage. [2025-09-28T03:00:56.343573] [INFO ] [MAIN ] BWLP: Loaded 33185 primary data records. [2025-09-28T03:00:57.184105] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:57.184998] [INFO ] [MAIN ] BWG: Generated 1820 derivative records from 12478 primary records. [2025-09-28T03:00:57.185517] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-28T03:00:57.202494] [DEBUG] [LOCAL ] BWG: Derivative data saved (1820 records). [2025-09-28T03:00:57.204675] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-28T03:00:57.209861] [INFO ] [MAIN ] Derivative Progress: 343/2211 symbols completed. BWG took 1.1s. Estimated remaining: 12m 40s. Rate: 147.4 symbols/min [2025-09-28T03:00:57.223985] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:57.236980] [INFO ] [MAIN ] BWMX: Generated 1820 derivative records from 7676 primary records. [2025-09-28T03:00:57.237266] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:57.237423] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-28T03:00:57.238196] [INFO ] [MAIN ] BWLP: Generated 1820 derivative records from 33185 primary records. [2025-09-28T03:00:57.238811] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-28T03:00:57.254185] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1820 records). [2025-09-28T03:00:57.254290] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-28T03:00:57.265165] [INFO ] [MAIN ] Derivative Progress: 344/2211 symbols completed. BWMX took 1.1s. Estimated remaining: 12m 38s. Rate: 147.8 symbols/min [2025-09-28T03:00:57.272227] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1820 records). [2025-09-28T03:00:57.272330] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-28T03:00:57.275023] [INFO ] [MAIN ] Derivative Progress: 345/2211 symbols completed. BWLP took 1.2s. Estimated remaining: 12m 35s. Rate: 148.2 symbols/min [2025-09-28T03:00:57.275492] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:57.275597] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:57.275544] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:57.289999] [DEBUG] [LOCAL ] BWNB: Loaded 4468 existing records from primary storage. [2025-09-28T03:00:57.290328] [DEBUG] [LOCAL ] BWSN: Loaded 5130 existing records from primary storage. [2025-09-28T03:00:57.290543] [INFO ] [MAIN ] BWNB: Loaded 4468 primary data records. [2025-09-28T03:00:57.290614] [INFO ] [MAIN ] BWSN: Loaded 5130 primary data records. [2025-09-28T03:00:57.949185] [DEBUG] [LOCAL ] BWXT: Loaded 47442 existing records from primary storage. [2025-09-28T03:00:57.951027] [INFO ] [MAIN ] BWXT: Loaded 47442 primary data records. [2025-09-28T03:00:58.359107] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:58.362260] [INFO ] [MAIN ] BWSN: Generated 1820 derivative records from 5130 primary records. [2025-09-28T03:00:58.363349] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-28T03:00:58.389686] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-28T03:00:58.391469] [INFO ] [MAIN ] BWNB: Generated 1819 derivative records from 4468 primary records. [2025-09-28T03:00:58.391872] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-28T03:00:58.402564] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1820 records). [2025-09-28T03:00:58.406513] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-28T03:00:58.410601] [INFO ] [MAIN ] Derivative Progress: 346/2211 symbols completed. BWSN took 1.1s. Estimated remaining: 12m 39s. Rate: 147.4 symbols/min [2025-09-28T03:00:58.411694] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:58.414765] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1819 records). [2025-09-28T03:00:58.415030] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-28T03:00:58.418119] [INFO ] [MAIN ] Derivative Progress: 347/2211 symbols completed. BWNB took 1.1s. Estimated remaining: 12m 36s. Rate: 147.8 symbols/min [2025-09-28T03:00:58.418852] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:58.440043] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:58.441421] [INFO ] [MAIN ] BWXT: Generated 1820 derivative records from 47442 primary records. [2025-09-28T03:00:58.441630] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-28T03:00:58.471581] [DEBUG] [LOCAL ] BXC: Loaded 13880 existing records from primary storage. [2025-09-28T03:00:58.471027] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1820 records). [2025-09-28T03:00:58.471921] [INFO ] [MAIN ] BXC: Loaded 13880 primary data records. [2025-09-28T03:00:58.472012] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-28T03:00:58.475230] [INFO ] [MAIN ] Derivative Progress: 348/2211 symbols completed. BWXT took 1.2s. Estimated remaining: 12m 34s. Rate: 148.2 symbols/min [2025-09-28T03:00:58.480606] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:58.710850] [DEBUG] [LOCAL ] BX: Loaded 54270 existing records from primary storage. [2025-09-28T03:00:58.717981] [INFO ] [MAIN ] BX: Loaded 54270 primary data records. [2025-09-28T03:00:58.993777] [DEBUG] [LOCAL ] BXMT: Loaded 47994 existing records from primary storage. [2025-09-28T03:00:59.004970] [INFO ] [MAIN ] BXMT: Loaded 47994 primary data records. [2025-09-28T03:00:59.556249] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:59.557768] [INFO ] [MAIN ] BXC: Generated 1820 derivative records from 13880 primary records. [2025-09-28T03:00:59.558944] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-28T03:00:59.577608] [DEBUG] [LOCAL ] BXC: Derivative data saved (1820 records). [2025-09-28T03:00:59.578337] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-28T03:00:59.581395] [INFO ] [MAIN ] Derivative Progress: 349/2211 symbols completed. BXC took 1.2s. Estimated remaining: 12m 38s. Rate: 147.5 symbols/min [2025-09-28T03:00:59.582487] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:59.601430] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:59.602549] [INFO ] [MAIN ] BX: Generated 1820 derivative records from 54270 primary records. [2025-09-28T03:00:59.602847] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-28T03:00:59.635215] [DEBUG] [LOCAL ] BX: Derivative data saved (1820 records). [2025-09-28T03:00:59.646575] [DEBUG] [LOCAL ] BXMX: Loaded 19855 existing records from primary storage. [2025-09-28T03:00:59.651238] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-28T03:00:59.652031] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:00:59.652090] [INFO ] [MAIN ] BXMX: Loaded 19855 primary data records. [2025-09-28T03:00:59.656515] [INFO ] [MAIN ] BXMT: Generated 1820 derivative records from 47994 primary records. [2025-09-28T03:00:59.661761] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-28T03:00:59.655190] [INFO ] [MAIN ] Derivative Progress: 350/2211 symbols completed. BX took 1.2s. Estimated remaining: 12m 35s. Rate: 147.8 symbols/min [2025-09-28T03:00:59.681324] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:00:59.762610] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1820 records). [2025-09-28T03:00:59.787623] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-28T03:00:59.790591] [INFO ] [MAIN ] Derivative Progress: 351/2211 symbols completed. BXMT took 1.3s. Estimated remaining: 12m 34s. Rate: 148.1 symbols/min [2025-09-28T03:00:59.806748] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:00.035354] [DEBUG] [LOCAL ] BXP: Loaded 50577 existing records from primary storage. [2025-09-28T03:01:00.045531] [INFO ] [MAIN ] BXP: Loaded 50577 primary data records. [2025-09-28T03:01:00.201758] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:00.208523] [DEBUG] [LOCAL ] BXSL: Loaded 48276 existing records from primary storage. [2025-09-28T03:01:00.219070] [INFO ] [MAIN ] BXSL: Loaded 48276 primary data records. [2025-09-28T03:01:00.220231] [INFO ] [MAIN ] BXMX: Generated 1820 derivative records from 19855 primary records. [2025-09-28T03:01:00.315190] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-28T03:01:00.570825] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1820 records). [2025-09-28T03:01:00.585354] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-28T03:01:00.589081] [INFO ] [MAIN ] Derivative Progress: 352/2211 symbols completed. BXMX took 1.0s. Estimated remaining: 12m 35s. Rate: 147.7 symbols/min [2025-09-28T03:01:00.594928] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:00.827000] [DEBUG] [LOCAL ] BY: Loaded 21895 existing records from primary storage. [2025-09-28T03:01:00.830549] [INFO ] [MAIN ] BY: Loaded 21895 primary data records. [2025-09-28T03:01:00.939580] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:00.946367] [INFO ] [MAIN ] BXP: Generated 1820 derivative records from 50577 primary records. [2025-09-28T03:01:00.946832] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-28T03:01:01.023751] [DEBUG] [LOCAL ] BXP: Derivative data saved (1820 records). [2025-09-28T03:01:01.089760] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:01.062112] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-28T03:01:01.100558] [INFO ] [MAIN ] Derivative Progress: 353/2211 symbols completed. BXP took 1.4s. Estimated remaining: 12m 35s. Rate: 147.6 symbols/min [2025-09-28T03:01:01.213206] [INFO ] [MAIN ] BXSL: Generated 1820 derivative records from 48276 primary records. [2025-09-28T03:01:01.213626] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:01.228831] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-28T03:01:01.252406] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1820 records). [2025-09-28T03:01:01.253622] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-28T03:01:01.256805] [INFO ] [MAIN ] Derivative Progress: 354/2211 symbols completed. BXSL took 1.5s. Estimated remaining: 12m 34s. Rate: 147.8 symbols/min [2025-09-28T03:01:01.257547] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:01.295297] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:01.301928] [DEBUG] [LOCAL ] BYM: Loaded 12225 existing records from primary storage. [2025-09-28T03:01:01.303015] [INFO ] [MAIN ] BY: Generated 1820 derivative records from 21895 primary records. [2025-09-28T03:01:01.303289] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-28T03:01:01.303366] [INFO ] [MAIN ] BYM: Loaded 12225 primary data records. [2025-09-28T03:01:01.432417] [DEBUG] [LOCAL ] BYD: Loaded 45804 existing records from primary storage. [2025-09-28T03:01:01.443162] [DEBUG] [LOCAL ] BY: Derivative data saved (1820 records). [2025-09-28T03:01:01.455844] [INFO ] [MAIN ] BYD: Loaded 45804 primary data records. [2025-09-28T03:01:01.466966] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-28T03:01:01.491541] [INFO ] [MAIN ] Derivative Progress: 355/2211 symbols completed. BY took 0.9s. Estimated remaining: 12m 32s. Rate: 148.0 symbols/min [2025-09-28T03:01:01.536735] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:02.041486] [DEBUG] [LOCAL ] BZH: Loaded 33088 existing records from primary storage. [2025-09-28T03:01:02.045432] [INFO ] [MAIN ] BZH: Loaded 33088 primary data records. [2025-09-28T03:01:02.141181] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:02.169024] [INFO ] [MAIN ] BYM: Generated 1820 derivative records from 12225 primary records. [2025-09-28T03:01:02.169260] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-28T03:01:02.471298] [DEBUG] [LOCAL ] BYM: Derivative data saved (1820 records). [2025-09-28T03:01:02.471987] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-28T03:01:02.474256] [INFO ] [MAIN ] Derivative Progress: 356/2211 symbols completed. BYM took 1.2s. Estimated remaining: 12m 35s. Rate: 147.4 symbols/min [2025-09-28T03:01:02.474851] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:02.496109] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:02.498341] [INFO ] [MAIN ] BYD: Generated 1820 derivative records from 45804 primary records. [2025-09-28T03:01:02.498753] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-28T03:01:02.518082] [DEBUG] [LOCAL ] BYD: Derivative data saved (1820 records). [2025-09-28T03:01:02.518509] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-28T03:01:02.520873] [INFO ] [MAIN ] Derivative Progress: 357/2211 symbols completed. BYD took 1.3s. Estimated remaining: 12m 33s. Rate: 147.8 symbols/min [2025-09-28T03:01:02.521518] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:02.541269] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:02.542197] [INFO ] [MAIN ] BZH: Generated 1820 derivative records from 33088 primary records. [2025-09-28T03:01:02.542390] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-28T03:01:02.585866] [DEBUG] [LOCAL ] BZH: Derivative data saved (1820 records). [2025-09-28T03:01:02.586541] [DEBUG] [LOCAL ] CAAP: Loaded 20021 existing records from primary storage. [2025-09-28T03:01:02.586991] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-28T03:01:02.586901] [INFO ] [MAIN ] CAAP: Loaded 20021 primary data records. [2025-09-28T03:01:02.590068] [INFO ] [MAIN ] Derivative Progress: 358/2211 symbols completed. BZH took 1.1s. Estimated remaining: 12m 30s. Rate: 148.1 symbols/min [2025-09-28T03:01:02.721422] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-28T03:01:02.742853] [INFO ] [MAIN ] C: Loaded 54521 primary data records. [2025-09-28T03:01:03.286853] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:03.288115] [INFO ] [MAIN ] CAAP: Generated 1820 derivative records from 20021 primary records. [2025-09-28T03:01:03.288466] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-28T03:01:03.308055] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1820 records). [2025-09-28T03:01:03.308506] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-28T03:01:03.311069] [INFO ] [MAIN ] Derivative Progress: 359/2211 symbols completed. CAAP took 0.8s. Estimated remaining: 12m 32s. Rate: 147.8 symbols/min [2025-09-28T03:01:03.326372] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:03.327197] [INFO ] [MAIN ] C: Generated 1820 derivative records from 54521 primary records. [2025-09-28T03:01:03.327286] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-28T03:01:03.343428] [DEBUG] [LOCAL ] C: Derivative data saved (1820 records). [2025-09-28T03:01:03.343568] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-28T03:01:03.346139] [INFO ] [MAIN ] Derivative Progress: 360/2211 symbols completed. C took 0.9s. Estimated remaining: 12m 29s. Rate: 148.2 symbols/min [2025-09-28T03:01:03.346963] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:03.346811] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:03.347065] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:03.371240] [DEBUG] [LOCAL ] CABO: Loaded 17549 existing records from primary storage. [2025-09-28T03:01:03.371594] [INFO ] [MAIN ] CABO: Loaded 17549 primary data records. [2025-09-28T03:01:03.514231] [DEBUG] [LOCAL ] CACI: Loaded 25384 existing records from primary storage. [2025-09-28T03:01:03.567091] [INFO ] [MAIN ] CACI: Loaded 25384 primary data records. [2025-09-28T03:01:03.789426] [DEBUG] [LOCAL ] CADE: Loaded 49496 existing records from primary storage. [2025-09-28T03:01:03.801493] [INFO ] [MAIN ] CADE: Loaded 49496 primary data records. [2025-09-28T03:01:04.478972] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:04.482627] [INFO ] [MAIN ] CABO: Generated 1820 derivative records from 17549 primary records. [2025-09-28T03:01:04.483306] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-28T03:01:04.507916] [DEBUG] [LOCAL ] CABO: Derivative data saved (1820 records). [2025-09-28T03:01:04.508575] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-28T03:01:04.521682] [INFO ] [MAIN ] Derivative Progress: 361/2211 symbols completed. CABO took 1.2s. Estimated remaining: 12m 33s. Rate: 147.4 symbols/min [2025-09-28T03:01:04.530509] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:04.532348] [INFO ] [MAIN ] CACI: Generated 1820 derivative records from 25384 primary records. [2025-09-28T03:01:04.532842] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:04.533054] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-28T03:01:04.556625] [DEBUG] [LOCAL ] CACI: Derivative data saved (1820 records). [2025-09-28T03:01:04.570251] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:04.570356] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-28T03:01:04.571373] [INFO ] [MAIN ] CADE: Generated 1820 derivative records from 49496 primary records. [2025-09-28T03:01:04.571570] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-28T03:01:04.573994] [INFO ] [MAIN ] Derivative Progress: 362/2211 symbols completed. CACI took 1.2s. Estimated remaining: 12m 31s. Rate: 147.8 symbols/min [2025-09-28T03:01:04.574336] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:04.595610] [DEBUG] [LOCAL ] CAF: Loaded 3471 existing records from primary storage. [2025-09-28T03:01:04.595950] [INFO ] [MAIN ] CAF: Loaded 3471 primary data records. [2025-09-28T03:01:04.610799] [DEBUG] [LOCAL ] CADE: Derivative data saved (1820 records). [2025-09-28T03:01:04.631834] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-28T03:01:04.682564] [INFO ] [MAIN ] Derivative Progress: 363/2211 symbols completed. CADE took 1.3s. Estimated remaining: 12m 29s. Rate: 148.1 symbols/min [2025-09-28T03:01:04.707899] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:04.746448] [DEBUG] [LOCAL ] CAE: Loaded 39622 existing records from primary storage. [2025-09-28T03:01:04.775097] [INFO ] [MAIN ] CAE: Loaded 39622 primary data records. [2025-09-28T03:01:05.335796] [DEBUG] [LOCAL ] CAG: Loaded 54439 existing records from primary storage. [2025-09-28T03:01:05.350081] [INFO ] [MAIN ] CAG: Loaded 54439 primary data records. [2025-09-28T03:01:05.697244] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:05.698406] [INFO ] [MAIN ] CAF: Generated 1820 derivative records from 3471 primary records. [2025-09-28T03:01:05.699009] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-28T03:01:05.732240] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:05.733814] [INFO ] [MAIN ] CAE: Generated 1820 derivative records from 39622 primary records. [2025-09-28T03:01:05.732362] [DEBUG] [LOCAL ] CAF: Derivative data saved (1820 records). [2025-09-28T03:01:05.734518] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-28T03:01:05.736025] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-28T03:01:05.738411] [INFO ] [MAIN ] Derivative Progress: 364/2211 symbols completed. CAF took 1.2s. Estimated remaining: 12m 32s. Rate: 147.4 symbols/min [2025-09-28T03:01:05.738671] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:05.757913] [DEBUG] [LOCAL ] CAE: Derivative data saved (1820 records). [2025-09-28T03:01:05.758570] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-28T03:01:05.761695] [INFO ] [MAIN ] Derivative Progress: 365/2211 symbols completed. CAE took 1.2s. Estimated remaining: 12m 29s. Rate: 147.8 symbols/min [2025-09-28T03:01:05.762306] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:05.787134] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:05.788159] [INFO ] [MAIN ] CAG: Generated 1820 derivative records from 54439 primary records. [2025-09-28T03:01:05.788250] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-28T03:01:05.806529] [DEBUG] [LOCAL ] CAG: Derivative data saved (1820 records). [2025-09-28T03:01:05.806703] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-28T03:01:05.809406] [INFO ] [MAIN ] Derivative Progress: 366/2211 symbols completed. CAG took 1.1s. Estimated remaining: 12m 27s. Rate: 148.2 symbols/min [2025-09-28T03:01:05.809770] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:05.873789] [DEBUG] [LOCAL ] CAH: Loaded 52209 existing records from primary storage. [2025-09-28T03:01:05.874747] [DEBUG] [LOCAL ] CAL: Loaded 43833 existing records from primary storage. [2025-09-28T03:01:05.875089] [INFO ] [MAIN ] CAL: Loaded 43833 primary data records. [2025-09-28T03:01:05.875140] [INFO ] [MAIN ] CAH: Loaded 52209 primary data records. [2025-09-28T03:01:06.119684] [DEBUG] [LOCAL ] CALX: Loaded 38931 existing records from primary storage. [2025-09-28T03:01:06.143456] [INFO ] [MAIN ] CALX: Loaded 38931 primary data records. [2025-09-28T03:01:06.955886] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:06.969968] [INFO ] [MAIN ] CAL: Generated 1820 derivative records from 43833 primary records. [2025-09-28T03:01:06.968981] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:06.970899] [INFO ] [MAIN ] CAH: Generated 1820 derivative records from 52209 primary records. [2025-09-28T03:01:06.971131] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-28T03:01:06.971296] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-28T03:01:07.024582] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:07.026509] [DEBUG] [LOCAL ] CAH: Derivative data saved (1820 records). [2025-09-28T03:01:07.029031] [DEBUG] [LOCAL ] CAL: Derivative data saved (1820 records). [2025-09-28T03:01:07.029158] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-28T03:01:07.027302] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-28T03:01:07.028375] [INFO ] [MAIN ] CALX: Generated 1820 derivative records from 38931 primary records. [2025-09-28T03:01:07.031988] [INFO ] [MAIN ] Derivative Progress: 367/2211 symbols completed. CAH took 1.3s. Estimated remaining: 12m 31s. Rate: 147.4 symbols/min [2025-09-28T03:01:07.032116] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-28T03:01:07.042109] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:07.043479] [INFO ] [MAIN ] Derivative Progress: 368/2211 symbols completed. CAL took 1.3s. Estimated remaining: 12m 28s. Rate: 147.7 symbols/min [2025-09-28T03:01:07.044229] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:07.061751] [DEBUG] [LOCAL ] CALX: Derivative data saved (1820 records). [2025-09-28T03:01:07.061961] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-28T03:01:07.066976] [INFO ] [MAIN ] Derivative Progress: 369/2211 symbols completed. CALX took 1.3s. Estimated remaining: 12m 26s. Rate: 148.1 symbols/min [2025-09-28T03:01:07.069045] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:07.074836] [DEBUG] [LOCAL ] CAPL: Loaded 5930 existing records from primary storage. [2025-09-28T03:01:07.075367] [INFO ] [MAIN ] CAPL: Loaded 5930 primary data records. [2025-09-28T03:01:07.207302] [DEBUG] [LOCAL ] CANG: Loaded 27132 existing records from primary storage. [2025-09-28T03:01:07.208029] [INFO ] [MAIN ] CANG: Loaded 27132 primary data records. [2025-09-28T03:01:07.790816] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-09-28T03:01:07.791415] [INFO ] [MAIN ] CARR: Loaded 54374 primary data records. [2025-09-28T03:01:08.162750] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:08.163997] [INFO ] [MAIN ] CAPL: Generated 1820 derivative records from 5930 primary records. [2025-09-28T03:01:08.165122] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-28T03:01:08.198868] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:08.201528] [INFO ] [MAIN ] CANG: Generated 1820 derivative records from 27132 primary records. [2025-09-28T03:01:08.203085] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-28T03:01:08.202916] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1820 records). [2025-09-28T03:01:08.203267] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-28T03:01:08.206517] [INFO ] [MAIN ] Derivative Progress: 370/2211 symbols completed. CAPL took 1.2s. Estimated remaining: 12m 29s. Rate: 147.4 symbols/min [2025-09-28T03:01:08.206935] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:08.225057] [DEBUG] [LOCAL ] CANG: Derivative data saved (1820 records). [2025-09-28T03:01:08.225860] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-28T03:01:08.228336] [INFO ] [MAIN ] Derivative Progress: 371/2211 symbols completed. CANG took 1.2s. Estimated remaining: 12m 27s. Rate: 147.8 symbols/min [2025-09-28T03:01:08.228615] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:08.249251] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:08.250183] [INFO ] [MAIN ] CARR: Generated 1820 derivative records from 54374 primary records. [2025-09-28T03:01:08.250584] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-28T03:01:08.281489] [DEBUG] [LOCAL ] CARR: Derivative data saved (1820 records). [2025-09-28T03:01:08.281762] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-28T03:01:08.285227] [INFO ] [MAIN ] Derivative Progress: 372/2211 symbols completed. CARR took 1.2s. Estimated remaining: 12m 25s. Rate: 148.1 symbols/min [2025-09-28T03:01:08.285768] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:08.301326] [DEBUG] [LOCAL ] CARS: Loaded 40616 existing records from primary storage. [2025-09-28T03:01:08.303267] [INFO ] [MAIN ] CARS: Loaded 40616 primary data records. [2025-09-28T03:01:08.356047] [DEBUG] [LOCAL ] CATO: Loaded 7286 existing records from primary storage. [2025-09-28T03:01:08.382231] [INFO ] [MAIN ] CATO: Loaded 7286 primary data records. [2025-09-28T03:01:08.563568] [DEBUG] [LOCAL ] CAT: Loaded 53693 existing records from primary storage. [2025-09-28T03:01:08.629755] [INFO ] [MAIN ] CAT: Loaded 53693 primary data records. [2025-09-28T03:01:09.430436] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:09.432212] [INFO ] [MAIN ] CARS: Generated 1820 derivative records from 40616 primary records. [2025-09-28T03:01:09.433065] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-28T03:01:09.453486] [DEBUG] [LOCAL ] CARS: Derivative data saved (1820 records). [2025-09-28T03:01:09.456164] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-28T03:01:09.462516] [INFO ] [MAIN ] Derivative Progress: 373/2211 symbols completed. CARS took 1.3s. Estimated remaining: 12m 28s. Rate: 147.4 symbols/min [2025-09-28T03:01:09.477371] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:09.490848] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:09.491870] [INFO ] [MAIN ] CAT: Generated 1820 derivative records from 53693 primary records. [2025-09-28T03:01:09.492176] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-28T03:01:09.493029] [INFO ] [MAIN ] CATO: Generated 1820 derivative records from 7286 primary records. [2025-09-28T03:01:09.494073] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-28T03:01:09.522579] [DEBUG] [LOCAL ] CAT: Derivative data saved (1820 records). [2025-09-28T03:01:09.526861] [DEBUG] [LOCAL ] CATO: Derivative data saved (1820 records). [2025-09-28T03:01:09.526944] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-28T03:01:09.529685] [INFO ] [MAIN ] Derivative Progress: 374/2211 symbols completed. CAT took 1.3s. Estimated remaining: 12m 26s. Rate: 147.7 symbols/min [2025-09-28T03:01:09.527089] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-28T03:01:09.532694] [INFO ] [MAIN ] Derivative Progress: 375/2211 symbols completed. CATO took 1.2s. Estimated remaining: 12m 24s. Rate: 148.1 symbols/min [2025-09-28T03:01:09.533329] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:09.533245] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:09.533152] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:09.550437] [DEBUG] [LOCAL ] CBAN: Loaded 11141 existing records from primary storage. [2025-09-28T03:01:09.550667] [INFO ] [MAIN ] CBAN: Loaded 11141 primary data records. [2025-09-28T03:01:09.819994] [DEBUG] [LOCAL ] CB: Loaded 50773 existing records from primary storage. [2025-09-28T03:01:09.821016] [DEBUG] [LOCAL ] CAVA: Loaded 54330 existing records from primary storage. [2025-09-28T03:01:09.947315] [INFO ] [MAIN ] CAVA: Loaded 54330 primary data records. [2025-09-28T03:01:09.947410] [INFO ] [MAIN ] CB: Loaded 50773 primary data records. [2025-09-28T03:01:10.609971] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:10.611006] [INFO ] [MAIN ] CBAN: Generated 1820 derivative records from 11141 primary records. [2025-09-28T03:01:10.611312] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-28T03:01:10.631955] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1820 records). [2025-09-28T03:01:10.632166] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-28T03:01:10.634301] [INFO ] [MAIN ] Derivative Progress: 376/2211 symbols completed. CBAN took 1.1s. Estimated remaining: 12m 27s. Rate: 147.4 symbols/min [2025-09-28T03:01:10.635003] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:10.656705] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:10.670053] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:10.670855] [INFO ] [MAIN ] CAVA: Generated 1820 derivative records from 54330 primary records. [2025-09-28T03:01:10.676467] [INFO ] [MAIN ] CB: Generated 1820 derivative records from 50773 primary records. [2025-09-28T03:01:10.676795] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-28T03:01:10.676916] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-28T03:01:10.706519] [DEBUG] [LOCAL ] CBL: Loaded 16862 existing records from primary storage. [2025-09-28T03:01:10.710235] [INFO ] [MAIN ] CBL: Loaded 16862 primary data records. [2025-09-28T03:01:10.722401] [DEBUG] [LOCAL ] CB: Derivative data saved (1820 records). [2025-09-28T03:01:10.730584] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1820 records). [2025-09-28T03:01:10.730704] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-28T03:01:10.763330] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-28T03:01:10.823141] [INFO ] [MAIN ] Derivative Progress: 377/2211 symbols completed. CB took 1.3s. Estimated remaining: 12m 25s. Rate: 147.6 symbols/min [2025-09-28T03:01:10.830099] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:10.830202] [INFO ] [MAIN ] Derivative Progress: 378/2211 symbols completed. CAVA took 1.3s. Estimated remaining: 12m 23s. Rate: 148.0 symbols/min [2025-09-28T03:01:10.831033] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:10.897833] [DEBUG] [LOCAL ] CBNA: Loaded 2923 existing records from primary storage. [2025-09-28T03:01:11.055397] [INFO ] [MAIN ] CBNA: Loaded 2923 primary data records. [2025-09-28T03:01:11.434285] [DEBUG] [LOCAL ] CBRE: Loaded 51366 existing records from primary storage. [2025-09-28T03:01:11.435788] [INFO ] [MAIN ] CBRE: Loaded 51366 primary data records. [2025-09-28T03:01:11.612571] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:11.665075] [INFO ] [MAIN ] CBL: Generated 1820 derivative records from 16862 primary records. [2025-09-28T03:01:11.674700] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-28T03:01:11.831969] [DEBUG] [LOCAL ] CBL: Derivative data saved (1820 records). [2025-09-28T03:01:11.832969] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-28T03:01:11.848453] [INFO ] [MAIN ] Derivative Progress: 379/2211 symbols completed. CBL took 1.2s. Estimated remaining: 12m 26s. Rate: 147.4 symbols/min [2025-09-28T03:01:11.849993] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:11.849764] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:11.852865] [INFO ] [MAIN ] CBNA: Generated 1820 derivative records from 2923 primary records. [2025-09-28T03:01:11.853748] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-28T03:01:11.872584] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1820 records). [2025-09-28T03:01:11.872978] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-28T03:01:11.875435] [INFO ] [MAIN ] Derivative Progress: 380/2211 symbols completed. CBNA took 1.0s. Estimated remaining: 12m 23s. Rate: 147.8 symbols/min [2025-09-28T03:01:11.875823] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:11.895338] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:11.904674] [INFO ] [MAIN ] CBRE: Generated 1820 derivative records from 51366 primary records. [2025-09-28T03:01:11.904886] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-28T03:01:11.933503] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1820 records). [2025-09-28T03:01:11.933892] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-28T03:01:11.937060] [INFO ] [MAIN ] Derivative Progress: 381/2211 symbols completed. CBRE took 1.1s. Estimated remaining: 12m 21s. Rate: 148.1 symbols/min [2025-09-28T03:01:11.938577] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:11.938227] [DEBUG] [LOCAL ] CBT: Loaded 31567 existing records from primary storage. [2025-09-28T03:01:11.945890] [INFO ] [MAIN ] CBT: Loaded 31567 primary data records. [2025-09-28T03:01:12.050987] [DEBUG] [LOCAL ] CBU: Loaded 23130 existing records from primary storage. [2025-09-28T03:01:12.067800] [INFO ] [MAIN ] CBU: Loaded 23130 primary data records. [2025-09-28T03:01:12.292552] [DEBUG] [LOCAL ] CBZ: Loaded 34130 existing records from primary storage. [2025-09-28T03:01:12.439309] [INFO ] [MAIN ] CBZ: Loaded 34130 primary data records. [2025-09-28T03:01:13.039317] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:13.042085] [INFO ] [MAIN ] CBT: Generated 1820 derivative records from 31567 primary records. [2025-09-28T03:01:13.043505] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-28T03:01:13.064591] [DEBUG] [LOCAL ] CBT: Derivative data saved (1820 records). [2025-09-28T03:01:13.066080] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-28T03:01:13.068777] [INFO ] [MAIN ] Derivative Progress: 382/2211 symbols completed. CBT took 1.2s. Estimated remaining: 12m 24s. Rate: 147.4 symbols/min [2025-09-28T03:01:13.082205] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:13.082746] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:13.083880] [INFO ] [MAIN ] CBU: Generated 1820 derivative records from 23130 primary records. [2025-09-28T03:01:13.084200] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-28T03:01:13.104290] [DEBUG] [LOCAL ] CBU: Derivative data saved (1820 records). [2025-09-28T03:01:13.107086] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-28T03:01:13.109675] [INFO ] [MAIN ] Derivative Progress: 383/2211 symbols completed. CBU took 1.2s. Estimated remaining: 12m 22s. Rate: 147.8 symbols/min [2025-09-28T03:01:13.110060] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:13.124141] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:13.125104] [INFO ] [MAIN ] CBZ: Generated 1820 derivative records from 34130 primary records. [2025-09-28T03:01:13.125257] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-28T03:01:13.143102] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1820 records). [2025-09-28T03:01:13.143268] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-28T03:01:13.146189] [INFO ] [MAIN ] Derivative Progress: 384/2211 symbols completed. CBZ took 1.2s. Estimated remaining: 12m 20s. Rate: 148.1 symbols/min [2025-09-28T03:01:13.146525] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:13.179919] [DEBUG] [LOCAL ] CCIF: Loaded 15698 existing records from primary storage. [2025-09-28T03:01:13.209865] [DEBUG] [LOCAL ] CC: Loaded 53801 existing records from primary storage. [2025-09-28T03:01:13.210102] [INFO ] [MAIN ] CC: Loaded 53801 primary data records. [2025-09-28T03:01:13.208128] [INFO ] [MAIN ] CCIF: Loaded 15698 primary data records. [2025-09-28T03:01:13.556075] [DEBUG] [LOCAL ] CCI: Loaded 53922 existing records from primary storage. [2025-09-28T03:01:13.743420] [INFO ] [MAIN ] CCI: Loaded 53922 primary data records. [2025-09-28T03:01:14.226678] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:14.230774] [INFO ] [MAIN ] CC: Generated 1820 derivative records from 53801 primary records. [2025-09-28T03:01:14.231098] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-28T03:01:14.259777] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:14.264795] [INFO ] [MAIN ] CCIF: Generated 1820 derivative records from 15698 primary records. [2025-09-28T03:01:14.263944] [DEBUG] [LOCAL ] CC: Derivative data saved (1820 records). [2025-09-28T03:01:14.264942] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-28T03:01:14.265034] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-28T03:01:14.268368] [INFO ] [MAIN ] Derivative Progress: 385/2211 symbols completed. CC took 1.2s. Estimated remaining: 12m 23s. Rate: 147.4 symbols/min [2025-09-28T03:01:14.269078] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:14.289279] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1820 records). [2025-09-28T03:01:14.290587] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-28T03:01:14.293579] [INFO ] [MAIN ] Derivative Progress: 386/2211 symbols completed. CCIF took 1.1s. Estimated remaining: 12m 21s. Rate: 147.8 symbols/min [2025-09-28T03:01:14.294787] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:14.309016] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:14.309838] [INFO ] [MAIN ] CCI: Generated 1820 derivative records from 53922 primary records. [2025-09-28T03:01:14.309922] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-28T03:01:14.327840] [DEBUG] [LOCAL ] CCI: Derivative data saved (1820 records). [2025-09-28T03:01:14.327983] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-28T03:01:14.330246] [INFO ] [MAIN ] Derivative Progress: 387/2211 symbols completed. CCI took 1.2s. Estimated remaining: 12m 19s. Rate: 148.1 symbols/min [2025-09-28T03:01:14.330455] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:14.393353] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-09-28T03:01:14.393742] [INFO ] [MAIN ] CCJ: Loaded 54453 primary data records. [2025-09-28T03:01:14.536123] [DEBUG] [LOCAL ] CCK: Loaded 47083 existing records from primary storage. [2025-09-28T03:01:14.540950] [INFO ] [MAIN ] CCK: Loaded 47083 primary data records. [2025-09-28T03:01:14.715018] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-28T03:01:14.861531] [INFO ] [MAIN ] CCL: Loaded 54580 primary data records. [2025-09-28T03:01:15.475638] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:15.477000] [INFO ] [MAIN ] CCJ: Generated 1820 derivative records from 54453 primary records. [2025-09-28T03:01:15.477269] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-28T03:01:15.503904] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:15.506911] [INFO ] [MAIN ] CCK: Generated 1820 derivative records from 47083 primary records. [2025-09-28T03:01:15.507027] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-28T03:01:15.509762] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1820 records). [2025-09-28T03:01:15.510801] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-28T03:01:15.514170] [INFO ] [MAIN ] Derivative Progress: 388/2211 symbols completed. CCJ took 1.2s. Estimated remaining: 12m 22s. Rate: 147.4 symbols/min [2025-09-28T03:01:15.532739] [DEBUG] [LOCAL ] CCK: Derivative data saved (1820 records). [2025-09-28T03:01:15.533012] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-28T03:01:15.535491] [INFO ] [MAIN ] Derivative Progress: 389/2211 symbols completed. CCK took 1.2s. Estimated remaining: 12m 20s. Rate: 147.8 symbols/min [2025-09-28T03:01:15.549064] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:15.549836] [INFO ] [MAIN ] CCL: Generated 1820 derivative records from 54580 primary records. [2025-09-28T03:01:15.549925] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-28T03:01:15.566306] [DEBUG] [LOCAL ] CCL: Derivative data saved (1820 records). [2025-09-28T03:01:15.566425] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-28T03:01:15.568834] [INFO ] [MAIN ] Derivative Progress: 390/2211 symbols completed. CCL took 1.2s. Estimated remaining: 12m 18s. Rate: 148.1 symbols/min [2025-09-28T03:01:15.569359] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:15.569529] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:15.569839] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:15.585297] [DEBUG] [LOCAL ] CCRD: Loaded 9100 existing records from primary storage. [2025-09-28T03:01:15.585610] [INFO ] [MAIN ] CCRD: Loaded 9100 primary data records. [2025-09-28T03:01:15.747012] [DEBUG] [LOCAL ] CCS: Loaded 31155 existing records from primary storage. [2025-09-28T03:01:15.775853] [INFO ] [MAIN ] CCS: Loaded 31155 primary data records. [2025-09-28T03:01:16.058175] [DEBUG] [LOCAL ] CCO: Loaded 48387 existing records from primary storage. [2025-09-28T03:01:16.063711] [INFO ] [MAIN ] CCO: Loaded 48387 primary data records. [2025-09-28T03:01:16.611719] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:16.613164] [INFO ] [MAIN ] CCRD: Generated 1820 derivative records from 9100 primary records. [2025-09-28T03:01:16.613450] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-28T03:01:16.633181] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1820 records). [2025-09-28T03:01:16.633682] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-28T03:01:16.636419] [INFO ] [MAIN ] Derivative Progress: 391/2211 symbols completed. CCRD took 1.1s. Estimated remaining: 12m 20s. Rate: 147.5 symbols/min [2025-09-28T03:01:16.636899] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:16.663318] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:16.677731] [INFO ] [MAIN ] CCS: Generated 1820 derivative records from 31155 primary records. [2025-09-28T03:01:16.678506] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-28T03:01:16.678049] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:16.679757] [INFO ] [MAIN ] CCO: Generated 1820 derivative records from 48387 primary records. [2025-09-28T03:01:16.680707] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-28T03:01:16.711248] [DEBUG] [LOCAL ] CCS: Derivative data saved (1820 records). [2025-09-28T03:01:16.714858] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-28T03:01:16.724779] [INFO ] [MAIN ] Derivative Progress: 392/2211 symbols completed. CCS took 1.2s. Estimated remaining: 12m 18s. Rate: 147.8 symbols/min [2025-09-28T03:01:16.729454] [DEBUG] [LOCAL ] CCO: Derivative data saved (1820 records). [2025-09-28T03:01:16.729709] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:16.730584] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-28T03:01:16.730275] [DEBUG] [LOCAL ] CCU: Loaded 23800 existing records from primary storage. [2025-09-28T03:01:16.731183] [INFO ] [MAIN ] CCU: Loaded 23800 primary data records. [2025-09-28T03:01:16.734312] [INFO ] [MAIN ] Derivative Progress: 393/2211 symbols completed. CCO took 1.2s. Estimated remaining: 12m 16s. Rate: 148.2 symbols/min [2025-09-28T03:01:16.739622] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:16.896929] [DEBUG] [LOCAL ] CDLR: Loaded 9966 existing records from primary storage. [2025-09-28T03:01:16.914793] [INFO ] [MAIN ] CDLR: Loaded 9966 primary data records. [2025-09-28T03:01:17.208864] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-28T03:01:17.209440] [INFO ] [MAIN ] CDE: Loaded 54421 primary data records. [2025-09-28T03:01:17.791016] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:17.792571] [INFO ] [MAIN ] CCU: Generated 1820 derivative records from 23800 primary records. [2025-09-28T03:01:17.793502] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-28T03:01:17.814862] [DEBUG] [LOCAL ] CCU: Derivative data saved (1820 records). [2025-09-28T03:01:17.815294] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-28T03:01:17.818119] [INFO ] [MAIN ] Derivative Progress: 394/2211 symbols completed. CCU took 1.2s. Estimated remaining: 12m 19s. Rate: 147.5 symbols/min [2025-09-28T03:01:17.818451] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:17.838804] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:17.839993] [INFO ] [MAIN ] CDLR: Generated 1820 derivative records from 9966 primary records. [2025-09-28T03:01:17.840559] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-28T03:01:17.862208] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1820 records). [2025-09-28T03:01:17.862783] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-28T03:01:17.865265] [INFO ] [MAIN ] Derivative Progress: 395/2211 symbols completed. CDLR took 1.1s. Estimated remaining: 12m 17s. Rate: 147.9 symbols/min [2025-09-28T03:01:17.865712] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:17.879877] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:17.880833] [INFO ] [MAIN ] CDE: Generated 1820 derivative records from 54421 primary records. [2025-09-28T03:01:17.881058] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-28T03:01:17.908186] [DEBUG] [LOCAL ] CDE: Derivative data saved (1820 records). [2025-09-28T03:01:17.908466] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-28T03:01:17.911025] [INFO ] [MAIN ] Derivative Progress: 396/2211 symbols completed. CDE took 1.2s. Estimated remaining: 12m 15s. Rate: 148.2 symbols/min [2025-09-28T03:01:17.912756] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:17.929363] [DEBUG] [LOCAL ] CDP: Loaded 43357 existing records from primary storage. [2025-09-28T03:01:17.936419] [INFO ] [MAIN ] CDP: Loaded 43357 primary data records. [2025-09-28T03:01:18.048325] [DEBUG] [LOCAL ] CDRE: Loaded 25747 existing records from primary storage. [2025-09-28T03:01:18.062250] [INFO ] [MAIN ] CDRE: Loaded 25747 primary data records. [2025-09-28T03:01:18.476221] [DEBUG] [LOCAL ] CE: Loaded 52316 existing records from primary storage. [2025-09-28T03:01:18.612370] [INFO ] [MAIN ] CE: Loaded 52316 primary data records. [2025-09-28T03:01:18.967328] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:18.968862] [INFO ] [MAIN ] CDP: Generated 1820 derivative records from 43357 primary records. [2025-09-28T03:01:18.969989] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-28T03:01:18.991625] [DEBUG] [LOCAL ] CDP: Derivative data saved (1820 records). [2025-09-28T03:01:19.005288] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-28T03:01:19.006216] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:19.007208] [INFO ] [MAIN ] CDRE: Generated 1820 derivative records from 25747 primary records. [2025-09-28T03:01:19.011096] [INFO ] [MAIN ] Derivative Progress: 397/2211 symbols completed. CDP took 1.2s. Estimated remaining: 12m 18s. Rate: 147.6 symbols/min [2025-09-28T03:01:19.011439] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-28T03:01:19.011544] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:19.035201] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1820 records). [2025-09-28T03:01:19.035977] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-28T03:01:19.039004] [INFO ] [MAIN ] Derivative Progress: 398/2211 symbols completed. CDRE took 1.2s. Estimated remaining: 12m 15s. Rate: 147.9 symbols/min [2025-09-28T03:01:19.039441] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:19.044531] [DEBUG] [LOCAL ] CEE: Loaded 6697 existing records from primary storage. [2025-09-28T03:01:19.044891] [INFO ] [MAIN ] CEE: Loaded 6697 primary data records. [2025-09-28T03:01:19.197062] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:19.271049] [INFO ] [MAIN ] CE: Generated 1820 derivative records from 52316 primary records. [2025-09-28T03:01:19.271438] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-28T03:01:19.272817] [DEBUG] [LOCAL ] CEPU: Loaded 26454 existing records from primary storage. [2025-09-28T03:01:19.434068] [INFO ] [MAIN ] CEPU: Loaded 26454 primary data records. [2025-09-28T03:01:19.503316] [DEBUG] [LOCAL ] CE: Derivative data saved (1820 records). [2025-09-28T03:01:19.550291] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-28T03:01:19.570749] [INFO ] [MAIN ] Derivative Progress: 399/2211 symbols completed. CE took 1.7s. Estimated remaining: 12m 16s. Rate: 147.8 symbols/min [2025-09-28T03:01:19.577505] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:19.805951] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:19.807550] [INFO ] [MAIN ] CEE: Generated 1820 derivative records from 6697 primary records. [2025-09-28T03:01:19.808328] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-28T03:01:19.842725] [DEBUG] [LOCAL ] CEE: Derivative data saved (1820 records). [2025-09-28T03:01:19.843429] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-28T03:01:19.846614] [INFO ] [MAIN ] Derivative Progress: 400/2211 symbols completed. CEE took 0.8s. Estimated remaining: 12m 15s. Rate: 147.9 symbols/min [2025-09-28T03:01:19.847801] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:19.891778] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:19.893346] [INFO ] [MAIN ] CEPU: Generated 1820 derivative records from 26454 primary records. [2025-09-28T03:01:19.895265] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-28T03:01:19.895107] [DEBUG] [LOCAL ] CF: Loaded 52983 existing records from primary storage. [2025-09-28T03:01:19.896506] [INFO ] [MAIN ] CF: Loaded 52983 primary data records. [2025-09-28T03:01:19.977930] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1820 records). [2025-09-28T03:01:20.006976] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-28T03:01:20.035111] [INFO ] [MAIN ] Derivative Progress: 401/2211 symbols completed. CEPU took 1.0s. Estimated remaining: 12m 13s. Rate: 148.1 symbols/min [2025-09-28T03:01:20.049756] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:20.277390] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-28T03:01:20.277760] [INFO ] [MAIN ] CFG: Loaded 54404 primary data records. [2025-09-28T03:01:20.501235] [DEBUG] [LOCAL ] CFR: Loaded 33971 existing records from primary storage. [2025-09-28T03:01:20.628823] [INFO ] [MAIN ] CFR: Loaded 33971 primary data records. [2025-09-28T03:01:20.971885] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:20.973360] [INFO ] [MAIN ] CF: Generated 1820 derivative records from 52983 primary records. [2025-09-28T03:01:20.973684] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-28T03:01:21.009896] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:21.010490] [DEBUG] [LOCAL ] CF: Derivative data saved (1820 records). [2025-09-28T03:01:21.011433] [INFO ] [MAIN ] CFG: Generated 1820 derivative records from 54404 primary records. [2025-09-28T03:01:21.011835] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-28T03:01:21.012078] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-28T03:01:21.014974] [INFO ] [MAIN ] Derivative Progress: 402/2211 symbols completed. CF took 1.4s. Estimated remaining: 12m 15s. Rate: 147.6 symbols/min [2025-09-28T03:01:21.016199] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:21.035875] [DEBUG] [LOCAL ] CFG: Derivative data saved (1820 records). [2025-09-28T03:01:21.036469] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-28T03:01:21.039064] [INFO ] [MAIN ] Derivative Progress: 403/2211 symbols completed. CFG took 1.2s. Estimated remaining: 12m 13s. Rate: 147.9 symbols/min [2025-09-28T03:01:21.058271] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:21.059144] [INFO ] [MAIN ] CFR: Generated 1820 derivative records from 33971 primary records. [2025-09-28T03:01:21.059290] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-28T03:01:21.076488] [DEBUG] [LOCAL ] CFR: Derivative data saved (1820 records). [2025-09-28T03:01:21.076732] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-28T03:01:21.079638] [INFO ] [MAIN ] Derivative Progress: 404/2211 symbols completed. CFR took 1.0s. Estimated remaining: 12m 11s. Rate: 148.3 symbols/min [2025-09-28T03:01:21.113162] [DEBUG] [LOCAL ] CGAU: Loaded 43406 existing records from primary storage. [2025-09-28T03:01:21.113374] [INFO ] [MAIN ] CGAU: Loaded 43406 primary data records. [2025-09-28T03:01:21.466244] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:21.467040] [INFO ] [MAIN ] CGAU: Generated 1820 derivative records from 43406 primary records. [2025-09-28T03:01:21.467133] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-28T03:01:21.482184] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1820 records). [2025-09-28T03:01:21.482293] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-28T03:01:21.484673] [INFO ] [MAIN ] Derivative Progress: 405/2211 symbols completed. CGAU took 0.5s. Estimated remaining: 12m 11s. Rate: 148.3 symbols/min [2025-09-28T03:01:21.485209] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:21.485336] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:21.485430] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:21.490721] [DEBUG] [LOCAL ] CGV: Loaded 1431 existing records from primary storage. [2025-09-28T03:01:21.490925] [INFO ] [MAIN ] CGV: Loaded 1431 primary data records. [2025-09-28T03:01:21.716859] [DEBUG] [LOCAL ] CHCT: Loaded 24309 existing records from primary storage. [2025-09-28T03:01:21.804292] [INFO ] [MAIN ] CHCT: Loaded 24309 primary data records. [2025-09-28T03:01:21.924099] [DEBUG] [LOCAL ] CHD: Loaded 52767 existing records from primary storage. [2025-09-28T03:01:21.945943] [INFO ] [MAIN ] CHD: Loaded 52767 primary data records. [2025-09-28T03:01:22.551627] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-28T03:01:22.552835] [INFO ] [MAIN ] CGV: Generated 1819 derivative records from 1431 primary records. [2025-09-28T03:01:22.553981] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-28T03:01:22.571891] [DEBUG] [LOCAL ] CGV: Derivative data saved (1819 records). [2025-09-28T03:01:22.572926] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-28T03:01:22.575638] [INFO ] [MAIN ] Derivative Progress: 406/2211 symbols completed. CGV took 1.1s. Estimated remaining: 12m 13s. Rate: 147.7 symbols/min [2025-09-28T03:01:22.576314] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:22.600983] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:22.606604] [INFO ] [MAIN ] CHCT: Generated 1820 derivative records from 24309 primary records. [2025-09-28T03:01:22.606917] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-28T03:01:22.628082] [DEBUG] [LOCAL ] CHE: Loaded 14983 existing records from primary storage. [2025-09-28T03:01:22.629597] [INFO ] [MAIN ] CHE: Loaded 14983 primary data records. [2025-09-28T03:01:22.714296] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:22.728250] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1820 records). [2025-09-28T03:01:22.729050] [INFO ] [MAIN ] CHD: Generated 1820 derivative records from 52767 primary records. [2025-09-28T03:01:22.745685] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-28T03:01:22.739438] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-28T03:01:22.756399] [INFO ] [MAIN ] Derivative Progress: 407/2211 symbols completed. CHCT took 1.3s. Estimated remaining: 12m 12s. Rate: 147.9 symbols/min [2025-09-28T03:01:22.756999] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:22.800838] [DEBUG] [LOCAL ] CHD: Derivative data saved (1820 records). [2025-09-28T03:01:22.862472] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-28T03:01:22.990125] [INFO ] [MAIN ] Derivative Progress: 408/2211 symbols completed. CHD took 1.5s. Estimated remaining: 12m 11s. Rate: 148.0 symbols/min [2025-09-28T03:01:22.990494] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:23.054107] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:23.055455] [DEBUG] [LOCAL ] CHGG: Loaded 48434 existing records from primary storage. [2025-09-28T03:01:23.056422] [INFO ] [MAIN ] CHGG: Loaded 48434 primary data records. [2025-09-28T03:01:23.062700] [INFO ] [MAIN ] CHE: Generated 1820 derivative records from 14983 primary records. [2025-09-28T03:01:23.108745] [DEBUG] [LOCAL ] CHH: Loaded 32744 existing records from primary storage. [2025-09-28T03:01:23.122340] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-28T03:01:23.172557] [INFO ] [MAIN ] CHH: Loaded 32744 primary data records. [2025-09-28T03:01:23.252735] [DEBUG] [LOCAL ] CHE: Derivative data saved (1820 records). [2025-09-28T03:01:23.291581] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-28T03:01:23.316909] [INFO ] [MAIN ] Derivative Progress: 409/2211 symbols completed. CHE took 0.7s. Estimated remaining: 12m 10s. Rate: 148.1 symbols/min [2025-09-28T03:01:23.364742] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:23.784435] [DEBUG] [LOCAL ] CHMI: Loaded 22359 existing records from primary storage. [2025-09-28T03:01:23.784717] [INFO ] [MAIN ] CHMI: Loaded 22359 primary data records. [2025-09-28T03:01:24.134322] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:24.135951] [INFO ] [MAIN ] CHGG: Generated 1820 derivative records from 48434 primary records. [2025-09-28T03:01:24.136075] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-28T03:01:24.169235] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:24.172573] [INFO ] [MAIN ] CHH: Generated 1820 derivative records from 32744 primary records. [2025-09-28T03:01:24.171824] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1820 records). [2025-09-28T03:01:24.172996] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-28T03:01:24.175848] [INFO ] [MAIN ] Derivative Progress: 410/2211 symbols completed. CHGG took 1.4s. Estimated remaining: 12m 12s. Rate: 147.7 symbols/min [2025-09-28T03:01:24.172954] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-28T03:01:24.176264] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:24.201126] [DEBUG] [LOCAL ] CHN: Loaded 4900 existing records from primary storage. [2025-09-28T03:01:24.197505] [DEBUG] [LOCAL ] CHH: Derivative data saved (1820 records). [2025-09-28T03:01:24.201316] [INFO ] [MAIN ] CHN: Loaded 4900 primary data records. [2025-09-28T03:01:24.202242] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-28T03:01:24.227508] [INFO ] [MAIN ] Derivative Progress: 411/2211 symbols completed. CHH took 1.2s. Estimated remaining: 12m 10s. Rate: 148.0 symbols/min [2025-09-28T03:01:24.283487] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:24.307207] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:24.328866] [INFO ] [MAIN ] CHMI: Generated 1820 derivative records from 22359 primary records. [2025-09-28T03:01:24.333931] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-28T03:01:24.565504] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1820 records). [2025-09-28T03:01:24.567615] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-28T03:01:24.570148] [INFO ] [MAIN ] Derivative Progress: 412/2211 symbols completed. CHMI took 1.2s. Estimated remaining: 12m 9s. Rate: 148.0 symbols/min [2025-09-28T03:01:24.570412] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:24.609676] [DEBUG] [LOCAL ] CHT: Loaded 19816 existing records from primary storage. [2025-09-28T03:01:24.611288] [INFO ] [MAIN ] CHT: Loaded 19816 primary data records. [2025-09-28T03:01:24.691472] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:24.716462] [DEBUG] [LOCAL ] CHPT: Loaded 49765 existing records from primary storage. [2025-09-28T03:01:24.715131] [INFO ] [MAIN ] CHN: Generated 1820 derivative records from 4900 primary records. [2025-09-28T03:01:24.759445] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-28T03:01:24.755342] [INFO ] [MAIN ] CHPT: Loaded 49765 primary data records. [2025-09-28T03:01:25.117672] [DEBUG] [LOCAL ] CHN: Derivative data saved (1820 records). [2025-09-28T03:01:25.153714] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-28T03:01:25.194211] [INFO ] [MAIN ] Derivative Progress: 413/2211 symbols completed. CHN took 1.0s. Estimated remaining: 12m 10s. Rate: 147.9 symbols/min [2025-09-28T03:01:25.307213] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:25.350828] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:25.351886] [INFO ] [MAIN ] CHT: Generated 1820 derivative records from 19816 primary records. [2025-09-28T03:01:25.352090] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-28T03:01:25.386155] [DEBUG] [LOCAL ] CHT: Derivative data saved (1820 records). [2025-09-28T03:01:25.386536] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-28T03:01:25.389362] [INFO ] [MAIN ] Derivative Progress: 414/2211 symbols completed. CHT took 0.8s. Estimated remaining: 12m 8s. Rate: 148.0 symbols/min [2025-09-28T03:01:25.389883] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:25.406901] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:25.409623] [INFO ] [MAIN ] CHPT: Generated 1820 derivative records from 49765 primary records. [2025-09-28T03:01:25.409735] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-28T03:01:25.442722] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1820 records). [2025-09-28T03:01:25.444596] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-28T03:01:25.448751] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-09-28T03:01:25.447160] [INFO ] [MAIN ] Derivative Progress: 415/2211 symbols completed. CHPT took 1.2s. Estimated remaining: 12m 6s. Rate: 148.3 symbols/min [2025-09-28T03:01:25.449207] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:25.449282] [INFO ] [MAIN ] CHWY: Loaded 54434 primary data records. [2025-09-28T03:01:25.595194] [DEBUG] [LOCAL ] CIA: Loaded 17213 existing records from primary storage. [2025-09-28T03:01:25.606663] [INFO ] [MAIN ] CIA: Loaded 17213 primary data records. [2025-09-28T03:01:25.758710] [DEBUG] [LOCAL ] CI: Loaded 50561 existing records from primary storage. [2025-09-28T03:01:25.936848] [INFO ] [MAIN ] CI: Loaded 50561 primary data records. [2025-09-28T03:01:26.540958] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:26.542444] [INFO ] [MAIN ] CHWY: Generated 1820 derivative records from 54434 primary records. [2025-09-28T03:01:26.542602] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-28T03:01:26.565441] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1820 records). [2025-09-28T03:01:26.579433] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:26.579754] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-28T03:01:26.580614] [INFO ] [MAIN ] CIA: Generated 1820 derivative records from 17213 primary records. [2025-09-28T03:01:26.583355] [INFO ] [MAIN ] Derivative Progress: 416/2211 symbols completed. CHWY took 1.3s. Estimated remaining: 12m 9s. Rate: 147.7 symbols/min [2025-09-28T03:01:26.584288] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-28T03:01:26.583903] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:26.616396] [DEBUG] [LOCAL ] CIA: Derivative data saved (1820 records). [2025-09-28T03:01:26.622675] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:26.622917] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-28T03:01:26.627949] [INFO ] [MAIN ] Derivative Progress: 417/2211 symbols completed. CIA took 1.2s. Estimated remaining: 12m 7s. Rate: 148.0 symbols/min [2025-09-28T03:01:26.628244] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:26.624275] [INFO ] [MAIN ] CI: Generated 1820 derivative records from 50561 primary records. [2025-09-28T03:01:26.629000] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-28T03:01:26.660620] [DEBUG] [LOCAL ] CI: Derivative data saved (1820 records). [2025-09-28T03:01:26.661006] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-28T03:01:26.664376] [INFO ] [MAIN ] Derivative Progress: 418/2211 symbols completed. CI took 1.3s. Estimated remaining: 12m 5s. Rate: 148.3 symbols/min [2025-09-28T03:01:26.678414] [DEBUG] [LOCAL ] CIB: Loaded 31435 existing records from primary storage. [2025-09-28T03:01:26.678626] [INFO ] [MAIN ] CIB: Loaded 31435 primary data records. [2025-09-28T03:01:26.924543] [DEBUG] [LOCAL ] CIEN: Loaded 52854 existing records from primary storage. [2025-09-28T03:01:27.025678] [INFO ] [MAIN ] CIEN: Loaded 52854 primary data records. [2025-09-28T03:01:27.393516] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:27.394777] [INFO ] [MAIN ] CIB: Generated 1820 derivative records from 31435 primary records. [2025-09-28T03:01:27.395236] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-28T03:01:27.412911] [DEBUG] [LOCAL ] CIB: Derivative data saved (1820 records). [2025-09-28T03:01:27.413067] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-28T03:01:27.415726] [INFO ] [MAIN ] Derivative Progress: 419/2211 symbols completed. CIB took 0.8s. Estimated remaining: 12m 6s. Rate: 148.0 symbols/min [2025-09-28T03:01:27.433577] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:27.434314] [INFO ] [MAIN ] CIEN: Generated 1820 derivative records from 52854 primary records. [2025-09-28T03:01:27.434403] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-28T03:01:27.450687] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1820 records). [2025-09-28T03:01:27.450799] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-28T03:01:27.453156] [INFO ] [MAIN ] Derivative Progress: 420/2211 symbols completed. CIEN took 0.8s. Estimated remaining: 12m 4s. Rate: 148.4 symbols/min [2025-09-28T03:01:27.453615] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:27.453734] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:27.453690] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:27.463085] [DEBUG] [LOCAL ] CIF: Loaded 4396 existing records from primary storage. [2025-09-28T03:01:27.463269] [INFO ] [MAIN ] CIF: Loaded 4396 primary data records. [2025-09-28T03:01:27.583308] [DEBUG] [LOCAL ] CII: Loaded 15638 existing records from primary storage. [2025-09-28T03:01:27.594163] [INFO ] [MAIN ] CII: Loaded 15638 primary data records. [2025-09-28T03:01:27.969446] [DEBUG] [LOCAL ] CIG: Loaded 44447 existing records from primary storage. [2025-09-28T03:01:27.980011] [INFO ] [MAIN ] CIG: Loaded 44447 primary data records. [2025-09-28T03:01:28.527998] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:28.529738] [INFO ] [MAIN ] CIF: Generated 1820 derivative records from 4396 primary records. [2025-09-28T03:01:28.529889] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-28T03:01:28.549483] [DEBUG] [LOCAL ] CIF: Derivative data saved (1820 records). [2025-09-28T03:01:28.549934] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-28T03:01:28.552722] [INFO ] [MAIN ] Derivative Progress: 421/2211 symbols completed. CIF took 1.1s. Estimated remaining: 12m 7s. Rate: 147.8 symbols/min [2025-09-28T03:01:28.553151] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:28.567957] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:28.569395] [INFO ] [MAIN ] CII: Generated 1820 derivative records from 15638 primary records. [2025-09-28T03:01:28.569717] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-28T03:01:28.591059] [DEBUG] [LOCAL ] CII: Derivative data saved (1820 records). [2025-09-28T03:01:28.591401] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-28T03:01:28.593806] [INFO ] [MAIN ] Derivative Progress: 422/2211 symbols completed. CII took 1.1s. Estimated remaining: 12m 5s. Rate: 148.1 symbols/min [2025-09-28T03:01:28.606997] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:28.608029] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:28.609419] [INFO ] [MAIN ] CIG: Generated 1820 derivative records from 44447 primary records. [2025-09-28T03:01:28.610227] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-28T03:01:28.635090] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-09-28T03:01:28.639692] [INFO ] [MAIN ] CIMN: Loaded 2697 primary data records. [2025-09-28T03:01:28.651418] [DEBUG] [LOCAL ] CIG: Derivative data saved (1820 records). [2025-09-28T03:01:28.677493] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-28T03:01:28.723144] [INFO ] [MAIN ] Derivative Progress: 423/2211 symbols completed. CIG took 1.3s. Estimated remaining: 12m 3s. Rate: 148.3 symbols/min [2025-09-28T03:01:28.764119] [DEBUG] [LOCAL ] CIM: Loaded 37858 existing records from primary storage. [2025-09-28T03:01:28.762843] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:28.779988] [INFO ] [MAIN ] CIM: Loaded 37858 primary data records. [2025-09-28T03:01:29.098160] [DEBUG] [LOCAL ] CINT: Loaded 18868 existing records from primary storage. [2025-09-28T03:01:29.131480] [INFO ] [MAIN ] CINT: Loaded 18868 primary data records. [2025-09-28T03:01:29.727825] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:29.729678] [INFO ] [MAIN ] CIMN: Generated 1820 derivative records from 2697 primary records. [2025-09-28T03:01:29.729934] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-28T03:01:29.750483] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1820 records). [2025-09-28T03:01:29.751105] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-28T03:01:29.754019] [INFO ] [MAIN ] Derivative Progress: 424/2211 symbols completed. CIMN took 1.1s. Estimated remaining: 12m 6s. Rate: 147.8 symbols/min [2025-09-28T03:01:29.768175] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:29.767797] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:29.769708] [INFO ] [MAIN ] CIM: Generated 1820 derivative records from 37858 primary records. [2025-09-28T03:01:29.770604] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-28T03:01:29.794882] [DEBUG] [LOCAL ] CIM: Derivative data saved (1820 records). [2025-09-28T03:01:29.795122] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-28T03:01:29.797781] [INFO ] [MAIN ] Derivative Progress: 425/2211 symbols completed. CIM took 1.2s. Estimated remaining: 12m 4s. Rate: 148.1 symbols/min [2025-09-28T03:01:29.798246] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:29.807689] [DEBUG] [LOCAL ] CIO: Loaded 20406 existing records from primary storage. [2025-09-28T03:01:29.809047] [INFO ] [MAIN ] CIO: Loaded 20406 primary data records. [2025-09-28T03:01:29.930206] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:29.943191] [INFO ] [MAIN ] CINT: Generated 1820 derivative records from 18868 primary records. [2025-09-28T03:01:29.955392] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-28T03:01:30.017354] [DEBUG] [LOCAL ] CION: Loaded 29661 existing records from primary storage. [2025-09-28T03:01:30.049314] [INFO ] [MAIN ] CION: Loaded 29661 primary data records. [2025-09-28T03:01:30.131006] [DEBUG] [LOCAL ] CINT: Derivative data saved (1820 records). [2025-09-28T03:01:30.196444] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-28T03:01:30.232519] [INFO ] [MAIN ] Derivative Progress: 426/2211 symbols completed. CINT took 1.5s. Estimated remaining: 12m 3s. Rate: 148.1 symbols/min [2025-09-28T03:01:30.268127] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:30.559261] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:30.560399] [INFO ] [MAIN ] CIO: Generated 1820 derivative records from 20406 primary records. [2025-09-28T03:01:30.560605] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-28T03:01:30.604344] [DEBUG] [LOCAL ] CIO: Derivative data saved (1820 records). [2025-09-28T03:01:30.604748] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-28T03:01:30.607681] [INFO ] [MAIN ] Derivative Progress: 427/2211 symbols completed. CIO took 0.8s. Estimated remaining: 12m 3s. Rate: 148.1 symbols/min [2025-09-28T03:01:30.609684] [DEBUG] [LOCAL ] CIVI: Loaded 53363 existing records from primary storage. [2025-09-28T03:01:30.609986] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:30.610075] [INFO ] [MAIN ] CIVI: Loaded 53363 primary data records. [2025-09-28T03:01:30.706144] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:30.730277] [INFO ] [MAIN ] CION: Generated 1820 derivative records from 29661 primary records. [2025-09-28T03:01:30.748276] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-28T03:01:30.859959] [DEBUG] [LOCAL ] CION: Derivative data saved (1820 records). [2025-09-28T03:01:30.986748] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-28T03:01:30.989818] [INFO ] [MAIN ] Derivative Progress: 428/2211 symbols completed. CION took 1.2s. Estimated remaining: 12m 2s. Rate: 148.1 symbols/min [2025-09-28T03:01:31.005854] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:31.043539] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-28T03:01:31.044001] [INFO ] [MAIN ] CL: Loaded 54424 primary data records. [2025-09-28T03:01:31.220511] [DEBUG] [LOCAL ] CLB: Loaded 33475 existing records from primary storage. [2025-09-28T03:01:31.264279] [INFO ] [MAIN ] CLB: Loaded 33475 primary data records. [2025-09-28T03:01:31.525890] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:31.543710] [INFO ] [MAIN ] CIVI: Generated 1820 derivative records from 53363 primary records. [2025-09-28T03:01:31.549272] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-28T03:01:31.811225] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1820 records). [2025-09-28T03:01:31.812670] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-28T03:01:31.815971] [INFO ] [MAIN ] Derivative Progress: 429/2211 symbols completed. CIVI took 1.5s. Estimated remaining: 12m 4s. Rate: 147.7 symbols/min [2025-09-28T03:01:31.820410] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:31.838140] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:31.838988] [INFO ] [MAIN ] CL: Generated 1820 derivative records from 54424 primary records. [2025-09-28T03:01:31.839320] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-28T03:01:31.860281] [DEBUG] [LOCAL ] CL: Derivative data saved (1820 records). [2025-09-28T03:01:31.869170] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-09-28T03:01:31.868693] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-28T03:01:31.871793] [INFO ] [MAIN ] Derivative Progress: 430/2211 symbols completed. CL took 1.3s. Estimated remaining: 12m 2s. Rate: 148.0 symbols/min [2025-09-28T03:01:31.872161] [INFO ] [MAIN ] CLCO: Loaded 13189 primary data records. [2025-09-28T03:01:31.885131] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:31.885756] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:31.887041] [INFO ] [MAIN ] CLB: Generated 1820 derivative records from 33475 primary records. [2025-09-28T03:01:31.887162] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-28T03:01:31.980984] [DEBUG] [LOCAL ] CLB: Derivative data saved (1820 records). [2025-09-28T03:01:32.019316] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-28T03:01:32.045324] [DEBUG] [LOCAL ] CLDT: Loaded 26082 existing records from primary storage. [2025-09-28T03:01:32.044478] [INFO ] [MAIN ] Derivative Progress: 431/2211 symbols completed. CLB took 1.0s. Estimated remaining: 12m 0s. Rate: 148.2 symbols/min [2025-09-28T03:01:32.050710] [INFO ] [MAIN ] CLDT: Loaded 26082 primary data records. [2025-09-28T03:01:32.050922] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:32.653325] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:32.652498] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-09-28T03:01:32.655028] [INFO ] [MAIN ] CLCO: Generated 1820 derivative records from 13189 primary records. [2025-09-28T03:01:32.655328] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-28T03:01:32.656570] [INFO ] [MAIN ] CLF: Loaded 54521 primary data records. [2025-09-28T03:01:32.732942] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1820 records). [2025-09-28T03:01:32.755707] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-28T03:01:32.817681] [INFO ] [MAIN ] Derivative Progress: 432/2211 symbols completed. CLCO took 1.0s. Estimated remaining: 12m 2s. Rate: 147.9 symbols/min [2025-09-28T03:01:32.835332] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:32.847162] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:32.872242] [INFO ] [MAIN ] CLDT: Generated 1820 derivative records from 26082 primary records. [2025-09-28T03:01:32.883180] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-28T03:01:32.972158] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1820 records). [2025-09-28T03:01:32.988502] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-28T03:01:33.015561] [INFO ] [MAIN ] Derivative Progress: 433/2211 symbols completed. CLDT took 1.1s. Estimated remaining: 12m 0s. Rate: 148.1 symbols/min [2025-09-28T03:01:33.254227] [DEBUG] [LOCAL ] CLH: Loaded 28493 existing records from primary storage. [2025-09-28T03:01:33.254803] [INFO ] [MAIN ] CLH: Loaded 28493 primary data records. [2025-09-28T03:01:33.665312] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:33.667112] [INFO ] [MAIN ] CLF: Generated 1820 derivative records from 54521 primary records. [2025-09-28T03:01:33.667240] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-28T03:01:33.687857] [DEBUG] [LOCAL ] CLF: Derivative data saved (1820 records). [2025-09-28T03:01:33.688240] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-28T03:01:33.691393] [INFO ] [MAIN ] Derivative Progress: 434/2211 symbols completed. CLF took 1.6s. Estimated remaining: 12m 1s. Rate: 147.9 symbols/min [2025-09-28T03:01:33.711026] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:33.711896] [INFO ] [MAIN ] CLH: Generated 1820 derivative records from 28493 primary records. [2025-09-28T03:01:33.711990] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-28T03:01:33.733427] [DEBUG] [LOCAL ] CLH: Derivative data saved (1820 records). [2025-09-28T03:01:33.733617] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-28T03:01:33.736393] [INFO ] [MAIN ] Derivative Progress: 435/2211 symbols completed. CLH took 0.9s. Estimated remaining: 11m 59s. Rate: 148.2 symbols/min [2025-09-28T03:01:33.737172] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:33.737299] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:33.737414] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:33.751742] [DEBUG] [LOCAL ] CLPR: Loaded 11615 existing records from primary storage. [2025-09-28T03:01:33.752009] [INFO ] [MAIN ] CLPR: Loaded 11615 primary data records. [2025-09-28T03:01:34.168075] [DEBUG] [LOCAL ] CLVT: Loaded 52713 existing records from primary storage. [2025-09-28T03:01:34.168595] [INFO ] [MAIN ] CLVT: Loaded 52713 primary data records. [2025-09-28T03:01:34.169501] [DEBUG] [LOCAL ] CLS: Loaded 54412 existing records from primary storage. [2025-09-28T03:01:34.176022] [INFO ] [MAIN ] CLS: Loaded 54412 primary data records. [2025-09-28T03:01:34.923904] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:34.925823] [INFO ] [MAIN ] CLPR: Generated 1820 derivative records from 11615 primary records. [2025-09-28T03:01:34.926984] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-28T03:01:34.950317] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1820 records). [2025-09-28T03:01:34.950509] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-28T03:01:34.953178] [INFO ] [MAIN ] Derivative Progress: 436/2211 symbols completed. CLPR took 1.2s. Estimated remaining: 12m 2s. Rate: 147.5 symbols/min [2025-09-28T03:01:34.953789] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:34.984292] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:34.999855] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:34.999434] [INFO ] [MAIN ] CLVT: Generated 1820 derivative records from 52713 primary records. [2025-09-28T03:01:35.001077] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-28T03:01:35.000954] [INFO ] [MAIN ] CLS: Generated 1820 derivative records from 54412 primary records. [2025-09-28T03:01:35.002814] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-28T03:01:35.020717] [DEBUG] [LOCAL ] CLW: Loaded 22226 existing records from primary storage. [2025-09-28T03:01:35.027955] [INFO ] [MAIN ] CLW: Loaded 22226 primary data records. [2025-09-28T03:01:35.057507] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1820 records). [2025-09-28T03:01:35.091592] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-28T03:01:35.104777] [INFO ] [MAIN ] Derivative Progress: 437/2211 symbols completed. CLVT took 1.4s. Estimated remaining: 12m 1s. Rate: 147.7 symbols/min [2025-09-28T03:01:35.134550] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:35.172923] [DEBUG] [LOCAL ] CLS: Derivative data saved (1820 records). [2025-09-28T03:01:35.173436] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-28T03:01:35.176317] [INFO ] [MAIN ] Derivative Progress: 438/2211 symbols completed. CLS took 1.4s. Estimated remaining: 11m 59s. Rate: 148.0 symbols/min [2025-09-28T03:01:35.182244] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:35.434776] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:35.435617] [INFO ] [MAIN ] CLW: Generated 1820 derivative records from 22226 primary records. [2025-09-28T03:01:35.445366] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-28T03:01:35.464170] [DEBUG] [LOCAL ] CLW: Derivative data saved (1820 records). [2025-09-28T03:01:35.479125] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-28T03:01:35.494781] [DEBUG] [LOCAL ] CM: Loaded 49317 existing records from primary storage. [2025-09-28T03:01:35.497761] [INFO ] [MAIN ] Derivative Progress: 439/2211 symbols completed. CLW took 0.5s. Estimated remaining: 11m 58s. Rate: 148.1 symbols/min [2025-09-28T03:01:35.498042] [INFO ] [MAIN ] CM: Loaded 49317 primary data records. [2025-09-28T03:01:35.498311] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:35.499792] [DEBUG] [LOCAL ] CLX: Loaded 52189 existing records from primary storage. [2025-09-28T03:01:35.513136] [INFO ] [MAIN ] CLX: Loaded 52189 primary data records. [2025-09-28T03:01:36.187027] [DEBUG] [LOCAL ] CMA: Loaded 50721 existing records from primary storage. [2025-09-28T03:01:36.187766] [INFO ] [MAIN ] CMA: Loaded 50721 primary data records. [2025-09-28T03:01:36.596512] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:36.598547] [INFO ] [MAIN ] CM: Generated 1820 derivative records from 49317 primary records. [2025-09-28T03:01:36.599167] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-28T03:01:36.628931] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:36.633038] [DEBUG] [LOCAL ] CM: Derivative data saved (1820 records). [2025-09-28T03:01:36.635608] [INFO ] [MAIN ] CLX: Generated 1820 derivative records from 52189 primary records. [2025-09-28T03:01:36.634254] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-28T03:01:36.635983] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-28T03:01:36.638502] [INFO ] [MAIN ] Derivative Progress: 440/2211 symbols completed. CM took 1.5s. Estimated remaining: 12m 1s. Rate: 147.5 symbols/min [2025-09-28T03:01:36.640631] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:36.668527] [DEBUG] [LOCAL ] CLX: Derivative data saved (1820 records). [2025-09-28T03:01:36.669459] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-28T03:01:36.672404] [INFO ] [MAIN ] Derivative Progress: 441/2211 symbols completed. CLX took 1.5s. Estimated remaining: 11m 59s. Rate: 147.8 symbols/min [2025-09-28T03:01:36.674254] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:36.695961] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:36.696874] [INFO ] [MAIN ] CMA: Generated 1820 derivative records from 50721 primary records. [2025-09-28T03:01:36.697031] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-28T03:01:36.719255] [DEBUG] [LOCAL ] CMBT: Loaded 22911 existing records from primary storage. [2025-09-28T03:01:36.720871] [INFO ] [MAIN ] CMBT: Loaded 22911 primary data records. [2025-09-28T03:01:36.824303] [DEBUG] [LOCAL ] CMA: Derivative data saved (1820 records). [2025-09-28T03:01:36.836052] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-28T03:01:36.838237] [INFO ] [MAIN ] Derivative Progress: 442/2211 symbols completed. CMA took 1.3s. Estimated remaining: 11m 57s. Rate: 148.0 symbols/min [2025-09-28T03:01:36.865748] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:37.076197] [DEBUG] [LOCAL ] CMCM: Loaded 4834 existing records from primary storage. [2025-09-28T03:01:37.076513] [INFO ] [MAIN ] CMCM: Loaded 4834 primary data records. [2025-09-28T03:01:37.102607] [DEBUG] [LOCAL ] CMC: Loaded 46311 existing records from primary storage. [2025-09-28T03:01:37.126359] [INFO ] [MAIN ] CMC: Loaded 46311 primary data records. [2025-09-28T03:01:37.759961] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:37.762111] [INFO ] [MAIN ] CMBT: Generated 1820 derivative records from 22911 primary records. [2025-09-28T03:01:37.762707] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-28T03:01:37.782805] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1820 records). [2025-09-28T03:01:37.783487] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-28T03:01:37.788106] [INFO ] [MAIN ] Derivative Progress: 443/2211 symbols completed. CMBT took 1.1s. Estimated remaining: 11m 59s. Rate: 147.5 symbols/min [2025-09-28T03:01:37.790184] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:37.807825] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:37.808704] [INFO ] [MAIN ] CMCM: Generated 1820 derivative records from 4834 primary records. [2025-09-28T03:01:37.809100] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-28T03:01:37.829380] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1820 records). [2025-09-28T03:01:37.831461] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-28T03:01:37.834419] [INFO ] [MAIN ] Derivative Progress: 444/2211 symbols completed. CMCM took 1.0s. Estimated remaining: 11m 57s. Rate: 147.8 symbols/min [2025-09-28T03:01:37.834970] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:37.851483] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:37.852622] [INFO ] [MAIN ] CMC: Generated 1820 derivative records from 46311 primary records. [2025-09-28T03:01:37.852932] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-28T03:01:37.873198] [DEBUG] [LOCAL ] CMC: Derivative data saved (1820 records). [2025-09-28T03:01:37.873421] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-28T03:01:37.876831] [INFO ] [MAIN ] Derivative Progress: 445/2211 symbols completed. CMC took 1.2s. Estimated remaining: 11m 55s. Rate: 148.1 symbols/min [2025-09-28T03:01:37.877148] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:37.942534] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-09-28T03:01:37.943870] [INFO ] [MAIN ] CMG: Loaded 54501 primary data records. [2025-09-28T03:01:38.034481] [DEBUG] [LOCAL ] CMI: Loaded 42484 existing records from primary storage. [2025-09-28T03:01:38.076608] [INFO ] [MAIN ] CMI: Loaded 42484 primary data records. [2025-09-28T03:01:38.133702] [DEBUG] [LOCAL ] CMP: Loaded 36848 existing records from primary storage. [2025-09-28T03:01:38.240156] [INFO ] [MAIN ] CMP: Loaded 36848 primary data records. [2025-09-28T03:01:39.060286] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:39.061179] [INFO ] [MAIN ] CMG: Generated 1820 derivative records from 54501 primary records. [2025-09-28T03:01:39.061610] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-28T03:01:39.082104] [DEBUG] [LOCAL ] CMG: Derivative data saved (1820 records). [2025-09-28T03:01:39.084260] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-28T03:01:39.088558] [INFO ] [MAIN ] Derivative Progress: 446/2211 symbols completed. CMG took 1.3s. Estimated remaining: 11m 58s. Rate: 147.4 symbols/min [2025-09-28T03:01:39.090551] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:39.104611] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-28T03:01:39.106251] [INFO ] [MAIN ] CMI: Generated 1819 derivative records from 42484 primary records. [2025-09-28T03:01:39.106543] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-28T03:01:39.124709] [DEBUG] [LOCAL ] CMI: Derivative data saved (1819 records). [2025-09-28T03:01:39.128124] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-28T03:01:39.130747] [INFO ] [MAIN ] Derivative Progress: 447/2211 symbols completed. CMI took 1.3s. Estimated remaining: 11m 56s. Rate: 147.7 symbols/min [2025-09-28T03:01:39.131209] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:39.146350] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:39.147735] [INFO ] [MAIN ] CMP: Generated 1820 derivative records from 36848 primary records. [2025-09-28T03:01:39.148018] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-28T03:01:39.174964] [DEBUG] [LOCAL ] CMP: Derivative data saved (1820 records). [2025-09-28T03:01:39.175223] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-28T03:01:39.179178] [INFO ] [MAIN ] Derivative Progress: 448/2211 symbols completed. CMP took 1.3s. Estimated remaining: 11m 55s. Rate: 148.0 symbols/min [2025-09-28T03:01:39.209738] [DEBUG] [LOCAL ] CMPO: Loaded 40071 existing records from primary storage. [2025-09-28T03:01:39.210054] [INFO ] [MAIN ] CMPO: Loaded 40071 primary data records. [2025-09-28T03:01:39.339117] [DEBUG] [LOCAL ] CMRE: Loaded 36068 existing records from primary storage. [2025-09-28T03:01:39.360382] [INFO ] [MAIN ] CMRE: Loaded 36068 primary data records. [2025-09-28T03:01:39.893916] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:39.894920] [INFO ] [MAIN ] CMPO: Generated 1820 derivative records from 40071 primary records. [2025-09-28T03:01:39.895123] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-09-28T03:01:39.913384] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1820 records). [2025-09-28T03:01:39.914674] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-09-28T03:01:39.917294] [INFO ] [MAIN ] Derivative Progress: 449/2211 symbols completed. CMPO took 0.8s. Estimated remaining: 11m 55s. Rate: 147.8 symbols/min [2025-09-28T03:01:39.932636] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:39.933341] [INFO ] [MAIN ] CMRE: Generated 1820 derivative records from 36068 primary records. [2025-09-28T03:01:39.933429] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-28T03:01:39.949803] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1820 records). [2025-09-28T03:01:39.949961] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-28T03:01:39.952264] [INFO ] [MAIN ] Derivative Progress: 450/2211 symbols completed. CMRE took 0.8s. Estimated remaining: 11m 54s. Rate: 148.1 symbols/min [2025-09-28T03:01:39.952854] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:39.952763] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:39.952919] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:39.962204] [DEBUG] [LOCAL ] CMSC: Loaded 5131 existing records from primary storage. [2025-09-28T03:01:39.965178] [DEBUG] [LOCAL ] CMSA: Loaded 3421 existing records from primary storage. [2025-09-28T03:01:39.965327] [INFO ] [MAIN ] CMSC: Loaded 5131 primary data records. [2025-09-28T03:01:39.977757] [INFO ] [MAIN ] CMSA: Loaded 3421 primary data records. [2025-09-28T03:01:40.526287] [DEBUG] [LOCAL ] CMS: Loaded 53371 existing records from primary storage. [2025-09-28T03:01:40.648461] [INFO ] [MAIN ] CMS: Loaded 53371 primary data records. [2025-09-28T03:01:41.009601] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:41.052390] [INFO ] [MAIN ] CMSC: Generated 1820 derivative records from 5131 primary records. [2025-09-28T03:01:41.053094] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-28T03:01:41.077148] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1820 records). [2025-09-28T03:01:41.078145] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-28T03:01:41.080544] [INFO ] [MAIN ] Derivative Progress: 451/2211 symbols completed. CMSC took 1.1s. Estimated remaining: 11m 56s. Rate: 147.5 symbols/min [2025-09-28T03:01:41.094805] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:41.095481] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:41.097250] [INFO ] [MAIN ] CMSA: Generated 1820 derivative records from 3421 primary records. [2025-09-28T03:01:41.101000] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-28T03:01:41.122439] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1820 records). [2025-09-28T03:01:41.127900] [DEBUG] [LOCAL ] CMSD: Loaded 8184 existing records from primary storage. [2025-09-28T03:01:41.128277] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-28T03:01:41.128593] [INFO ] [MAIN ] CMSD: Loaded 8184 primary data records. [2025-09-28T03:01:41.143206] [INFO ] [MAIN ] Derivative Progress: 452/2211 symbols completed. CMSA took 1.2s. Estimated remaining: 11m 54s. Rate: 147.8 symbols/min [2025-09-28T03:01:41.187213] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:41.278140] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:41.330311] [INFO ] [MAIN ] CMS: Generated 1820 derivative records from 53371 primary records. [2025-09-28T03:01:41.354877] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-28T03:01:41.511435] [DEBUG] [LOCAL ] CMS: Derivative data saved (1820 records). [2025-09-28T03:01:41.512797] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-28T03:01:41.521239] [INFO ] [MAIN ] Derivative Progress: 453/2211 symbols completed. CMS took 1.6s. Estimated remaining: 11m 54s. Rate: 147.8 symbols/min [2025-09-28T03:01:41.534569] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:41.536612] [DEBUG] [LOCAL ] CMTG: Loaded 37931 existing records from primary storage. [2025-09-28T03:01:41.537011] [INFO ] [MAIN ] CMTG: Loaded 37931 primary data records. [2025-09-28T03:01:41.646576] [DEBUG] [LOCAL ] CMU: Loaded 7303 existing records from primary storage. [2025-09-28T03:01:41.720896] [INFO ] [MAIN ] CMU: Loaded 7303 primary data records. [2025-09-28T03:01:41.942621] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:41.959710] [INFO ] [MAIN ] CMSD: Generated 1820 derivative records from 8184 primary records. [2025-09-28T03:01:41.972709] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-28T03:01:42.214605] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1820 records). [2025-09-28T03:01:42.224302] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-28T03:01:42.226629] [INFO ] [MAIN ] Derivative Progress: 454/2211 symbols completed. CMSD took 1.1s. Estimated remaining: 11m 55s. Rate: 147.5 symbols/min [2025-09-28T03:01:42.227617] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:42.251279] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:42.252608] [INFO ] [MAIN ] CMTG: Generated 1820 derivative records from 37931 primary records. [2025-09-28T03:01:42.252802] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-28T03:01:42.283586] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1820 records). [2025-09-28T03:01:42.284146] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-28T03:01:42.286568] [INFO ] [MAIN ] Derivative Progress: 455/2211 symbols completed. CMTG took 1.1s. Estimated remaining: 11m 53s. Rate: 147.8 symbols/min [2025-09-28T03:01:42.287248] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:42.320707] [DEBUG] [LOCAL ] CNA: Loaded 33235 existing records from primary storage. [2025-09-28T03:01:42.319563] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:42.321632] [INFO ] [MAIN ] CMU: Generated 1820 derivative records from 7303 primary records. [2025-09-28T03:01:42.321766] [INFO ] [MAIN ] CNA: Loaded 33235 primary data records. [2025-09-28T03:01:42.322124] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-28T03:01:42.433331] [DEBUG] [LOCAL ] CMU: Derivative data saved (1820 records). [2025-09-28T03:01:42.467679] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-28T03:01:42.471048] [INFO ] [MAIN ] Derivative Progress: 456/2211 symbols completed. CMU took 0.9s. Estimated remaining: 11m 52s. Rate: 148.0 symbols/min [2025-09-28T03:01:42.481887] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:42.694495] [DEBUG] [LOCAL ] CNC: Loaded 54518 existing records from primary storage. [2025-09-28T03:01:42.706446] [INFO ] [MAIN ] CNC: Loaded 54518 primary data records. [2025-09-28T03:01:42.742006] [DEBUG] [LOCAL ] CNF: Loaded 11166 existing records from primary storage. [2025-09-28T03:01:42.795127] [INFO ] [MAIN ] CNF: Loaded 11166 primary data records. [2025-09-28T03:01:43.453810] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:43.456424] [INFO ] [MAIN ] CNA: Generated 1820 derivative records from 33235 primary records. [2025-09-28T03:01:43.458134] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-28T03:01:43.477419] [DEBUG] [LOCAL ] CNA: Derivative data saved (1820 records). [2025-09-28T03:01:43.478006] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-28T03:01:43.480634] [INFO ] [MAIN ] Derivative Progress: 457/2211 symbols completed. CNA took 1.3s. Estimated remaining: 11m 53s. Rate: 147.5 symbols/min [2025-09-28T03:01:43.481054] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:43.500931] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:43.502525] [INFO ] [MAIN ] CNC: Generated 1820 derivative records from 54518 primary records. [2025-09-28T03:01:43.504540] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-28T03:01:43.533458] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-28T03:01:43.535539] [INFO ] [MAIN ] CNF: Generated 1819 derivative records from 11166 primary records. [2025-09-28T03:01:43.536006] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-28T03:01:43.539619] [DEBUG] [LOCAL ] CNC: Derivative data saved (1820 records). [2025-09-28T03:01:43.540322] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-28T03:01:43.543167] [INFO ] [MAIN ] Derivative Progress: 458/2211 symbols completed. CNC took 1.3s. Estimated remaining: 11m 52s. Rate: 147.8 symbols/min [2025-09-28T03:01:43.543417] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:43.575609] [DEBUG] [LOCAL ] CNF: Derivative data saved (1819 records). [2025-09-28T03:01:43.576043] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-28T03:01:43.578972] [INFO ] [MAIN ] Derivative Progress: 459/2211 symbols completed. CNF took 1.1s. Estimated remaining: 11m 50s. Rate: 148.1 symbols/min [2025-09-28T03:01:43.579419] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:43.605581] [DEBUG] [LOCAL ] CNH: Loaded 54337 existing records from primary storage. [2025-09-28T03:01:43.605934] [INFO ] [MAIN ] CNH: Loaded 54337 primary data records. [2025-09-28T03:01:43.867426] [DEBUG] [LOCAL ] CNI: Loaded 52419 existing records from primary storage. [2025-09-28T03:01:43.988875] [INFO ] [MAIN ] CNI: Loaded 52419 primary data records. [2025-09-28T03:01:44.119276] [DEBUG] [LOCAL ] CNK: Loaded 53658 existing records from primary storage. [2025-09-28T03:01:44.141425] [INFO ] [MAIN ] CNK: Loaded 53658 primary data records. [2025-09-28T03:01:44.670727] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:44.673569] [INFO ] [MAIN ] CNH: Generated 1820 derivative records from 54337 primary records. [2025-09-28T03:01:44.674040] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-28T03:01:44.693220] [DEBUG] [LOCAL ] CNH: Derivative data saved (1820 records). [2025-09-28T03:01:44.694173] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-28T03:01:44.697406] [INFO ] [MAIN ] Derivative Progress: 460/2211 symbols completed. CNH took 1.2s. Estimated remaining: 11m 52s. Rate: 147.5 symbols/min [2025-09-28T03:01:44.698136] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:44.718282] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:44.719516] [INFO ] [MAIN ] CNI: Generated 1820 derivative records from 52419 primary records. [2025-09-28T03:01:44.720110] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-28T03:01:44.744700] [DEBUG] [LOCAL ] CNI: Derivative data saved (1820 records). [2025-09-28T03:01:44.746611] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-28T03:01:44.749582] [INFO ] [MAIN ] Derivative Progress: 461/2211 symbols completed. CNI took 1.2s. Estimated remaining: 11m 50s. Rate: 147.8 symbols/min [2025-09-28T03:01:44.750057] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:44.764771] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:44.766182] [INFO ] [MAIN ] CNK: Generated 1820 derivative records from 53658 primary records. [2025-09-28T03:01:44.766634] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-28T03:01:44.804146] [DEBUG] [LOCAL ] CNK: Derivative data saved (1820 records). [2025-09-28T03:01:44.804622] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-28T03:01:44.808989] [INFO ] [MAIN ] Derivative Progress: 462/2211 symbols completed. CNK took 1.2s. Estimated remaining: 11m 49s. Rate: 148.1 symbols/min [2025-09-28T03:01:44.811334] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:44.830821] [DEBUG] [LOCAL ] CNM: Loaded 51747 existing records from primary storage. [2025-09-28T03:01:44.838943] [INFO ] [MAIN ] CNM: Loaded 51747 primary data records. [2025-09-28T03:01:44.973868] [DEBUG] [LOCAL ] CNMD: Loaded 32884 existing records from primary storage. [2025-09-28T03:01:45.014604] [INFO ] [MAIN ] CNMD: Loaded 32884 primary data records. [2025-09-28T03:01:45.357638] [DEBUG] [LOCAL ] CNNE: Loaded 37257 existing records from primary storage. [2025-09-28T03:01:45.363463] [INFO ] [MAIN ] CNNE: Loaded 37257 primary data records. [2025-09-28T03:01:45.960412] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:45.965924] [INFO ] [MAIN ] CNM: Generated 1820 derivative records from 51747 primary records. [2025-09-28T03:01:45.980609] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-28T03:01:45.982549] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:45.984103] [INFO ] [MAIN ] CNMD: Generated 1820 derivative records from 32884 primary records. [2025-09-28T03:01:45.984213] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-28T03:01:46.017844] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1820 records). [2025-09-28T03:01:46.018893] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-28T03:01:46.019333] [DEBUG] [LOCAL ] CNM: Derivative data saved (1820 records). [2025-09-28T03:01:46.022535] [INFO ] [MAIN ] Derivative Progress: 463/2211 symbols completed. CNMD took 1.3s. Estimated remaining: 11m 51s. Rate: 147.4 symbols/min [2025-09-28T03:01:46.022953] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-28T03:01:46.028822] [INFO ] [MAIN ] Derivative Progress: 464/2211 symbols completed. CNM took 1.3s. Estimated remaining: 11m 49s. Rate: 147.7 symbols/min [2025-09-28T03:01:46.042810] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:46.043449] [INFO ] [MAIN ] CNNE: Generated 1820 derivative records from 37257 primary records. [2025-09-28T03:01:46.043536] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-28T03:01:46.059347] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1820 records). [2025-09-28T03:01:46.059464] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-28T03:01:46.062144] [INFO ] [MAIN ] Derivative Progress: 465/2211 symbols completed. CNNE took 1.3s. Estimated remaining: 11m 48s. Rate: 148.0 symbols/min [2025-09-28T03:01:46.063041] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:46.062968] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:46.063112] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:46.161761] [DEBUG] [LOCAL ] CNO: Loaded 41901 existing records from primary storage. [2025-09-28T03:01:46.163006] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-09-28T03:01:46.163121] [INFO ] [MAIN ] CNO: Loaded 41901 primary data records. [2025-09-28T03:01:46.163589] [INFO ] [MAIN ] CNQ: Loaded 54361 primary data records. [2025-09-28T03:01:46.404922] [DEBUG] [LOCAL ] CNP: Loaded 54249 existing records from primary storage. [2025-09-28T03:01:46.433772] [INFO ] [MAIN ] CNP: Loaded 54249 primary data records. [2025-09-28T03:01:47.286945] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:47.302941] [INFO ] [MAIN ] CNO: Generated 1820 derivative records from 41901 primary records. [2025-09-28T03:01:47.303375] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-28T03:01:47.301598] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:47.305841] [INFO ] [MAIN ] CNQ: Generated 1820 derivative records from 54361 primary records. [2025-09-28T03:01:47.318978] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-28T03:01:47.352687] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1820 records). [2025-09-28T03:01:47.354804] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-28T03:01:47.358162] [INFO ] [MAIN ] Derivative Progress: 466/2211 symbols completed. CNQ took 1.3s. Estimated remaining: 11m 51s. Rate: 147.3 symbols/min [2025-09-28T03:01:47.354380] [DEBUG] [LOCAL ] CNO: Derivative data saved (1820 records). [2025-09-28T03:01:47.358673] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:47.358764] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-28T03:01:47.381153] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:47.382078] [INFO ] [MAIN ] CNP: Generated 1820 derivative records from 54249 primary records. [2025-09-28T03:01:47.379199] [INFO ] [MAIN ] Derivative Progress: 467/2211 symbols completed. CNO took 1.3s. Estimated remaining: 11m 49s. Rate: 147.6 symbols/min [2025-09-28T03:01:47.382360] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-28T03:01:47.382258] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:47.400218] [DEBUG] [LOCAL ] CNP: Derivative data saved (1820 records). [2025-09-28T03:01:47.400513] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-28T03:01:47.403194] [INFO ] [MAIN ] Derivative Progress: 468/2211 symbols completed. CNP took 1.3s. Estimated remaining: 11m 47s. Rate: 147.9 symbols/min [2025-09-28T03:01:47.403554] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:47.433199] [DEBUG] [LOCAL ] CNS: Loaded 21245 existing records from primary storage. [2025-09-28T03:01:47.433512] [INFO ] [MAIN ] CNS: Loaded 21245 primary data records. [2025-09-28T03:01:47.620938] [DEBUG] [LOCAL ] CNX: Loaded 52150 existing records from primary storage. [2025-09-28T03:01:47.653422] [INFO ] [MAIN ] CNX: Loaded 52150 primary data records. [2025-09-28T03:01:47.856548] [DEBUG] [LOCAL ] CODI: Loaded 40312 existing records from primary storage. [2025-09-28T03:01:47.883048] [INFO ] [MAIN ] CODI: Loaded 40312 primary data records. [2025-09-28T03:01:48.509629] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:48.511452] [INFO ] [MAIN ] CNS: Generated 1820 derivative records from 21245 primary records. [2025-09-28T03:01:48.511588] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-28T03:01:48.530322] [DEBUG] [LOCAL ] CNS: Derivative data saved (1820 records). [2025-09-28T03:01:48.530711] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-28T03:01:48.533194] [INFO ] [MAIN ] Derivative Progress: 469/2211 symbols completed. CNS took 1.2s. Estimated remaining: 11m 49s. Rate: 147.4 symbols/min [2025-09-28T03:01:48.533932] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:48.555294] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:48.556544] [INFO ] [MAIN ] CNX: Generated 1820 derivative records from 52150 primary records. [2025-09-28T03:01:48.556690] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-28T03:01:48.592026] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:48.593203] [DEBUG] [LOCAL ] CNX: Derivative data saved (1820 records). [2025-09-28T03:01:48.594201] [INFO ] [MAIN ] CODI: Generated 1820 derivative records from 40312 primary records. [2025-09-28T03:01:48.594375] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-28T03:01:48.594318] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-28T03:01:48.597815] [INFO ] [MAIN ] Derivative Progress: 470/2211 symbols completed. CNX took 1.2s. Estimated remaining: 11m 48s. Rate: 147.6 symbols/min [2025-09-28T03:01:48.598434] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:48.629267] [DEBUG] [LOCAL ] CODI: Derivative data saved (1820 records). [2025-09-28T03:01:48.629438] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-28T03:01:48.631912] [INFO ] [MAIN ] Derivative Progress: 471/2211 symbols completed. CODI took 1.2s. Estimated remaining: 11m 46s. Rate: 147.9 symbols/min [2025-09-28T03:01:48.632292] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:48.657559] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-09-28T03:01:48.657939] [INFO ] [MAIN ] COF: Loaded 54389 primary data records. [2025-09-28T03:01:48.883747] [DEBUG] [LOCAL ] COHR: Loaded 54144 existing records from primary storage. [2025-09-28T03:01:48.955250] [INFO ] [MAIN ] COHR: Loaded 54144 primary data records. [2025-09-28T03:01:49.064995] [DEBUG] [LOCAL ] COLD: Loaded 52785 existing records from primary storage. [2025-09-28T03:01:49.098691] [INFO ] [MAIN ] COLD: Loaded 52785 primary data records. [2025-09-28T03:01:49.802139] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:49.803509] [INFO ] [MAIN ] COF: Generated 1820 derivative records from 54389 primary records. [2025-09-28T03:01:49.803805] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-28T03:01:49.840272] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:49.840343] [DEBUG] [LOCAL ] COF: Derivative data saved (1820 records). [2025-09-28T03:01:49.841238] [INFO ] [MAIN ] COHR: Generated 1820 derivative records from 54144 primary records. [2025-09-28T03:01:49.842163] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-28T03:01:49.846106] [INFO ] [MAIN ] Derivative Progress: 472/2211 symbols completed. COF took 1.3s. Estimated remaining: 11m 48s. Rate: 147.3 symbols/min [2025-09-28T03:01:49.842459] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-28T03:01:49.847241] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:49.874090] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:49.878752] [INFO ] [MAIN ] COLD: Generated 1820 derivative records from 52785 primary records. [2025-09-28T03:01:49.879813] [DEBUG] [LOCAL ] COHR: Derivative data saved (1820 records). [2025-09-28T03:01:49.880042] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-28T03:01:49.879986] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-28T03:01:49.883898] [INFO ] [MAIN ] Derivative Progress: 473/2211 symbols completed. COHR took 1.3s. Estimated remaining: 11m 47s. Rate: 147.6 symbols/min [2025-09-28T03:01:49.884466] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:49.903463] [DEBUG] [LOCAL ] COLD: Derivative data saved (1820 records). [2025-09-28T03:01:49.903689] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-28T03:01:49.906562] [INFO ] [MAIN ] Derivative Progress: 474/2211 symbols completed. COLD took 1.3s. Estimated remaining: 11m 45s. Rate: 147.9 symbols/min [2025-09-28T03:01:49.907056] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:49.971340] [DEBUG] [LOCAL ] COOK: Loaded 24850 existing records from primary storage. [2025-09-28T03:01:49.971602] [INFO ] [MAIN ] COOK: Loaded 24850 primary data records. [2025-09-28T03:01:50.003805] [DEBUG] [LOCAL ] COMP: Loaded 54166 existing records from primary storage. [2025-09-28T03:01:50.015337] [INFO ] [MAIN ] COMP: Loaded 54166 primary data records. [2025-09-28T03:01:50.106613] [DEBUG] [LOCAL ] CON: Loaded 39289 existing records from primary storage. [2025-09-28T03:01:50.146919] [INFO ] [MAIN ] CON: Loaded 39289 primary data records. [2025-09-28T03:01:51.075048] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:51.076445] [INFO ] [MAIN ] COOK: Generated 1820 derivative records from 24850 primary records. [2025-09-28T03:01:51.077322] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-28T03:01:51.099623] [DEBUG] [LOCAL ] COOK: Derivative data saved (1820 records). [2025-09-28T03:01:51.115480] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-28T03:01:51.116554] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:51.117559] [INFO ] [MAIN ] COMP: Generated 1820 derivative records from 54166 primary records. [2025-09-28T03:01:51.119709] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-28T03:01:51.119587] [INFO ] [MAIN ] Derivative Progress: 475/2211 symbols completed. COOK took 1.2s. Estimated remaining: 11m 47s. Rate: 147.3 symbols/min [2025-09-28T03:01:51.120473] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:51.143977] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:51.148940] [INFO ] [MAIN ] CON: Generated 1820 derivative records from 39289 primary records. [2025-09-28T03:01:51.151004] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-28T03:01:51.155296] [DEBUG] [LOCAL ] COMP: Derivative data saved (1820 records). [2025-09-28T03:01:51.155719] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-28T03:01:51.170072] [INFO ] [MAIN ] Derivative Progress: 476/2211 symbols completed. COMP took 1.3s. Estimated remaining: 11m 46s. Rate: 147.5 symbols/min [2025-09-28T03:01:51.171503] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:51.177088] [DEBUG] [LOCAL ] CON: Derivative data saved (1820 records). [2025-09-28T03:01:51.178074] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-28T03:01:51.181173] [INFO ] [MAIN ] Derivative Progress: 477/2211 symbols completed. CON took 1.3s. Estimated remaining: 11m 44s. Rate: 147.8 symbols/min [2025-09-28T03:01:51.181553] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:51.229838] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-09-28T03:01:51.230102] [INFO ] [MAIN ] COP: Loaded 54507 primary data records. [2025-09-28T03:01:51.601859] [DEBUG] [LOCAL ] COTY: Loaded 54014 existing records from primary storage. [2025-09-28T03:01:51.612138] [INFO ] [MAIN ] COTY: Loaded 54014 primary data records. [2025-09-28T03:01:51.613179] [DEBUG] [LOCAL ] COR: Loaded 47937 existing records from primary storage. [2025-09-28T03:01:51.613326] [INFO ] [MAIN ] COR: Loaded 47937 primary data records. [2025-09-28T03:01:52.352013] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:52.353864] [INFO ] [MAIN ] COP: Generated 1820 derivative records from 54507 primary records. [2025-09-28T03:01:52.354286] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-28T03:01:52.375866] [DEBUG] [LOCAL ] COP: Derivative data saved (1820 records). [2025-09-28T03:01:52.376177] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-28T03:01:52.378348] [INFO ] [MAIN ] Derivative Progress: 478/2211 symbols completed. COP took 1.3s. Estimated remaining: 11m 46s. Rate: 147.2 symbols/min [2025-09-28T03:01:52.398104] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:52.399082] [INFO ] [MAIN ] COR: Generated 1820 derivative records from 47937 primary records. [2025-09-28T03:01:52.399355] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-28T03:01:52.412448] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:52.413921] [INFO ] [MAIN ] COTY: Generated 1820 derivative records from 54014 primary records. [2025-09-28T03:01:52.414213] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-28T03:01:52.446331] [DEBUG] [LOCAL ] COR: Derivative data saved (1820 records). [2025-09-28T03:01:52.446264] [DEBUG] [LOCAL ] COTY: Derivative data saved (1820 records). [2025-09-28T03:01:52.446760] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-28T03:01:52.446610] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-28T03:01:52.450609] [INFO ] [MAIN ] Derivative Progress: 479/2211 symbols completed. COTY took 1.3s. Estimated remaining: 11m 45s. Rate: 147.5 symbols/min [2025-09-28T03:01:52.453926] [INFO ] [MAIN ] Derivative Progress: 480/2211 symbols completed. COR took 1.3s. Estimated remaining: 11m 43s. Rate: 147.8 symbols/min [2025-09-28T03:01:52.454432] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:52.454343] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:52.454637] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:52.496989] [DEBUG] [LOCAL ] CPA: Loaded 29208 existing records from primary storage. [2025-09-28T03:01:52.497324] [INFO ] [MAIN ] CPA: Loaded 29208 primary data records. [2025-09-28T03:01:52.682011] [DEBUG] [LOCAL ] COUR: Loaded 49636 existing records from primary storage. [2025-09-28T03:01:52.717856] [INFO ] [MAIN ] COUR: Loaded 49636 primary data records. [2025-09-28T03:01:52.770261] [DEBUG] [LOCAL ] CP: Loaded 54051 existing records from primary storage. [2025-09-28T03:01:52.937692] [INFO ] [MAIN ] CP: Loaded 54051 primary data records. [2025-09-28T03:01:53.622679] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:53.624555] [INFO ] [MAIN ] CPA: Generated 1820 derivative records from 29208 primary records. [2025-09-28T03:01:53.625712] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-28T03:01:53.645586] [DEBUG] [LOCAL ] CPA: Derivative data saved (1820 records). [2025-09-28T03:01:53.645789] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-28T03:01:53.648169] [INFO ] [MAIN ] Derivative Progress: 481/2211 symbols completed. CPA took 1.2s. Estimated remaining: 11m 45s. Rate: 147.2 symbols/min [2025-09-28T03:01:53.649467] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:53.674507] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:53.675918] [INFO ] [MAIN ] CP: Generated 1820 derivative records from 54051 primary records. [2025-09-28T03:01:53.676329] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-28T03:01:53.703079] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:53.722523] [INFO ] [MAIN ] COUR: Generated 1820 derivative records from 49636 primary records. [2025-09-28T03:01:53.723192] [DEBUG] [LOCAL ] CP: Derivative data saved (1820 records). [2025-09-28T03:01:53.723577] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-28T03:01:53.726515] [INFO ] [MAIN ] Derivative Progress: 482/2211 symbols completed. CP took 1.3s. Estimated remaining: 11m 44s. Rate: 147.5 symbols/min [2025-09-28T03:01:53.723474] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-28T03:01:53.727554] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:53.759783] [DEBUG] [LOCAL ] CPAY: Loaded 31286 existing records from primary storage. [2025-09-28T03:01:53.758605] [DEBUG] [LOCAL ] COUR: Derivative data saved (1820 records). [2025-09-28T03:01:53.759986] [INFO ] [MAIN ] CPAY: Loaded 31286 primary data records. [2025-09-28T03:01:53.760086] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-28T03:01:53.762977] [INFO ] [MAIN ] Derivative Progress: 483/2211 symbols completed. COUR took 1.3s. Estimated remaining: 11m 42s. Rate: 147.7 symbols/min [2025-09-28T03:01:53.809772] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:53.858070] [DEBUG] [LOCAL ] CPF: Loaded 15618 existing records from primary storage. [2025-09-28T03:01:53.881575] [INFO ] [MAIN ] CPF: Loaded 15618 primary data records. [2025-09-28T03:01:54.034429] [DEBUG] [LOCAL ] CPK: Loaded 13588 existing records from primary storage. [2025-09-28T03:01:54.085851] [INFO ] [MAIN ] CPK: Loaded 13588 primary data records. [2025-09-28T03:01:54.902421] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:54.904122] [INFO ] [MAIN ] CPF: Generated 1820 derivative records from 15618 primary records. [2025-09-28T03:01:54.902927] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:54.905283] [INFO ] [MAIN ] CPAY: Generated 1820 derivative records from 31286 primary records. [2025-09-28T03:01:54.905488] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-28T03:01:54.906202] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-28T03:01:54.944480] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1820 records). [2025-09-28T03:01:54.959163] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-28T03:01:54.962108] [INFO ] [MAIN ] Derivative Progress: 484/2211 symbols completed. CPAY took 1.3s. Estimated remaining: 11m 44s. Rate: 147.1 symbols/min [2025-09-28T03:01:54.962746] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:54.945603] [DEBUG] [LOCAL ] CPF: Derivative data saved (1820 records). [2025-09-28T03:01:54.963227] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:54.963438] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-28T03:01:54.968751] [INFO ] [MAIN ] Derivative Progress: 485/2211 symbols completed. CPF took 1.2s. Estimated remaining: 11m 42s. Rate: 147.4 symbols/min [2025-09-28T03:01:54.969205] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:54.965239] [INFO ] [MAIN ] CPK: Generated 1820 derivative records from 13588 primary records. [2025-09-28T03:01:54.969818] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-28T03:01:54.990783] [DEBUG] [LOCAL ] CPK: Derivative data saved (1820 records). [2025-09-28T03:01:54.991201] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-28T03:01:54.993970] [INFO ] [MAIN ] Derivative Progress: 486/2211 symbols completed. CPK took 1.2s. Estimated remaining: 11m 41s. Rate: 147.7 symbols/min [2025-09-28T03:01:54.994332] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:55.055009] [DEBUG] [LOCAL ] CPS: Loaded 26476 existing records from primary storage. [2025-09-28T03:01:55.055393] [INFO ] [MAIN ] CPS: Loaded 26476 primary data records. [2025-09-28T03:01:55.208303] [DEBUG] [LOCAL ] CPRI: Loaded 53326 existing records from primary storage. [2025-09-28T03:01:55.208790] [INFO ] [MAIN ] CPRI: Loaded 53326 primary data records. [2025-09-28T03:01:55.210045] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-09-28T03:01:55.238433] [INFO ] [MAIN ] CPNG: Loaded 54450 primary data records. [2025-09-28T03:01:56.141477] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:56.142798] [INFO ] [MAIN ] CPS: Generated 1820 derivative records from 26476 primary records. [2025-09-28T03:01:56.143227] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-28T03:01:56.164018] [DEBUG] [LOCAL ] CPS: Derivative data saved (1820 records). [2025-09-28T03:01:56.164304] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-28T03:01:56.166169] [INFO ] [MAIN ] Derivative Progress: 487/2211 symbols completed. CPS took 1.2s. Estimated remaining: 11m 43s. Rate: 147.2 symbols/min [2025-09-28T03:01:56.166604] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:56.180674] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:56.181561] [INFO ] [MAIN ] CPRI: Generated 1820 derivative records from 53326 primary records. [2025-09-28T03:01:56.181701] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-28T03:01:56.200107] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1820 records). [2025-09-28T03:01:56.201924] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-28T03:01:56.205022] [INFO ] [MAIN ] Derivative Progress: 488/2211 symbols completed. CPRI took 1.2s. Estimated remaining: 11m 41s. Rate: 147.4 symbols/min [2025-09-28T03:01:56.205351] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-28T03:01:56.219860] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-28T03:01:56.220669] [INFO ] [MAIN ] CPNG: Generated 1820 derivative records from 54450 primary records. [2